2023-07-06T00:50:32.519 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T00:50:32.520 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} --owner scheduled_rishabh@teuthology --name rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779 --verbose -- /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/orig.config.yaml 2023-07-06T00:50:32.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T00:50:32.666 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779 branch: wip-rishabh-2023Jul5 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} email: null first_in_suite: false job_id: '7327779' kernel: client: branch: testing flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-rishabh-2023Jul5 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul5 sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh1FiUsm6UWjQTeRcXz5Gm5JfU5CUddCynwS0utyfFwmoR4cf9H1CosIW6mi51Z3OFzYDuyLg+kZEXQnHAe+xMfYkin0D52pWlBe2vtVtegKV6gSi2bPZZBdvK9dw+XKtteBSJnNTpnHvTJF2Yrrqgek11b7ah2tmHBhEdSHAj1Lff9kWDlUVvXtG2FCfEl37pLFx3XJ4lLEn6TGGszrRKjupnTZdCPtNbvf1n81p+PDOrGSGFrISjdKfoIELpSuJCWfoeVt5YALjj/KgD6YeYmJ9pU7baL1MDSVLtBCSwGDTU++Lk18aP3dkOGhQZtfLdDeCTbEMhschHkOBsXyjtab3c1tYMR3CaSssoTTUlQuZXuKjlKRgV4Le9Qfug+CzWXpRv7CUD/J+qufAOOFaA5NL/HtrjDWHJ4LsKXCj3gKefs0CfPpVvKCY8vg407f1FtUglSKisDdNeUrRT5N3LkNYX7SnhtuQPSqMa5LVQ6MyiX/jAvcD+h4NlbUhrSD0= smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDj5B0Sb4F/pfxtBCMrH5SFVfDCw3e5E78alRxLQitAg1KqDrFIra8rZ6nVmuYK2TrpQY3OnfmukqXMpeLB125bEAq3TGf6gWxwX7BRflCkJWEo2T18EYK8PKrcU2PJDga+4tQgIw1k2i6JbbtfPn54gYWDaNu6ON0m3Yaqs1qJ4wsLNmeVnzB39U9BxrxyTzG/W+9kjxC3ooaRCrc9V8l4kDJbQxXvXCuhjlKN40yMvaaupeV3AWoej876HFVczkrv8cXPicU3bv1linPy+XAwsfKPYE7QSj22Rj9KbG9EH8Hu+GN1WKFcK9LJN4vPpcGeIcnt13RYtfsUuQckfOG65pHn+wAjLx6adLuDL2G0zuDuGhNP+5wtlgZMFvb7JdfKr1iCtOeu4qVsmXZorH3SXd+eLwnH9O5x4Ytx2MSDyQ2qTxaHGppOJ0G2ST/SbacB+pWdccKDxhKf/Il6DuLTdHX4jYBnvRwqh56LpltlgQYwIdWPuCjawpJpKjuUEM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-05_22:21:20 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-06T00:50:32.667 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa; will attempt to use it 2023-07-06T00:50:32.668 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks 2023-07-06T00:50:32.668 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-06T00:50:32.670 INFO:teuthology.task.internal:Checking packages... 2023-07-06T00:50:32.700 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '79365bb3b803780276d69efb2cc4afe5b160de9e' 2023-07-06T00:50:32.701 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-06T00:50:32.701 INFO:teuthology.packaging:ref: None 2023-07-06T00:50:32.702 INFO:teuthology.packaging:tag: None 2023-07-06T00:50:32.702 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul5 2023-07-06T00:50:32.702 INFO:teuthology.packaging:sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T00:50:32.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul5 2023-07-06T00:50:32.846 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4742.g79365bb3 2023-07-06T00:50:32.847 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-06T00:50:32.854 INFO:teuthology.task.internal:no buildpackages task found 2023-07-06T00:50:32.854 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-06T00:50:32.868 INFO:teuthology.task.internal:Saving configuration 2023-07-06T00:50:32.889 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-06T00:50:32.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T00:50:32.928 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:44:57.431614', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnxEZ7eN5/uPU34LXjGCyJiViPQHzBTYwHFWB+0zVrHPp5rZA2JWMniWsNyQErxPblTDZ167wqC6lIBdS5Tc3U='} 2023-07-06T00:50:32.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:44:57.434855', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYp+c3TmbwGBDrAPZPiqZfgDl4/kZXXrTem1F1rfjfRoi8GvgY0/QhtKGFn0FWD/viERPAV39dTCyIbKgqsQuk='} 2023-07-06T00:50:32.957 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-06T00:50:32.962 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-06T00:50:32.963 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-06T00:50:32.963 INFO:teuthology.run_tasks:Running task console_log... 2023-07-06T00:50:33.051 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6165b39280>, signals=[15]) 2023-07-06T00:50:33.052 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-06T00:50:33.058 INFO:teuthology.task.internal:Opening connections... 2023-07-06T00:50:33.059 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T00:50:33.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:50:33.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T00:50:33.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:50:33.198 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-06T00:50:33.206 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-07-06T00:50:33.230 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-07-06T00:50:33.231 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-07-06T00:50:33.290 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-07-06T00:50:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-07-06T00:50:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-07-06T00:50:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-07-06T00:50:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-07-06T00:50:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:50:33.291 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T00:50:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-07-06T00:50:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T00:50:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-07-06T00:50:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:50:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:50:33.292 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T00:50:33.293 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-07-06T00:50:33.317 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-07-06T00:50:33.339 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-07-06T00:50:33.340 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-07-06T00:50:33.400 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-07-06T00:50:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2023-07-06T00:50:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-07-06T00:50:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-07-06T00:50:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2023-07-06T00:50:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:50:33.401 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T00:50:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-07-06T00:50:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T00:50:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-07-06T00:50:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:50:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:50:33.403 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T00:50:33.403 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-07-06T00:50:33.442 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-06T00:50:33.452 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-06T00:50:33.543 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-06T00:50:33.544 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2023-07-06T00:50:33.547 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2023-07-06T00:50:33.567 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-06T00:50:33.580 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-06T00:50:33.581 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2023-07-06T00:50:33.607 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2023-07-06T00:50:33.656 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-06T00:50:33.719 INFO:teuthology.run_tasks:Running task kernel... 2023-07-06T00:50:33.735 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-06T00:50:33.736 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-06T00:50:33.736 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-06T00:50:33.736 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-06T00:50:33.737 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-06T00:50:33.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T00:50:33.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-06T00:50:33.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T00:50:33.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-07-06T00:50:34.078 DEBUG:teuthology.task.kernel:sha1 for client.1 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T00:50:34.078 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-06T00:50:34.079 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2023-07-06T00:50:34.092 DEBUG:teuthology.task.kernel:sha1 for client.0 is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T00:50:34.093 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-06T00:50:34.093 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-07-06T00:50:34.105 INFO:teuthology.orchestra.run.smithi194.stdout:4.18.0-489.el8.x86_64 2023-07-06T00:50:34.105 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T00:50:34.106 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-06T00:50:34.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum upgrade -y linux-firmware 2023-07-06T00:50:34.118 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-489.el8.x86_64 2023-07-06T00:50:34.119 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T00:50:34.119 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-06T00:50:34.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum upgrade -y linux-firmware 2023-07-06T00:50:37.988 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - AppStream 23 MB/s | 31 MB 00:01 2023-07-06T00:50:38.563 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - AppStream 17 MB/s | 31 MB 00:01 2023-07-06T00:50:44.871 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - BaseOS 32 MB/s | 41 MB 00:01 2023-07-06T00:50:45.471 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - BaseOS 33 MB/s | 41 MB 00:01 2023-07-06T00:50:51.238 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-07-06T00:50:51.613 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras common packages 33 kB/s | 6.6 kB 00:00 2023-07-06T00:50:51.879 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2023-07-06T00:50:52.263 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras common packages 32 kB/s | 6.6 kB 00:00 2023-07-06T00:50:54.106 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-07-06T00:50:54.365 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-07-06T00:50:55.515 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-07-06T00:50:55.765 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-07-06T00:50:59.215 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 570 kB/s | 24 kB 00:00 2023-07-06T00:50:59.565 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-07-06T00:51:02.726 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-07-06T00:51:02.726 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-07-06T00:51:02.726 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repo Size 2023-07-06T00:51:02.727 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-07-06T00:51:02.727 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2023-07-06T00:51:02.727 INFO:teuthology.orchestra.run.smithi071.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-06T00:51:02.727 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T00:51:02.728 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-07-06T00:51:02.728 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2023-07-06T00:51:02.728 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 1 Package 2023-07-06T00:51:02.728 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T00:51:02.729 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 266 M 2023-07-06T00:51:02.729 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-07-06T00:51:03.050 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-07-06T00:51:03.050 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-07-06T00:51:03.051 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2023-07-06T00:51:03.051 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-07-06T00:51:03.051 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2023-07-06T00:51:03.051 INFO:teuthology.orchestra.run.smithi194.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-07-06T00:51:03.051 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T00:51:03.051 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-07-06T00:51:03.052 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-07-06T00:51:03.052 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 1 Package 2023-07-06T00:51:03.052 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T00:51:03.052 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 266 M 2023-07-06T00:51:03.053 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-07-06T00:51:09.391 INFO:teuthology.orchestra.run.smithi194.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 42 MB/s | 266 MB 00:06 2023-07-06T00:51:09.391 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-07-06T00:51:09.392 INFO:teuthology.orchestra.run.smithi194.stdout:Total 42 MB/s | 266 MB 00:06 2023-07-06T00:51:10.624 INFO:teuthology.orchestra.run.smithi071.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 34 MB/s | 266 MB 00:07 2023-07-06T00:51:10.624 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-07-06T00:51:10.625 INFO:teuthology.orchestra.run.smithi071.stdout:Total 34 MB/s | 266 MB 00:07 2023-07-06T00:51:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-07-06T00:51:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-07-06T00:51:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-07-06T00:51:12.206 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-07-06T00:51:12.282 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-07-06T00:51:12.282 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-07-06T00:51:12.687 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-07-06T00:51:12.706 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-07-06T00:51:13.950 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-07-06T00:51:13.978 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-07-06T00:51:30.450 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-07-06T00:51:30.841 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-06T00:51:31.088 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-06T00:51:31.329 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-06T00:51:31.329 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-06T00:51:31.959 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-07-06T00:51:32.001 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-06T00:51:32.001 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T00:51:32.002 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2023-07-06T00:51:32.002 INFO:teuthology.orchestra.run.smithi194.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-06T00:51:32.002 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T00:51:32.003 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-07-06T00:51:32.160 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-06T00:51:32.161 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T00:51:32.313 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-06T00:51:32.373 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-06T00:51:32.373 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-06T00:51:32.376 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi194.front.sepia.ceph.com to complete... 2023-07-06T00:51:32.892 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-06T00:51:33.173 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-06T00:51:33.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-07-06T00:51:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-07-06T00:51:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T00:51:33.922 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2023-07-06T00:51:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-07-06T00:51:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T00:51:33.923 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-07-06T00:51:34.111 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-06T00:51:34.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-06T00:51:34.253 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ 2023-07-06T00:51:34.254 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_g84139c18d56f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-06T00:51:34.256 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi071.front.sepia.ceph.com to complete... 2023-07-06T00:51:48.968 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06 00:51:48 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-06T00:51:48.968 INFO:teuthology.orchestra.run.smithi194.stderr:FINISHED --2023-07-06 00:51:48-- 2023-07-06T00:51:48.968 INFO:teuthology.orchestra.run.smithi194.stderr:Total wall clock time: 17s 2023-07-06T00:51:48.968 INFO:teuthology.orchestra.run.smithi194.stderr:Downloaded: 1 files, 362M in 16s (22.4 MB/s) 2023-07-06T00:51:48.970 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.1... 2023-07-06T00:51:48.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-06T00:51:50.627 INFO:teuthology.orchestra.run.smithi194.stdout:Verifying... ######################################## 2023-07-06T00:51:50.671 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing... ######################################## 2023-07-06T00:51:50.780 INFO:teuthology.orchestra.run.smithi194.stdout:Updating / installing... 2023-07-06T00:51:59.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06 00:51:59 URL:https://2.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/centos/8/flavors/default/x86_64/kernel-6.4.0_g84139c18d56f-1.x86_64.rpm [379858600/379858600] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-06T00:51:59.149 INFO:teuthology.orchestra.run.smithi071.stderr:FINISHED --2023-07-06 00:51:59-- 2023-07-06T00:51:59.149 INFO:teuthology.orchestra.run.smithi071.stderr:Total wall clock time: 25s 2023-07-06T00:51:59.149 INFO:teuthology.orchestra.run.smithi071.stderr:Downloaded: 1 files, 362M in 24s (14.9 MB/s) 2023-07-06T00:51:59.150 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on client.0... 2023-07-06T00:51:59.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-06T00:52:00.798 INFO:teuthology.orchestra.run.smithi071.stdout:Verifying... ######################################## 2023-07-06T00:52:00.842 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing... ######################################## 2023-07-06T00:52:00.952 INFO:teuthology.orchestra.run.smithi071.stdout:Updating / installing... 2023-07-06T00:52:28.667 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-06T00:52:38.845 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-6.4.0_g84139c18d56f-1 ######################################## 2023-07-06T00:52:52.321 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-06T00:52:52.321 DEBUG:teuthology.orchestra.run.smithi194:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-06T00:52:52.382 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-06T00:52:52.382 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-06T00:52:52.382 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T00:52:52.382 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-06T00:52:52.382 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-06T00:52:52.382 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-06T00:52:52.383 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-06T00:52:52.383 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-06T00:52:52.383 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-06T00:52:52.383 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-06T00:52:52.383 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-06T00:52:52.383 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-06T00:52:52.384 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-06T00:52:52.384 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-06T00:52:52.384 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-06T00:52:52.384 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-06T00:52:52.384 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-06T00:52:52.384 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-06T00:52:52.385 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-06T00:52:52.386 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-06T00:52:52.387 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-06T00:52:52.388 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-06T00:52:52.389 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-06T00:52:52.389 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-06T00:52:52.389 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-06T00:52:52.389 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-06T00:52:52.389 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-06T00:52:52.389 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-06T00:52:52.390 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-06T00:52:52.391 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-06T00:52:52.392 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-06T00:52:52.392 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-06T00:52:52.392 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-06T00:52:52.392 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-06T00:52:52.392 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-06T00:52:52.392 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-06T00:52:52.393 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-06T00:52:52.393 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-06T00:52:52.393 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-06T00:52:52.393 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-06T00:52:52.393 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-06T00:52:52.394 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-06T00:52:52.395 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-06T00:52:52.396 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-06T00:52:52.396 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-06T00:52:52.396 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-06T00:52:52.396 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-06T00:52:52.396 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-06T00:52:52.397 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-06T00:52:52.398 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-06T00:52:52.399 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-06T00:52:52.400 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-06T00:52:52.401 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-06T00:52:52.402 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-06T00:52:52.403 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-06T00:52:52.404 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-06T00:52:52.404 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-06T00:52:52.404 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-06T00:52:52.404 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-06T00:52:52.404 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-06T00:52:52.404 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-06T00:52:52.405 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-06T00:52:52.406 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-06T00:52:52.406 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-06T00:52:52.406 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-06T00:52:52.406 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-06T00:52:52.406 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-06T00:52:52.407 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-06T00:52:52.407 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-06T00:52:52.407 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-06T00:52:52.407 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-06T00:52:52.408 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-06T00:52:52.408 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-06T00:52:52.408 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-06T00:52:52.409 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-06T00:52:52.409 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-06T00:52:52.409 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-06T00:52:52.410 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-06T00:52:52.410 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-06T00:52:52.410 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-06T00:52:52.410 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-06T00:52:52.411 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-06T00:52:52.411 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-06T00:52:52.411 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-06T00:52:52.411 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-06T00:52:52.412 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-06T00:52:52.412 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-06T00:52:52.412 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-06T00:52:52.413 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-06T00:52:52.414 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-06T00:52:52.415 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-06T00:52:52.416 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-06T00:52:52.417 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-06T00:52:52.418 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-06T00:52:52.419 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-06T00:52:52.420 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-06T00:52:52.421 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-06T00:52:52.421 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-06T00:52:52.421 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-06T00:52:52.421 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-06T00:52:52.421 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-06T00:52:52.421 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-06T00:52:52.422 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-06T00:52:52.423 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-06T00:52:52.424 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-06T00:52:52.424 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-06T00:52:52.424 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-06T00:52:52.424 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-06T00:52:52.424 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-06T00:52:52.424 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-06T00:52:52.425 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-06T00:52:52.425 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-06T00:52:52.425 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-06T00:52:52.425 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-06T00:52:52.425 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-06T00:52:52.425 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-06T00:52:52.426 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-06T00:52:52.426 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-06T00:52:52.426 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-06T00:52:52.426 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-06T00:52:52.426 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-06T00:52:52.427 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-06T00:52:52.427 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-06T00:52:52.427 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-06T00:52:52.427 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-06T00:52:52.428 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-06T00:52:52.428 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-06T00:52:52.428 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-06T00:52:52.428 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-06T00:52:52.428 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-06T00:52:52.429 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-06T00:52:52.429 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-06T00:52:52.429 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-06T00:52:52.429 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-06T00:52:52.429 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-06T00:52:52.429 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-06T00:52:52.430 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-06T00:52:52.431 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-06T00:52:52.432 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-06T00:52:52.432 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-06T00:52:52.432 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-06T00:52:52.432 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-06T00:52:52.432 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-06T00:52:52.433 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-06T00:52:52.433 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-06T00:52:52.433 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-06T00:52:52.434 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-06T00:52:52.434 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-06T00:52:52.435 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-06T00:52:52.435 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-06T00:52:52.435 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-06T00:52:52.436 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-06T00:52:52.436 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-06T00:52:52.436 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-06T00:52:52.436 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-06T00:52:52.437 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-06T00:52:52.437 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-06T00:52:52.437 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-06T00:52:52.437 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-06T00:52:52.438 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-06T00:52:52.438 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-06T00:52:52.438 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-06T00:52:52.439 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-06T00:52:52.439 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-06T00:52:52.439 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-06T00:52:52.439 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-06T00:52:52.440 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-06T00:52:52.441 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-06T00:52:52.441 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-06T00:52:52.441 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-06T00:52:52.441 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-06T00:52:52.441 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-06T00:52:52.441 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-06T00:52:52.442 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-06T00:52:52.442 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-06T00:52:52.442 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-06T00:52:52.442 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-06T00:52:52.443 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-06T00:52:52.443 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-06T00:52:52.443 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-06T00:52:52.444 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-06T00:52:52.444 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-06T00:52:52.444 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-06T00:52:52.444 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-06T00:52:52.445 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-06T00:52:52.445 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-06T00:52:52.445 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-06T00:52:52.446 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-06T00:52:52.446 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-06T00:52:52.446 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-06T00:52:52.446 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-06T00:52:52.446 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-06T00:52:52.447 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-06T00:52:52.447 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-06T00:52:52.447 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-06T00:52:52.447 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-06T00:52:52.447 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-06T00:52:52.448 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-06T00:52:52.448 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-06T00:52:52.448 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-06T00:52:52.449 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-06T00:52:52.449 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-06T00:52:52.449 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-06T00:52:52.449 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-06T00:52:52.450 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-06T00:52:52.450 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-06T00:52:52.450 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-06T00:52:52.450 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-06T00:52:52.451 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-06T00:52:52.451 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-06T00:52:52.451 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-06T00:52:52.452 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-06T00:52:52.452 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-06T00:52:52.452 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-06T00:52:52.453 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-06T00:52:52.453 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-06T00:52:52.453 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-06T00:52:52.453 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-06T00:52:52.453 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-06T00:52:52.454 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-06T00:52:52.455 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-06T00:52:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-06T00:52:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-06T00:52:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-06T00:52:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-06T00:52:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-06T00:52:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-06T00:52:52.457 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-06T00:52:52.458 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-06T00:52:52.459 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-06T00:52:52.460 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-06T00:52:52.461 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-06T00:52:52.462 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-06T00:52:52.463 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-06T00:52:52.464 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-06T00:52:52.465 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-06T00:52:52.466 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-06T00:52:52.467 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-06T00:52:52.468 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-06T00:52:52.469 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-06T00:52:52.470 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-06T00:52:52.471 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-06T00:52:52.472 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-06T00:52:52.473 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-06T00:52:52.474 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-06T00:52:52.474 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-06T00:52:52.474 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-06T00:52:52.474 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-06T00:52:52.474 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-06T00:52:52.474 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-06T00:52:52.475 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-06T00:52:52.476 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-06T00:52:52.477 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-06T00:52:52.478 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-06T00:52:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-06T00:52:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-06T00:52:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-06T00:52:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-06T00:52:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-06T00:52:52.479 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-06T00:52:52.480 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-06T00:52:52.481 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-06T00:52:52.482 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-06T00:52:52.483 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-06T00:52:52.484 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-06T00:52:52.485 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-06T00:52:52.486 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-06T00:52:52.487 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-06T00:52:52.488 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-06T00:52:52.489 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-06T00:52:52.490 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-06T00:52:52.491 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-06T00:52:52.492 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-06T00:52:52.493 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-06T00:52:52.494 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-06T00:52:52.495 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-06T00:52:52.496 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-06T00:52:52.496 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-06T00:52:52.496 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-06T00:52:52.496 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-06T00:52:52.496 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-06T00:52:52.497 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-06T00:52:52.498 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-06T00:52:52.499 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-06T00:52:52.500 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-06T00:52:52.501 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-06T00:52:52.502 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-06T00:52:52.503 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-06T00:52:52.504 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-06T00:52:52.505 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-06T00:52:52.506 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-06T00:52:52.507 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-06T00:52:52.508 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-06T00:52:52.508 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-06T00:52:52.508 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-06T00:52:52.508 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-06T00:52:52.508 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-06T00:52:52.508 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-06T00:52:52.509 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-06T00:52:52.510 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-06T00:52:52.511 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-06T00:52:52.512 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-06T00:52:52.513 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-06T00:52:52.514 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-06T00:52:52.515 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-06T00:52:52.516 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-06T00:52:52.517 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-06T00:52:52.518 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-06T00:52:52.519 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-06T00:52:52.520 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-06T00:52:52.521 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-06T00:52:52.522 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-06T00:52:52.523 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-06T00:52:52.524 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-06T00:52:52.525 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-06T00:52:52.526 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-06T00:52:52.527 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-06T00:52:52.528 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-06T00:52:52.529 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-06T00:52:52.530 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-06T00:52:52.531 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-06T00:52:52.532 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-06T00:52:52.533 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-06T00:52:52.534 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-06T00:52:52.535 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-06T00:52:52.536 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-06T00:52:52.537 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-06T00:52:52.538 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-06T00:52:52.539 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-06T00:52:52.540 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-06T00:52:52.541 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-06T00:52:52.542 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-06T00:52:52.543 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-06T00:52:52.544 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-06T00:52:52.545 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-06T00:52:52.546 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-06T00:52:52.547 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-06T00:52:52.548 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-06T00:52:52.548 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-06T00:52:52.548 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-06T00:52:52.548 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-06T00:52:52.549 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-06T00:52:52.550 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-06T00:52:52.551 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-06T00:52:52.552 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-06T00:52:52.553 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-06T00:52:52.554 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-06T00:52:52.555 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-06T00:52:52.556 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-06T00:52:52.557 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-06T00:52:52.557 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-06T00:52:52.557 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-06T00:52:52.557 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-06T00:52:52.557 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-06T00:52:52.557 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-06T00:52:52.558 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-06T00:52:52.558 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-06T00:52:52.558 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-06T00:52:52.558 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-06T00:52:52.558 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-06T00:52:52.558 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-06T00:52:52.559 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-06T00:52:52.559 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-06T00:52:52.559 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-06T00:52:52.559 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-06T00:52:52.559 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-06T00:52:52.559 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-06T00:52:52.560 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-06T00:52:52.560 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-06T00:52:52.560 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-06T00:52:52.560 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-06T00:52:52.560 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-06T00:52:52.560 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-06T00:52:52.561 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-06T00:52:52.561 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-06T00:52:52.561 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-06T00:52:52.561 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-06T00:52:52.561 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-06T00:52:52.561 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-06T00:52:52.562 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-06T00:52:52.562 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-06T00:52:52.562 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-06T00:52:52.562 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-06T00:52:52.562 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-06T00:52:52.563 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-06T00:52:52.563 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-06T00:52:52.563 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-06T00:52:52.563 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-06T00:52:52.563 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-06T00:52:52.564 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-06T00:52:52.564 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-06T00:52:52.564 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-06T00:52:52.564 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-06T00:52:52.564 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-06T00:52:52.564 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-06T00:52:52.565 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-06T00:52:52.565 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-06T00:52:52.565 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-06T00:52:52.565 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-06T00:52:52.565 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-06T00:52:52.565 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-06T00:52:52.566 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-06T00:52:52.567 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-06T00:52:52.568 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-06T00:52:52.569 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-06T00:52:52.570 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-06T00:52:52.571 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-06T00:52:52.572 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-06T00:52:52.573 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-06T00:52:52.574 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-06T00:52:52.575 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-06T00:52:52.576 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-06T00:52:52.577 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-06T00:52:52.578 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-06T00:52:52.579 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-06T00:52:52.580 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-06T00:52:52.581 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-06T00:52:52.582 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-06T00:52:52.583 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-06T00:52:52.584 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-06T00:52:52.585 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-06T00:52:52.586 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-06T00:52:52.587 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-06T00:52:52.588 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-06T00:52:52.589 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-06T00:52:52.590 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-06T00:52:52.590 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-06T00:52:52.590 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-06T00:52:52.590 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-06T00:52:52.590 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-06T00:52:52.591 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-06T00:52:52.592 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-06T00:52:52.593 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-06T00:52:52.593 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-06T00:52:52.593 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-06T00:52:52.593 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-06T00:52:52.593 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-06T00:52:52.593 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-06T00:52:52.594 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-06T00:52:52.595 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-06T00:52:52.596 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-06T00:52:52.597 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-06T00:52:52.598 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-06T00:52:52.599 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-06T00:52:52.600 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-06T00:52:52.601 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-06T00:52:52.602 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-06T00:52:52.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-06T00:52:52.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-06T00:52:52.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-06T00:52:52.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-06T00:52:52.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-06T00:52:52.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-06T00:52:52.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-06T00:52:52.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-06T00:52:52.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-06T00:52:52.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-06T00:52:52.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-06T00:52:52.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-06T00:52:52.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-06T00:52:52.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-06T00:52:52.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-06T00:52:52.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-06T00:52:52.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-06T00:52:52.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-06T00:52:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-06T00:52:52.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-06T00:52:52.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-06T00:52:52.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-06T00:52:52.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-06T00:52:52.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-06T00:52:52.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-06T00:52:52.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-06T00:52:52.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-06T00:52:52.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-06T00:52:52.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-06T00:52:52.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-06T00:52:52.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-06T00:52:52.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-06T00:52:52.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-06T00:52:52.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-06T00:52:52.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-06T00:52:52.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-06T00:52:52.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-06T00:52:52.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-06T00:52:52.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-06T00:52:52.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-06T00:52:52.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-06T00:52:52.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-06T00:52:52.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-06T00:52:52.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-06T00:52:52.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-06T00:52:52.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-06T00:52:52.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-06T00:52:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-06T00:52:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-06T00:52:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-06T00:52:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-06T00:52:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-06T00:52:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-06T00:52:52.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-06T00:52:52.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-06T00:52:52.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-06T00:52:52.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-06T00:52:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-06T00:52:52.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-06T00:52:52.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-06T00:52:52.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-06T00:52:52.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-06T00:52:52.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-06T00:52:52.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-06T00:52:52.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-06T00:52:52.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-06T00:52:52.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-06T00:52:52.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-06T00:52:52.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-06T00:52:52.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-06T00:52:52.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-06T00:52:52.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-06T00:52:52.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-06T00:52:52.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-06T00:52:52.662 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-06T00:52:52.663 DEBUG:teuthology.orchestra.run.smithi194:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-06T00:52:52.689 INFO:teuthology.orchestra.run.smithi194.stdout:postinstall scriptlet (using /bin/sh): 2023-07-06T00:52:52.689 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-06T00:52:52.689 INFO:teuthology.orchestra.run.smithi194.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-06T00:52:52.689 INFO:teuthology.orchestra.run.smithi194.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-06T00:52:52.689 INFO:teuthology.orchestra.run.smithi194.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-06T00:52:52.689 INFO:teuthology.orchestra.run.smithi194.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-06T00:52:52.690 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2023-07-06T00:52:52.691 INFO:teuthology.orchestra.run.smithi194.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-06T00:52:52.691 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-06T00:52:52.691 INFO:teuthology.orchestra.run.smithi194.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-06T00:52:52.691 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2023-07-06T00:52:52.692 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2023-07-06T00:52:52.768 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2023-07-06T00:52:52.769 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2023-07-06T00:52:52.769 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.02 2023-07-06T00:52:52.769 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 129.el8 2023-07-06T00:52:52.769 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2023-07-06T00:52:52.769 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-06T00:52:52.769 INFO:teuthology.orchestra.run.smithi194.stdout:Group : System Environment/Base 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 9265586 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-06T00:52:52.770 INFO:teuthology.orchestra.run.smithi194.stdout:Relocations : (not relocatable) 2023-07-06T00:52:52.771 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : CentOS BuildSystem 2023-07-06T00:52:52.771 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2023-07-06T00:52:52.771 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-06T00:52:52.771 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2023-07-06T00:52:52.771 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2023-07-06T00:52:52.771 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T00:52:52.772 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-06T00:52:52.772 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-06T00:52:52.772 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-06T00:52:52.772 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2023-07-06T00:52:52.772 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T00:52:52.772 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2023-07-06T00:52:52.773 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-06T00:52:52.774 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 6.4.0-g84139c18d56f 2023-07-06T00:52:52.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-06T00:52:57.016 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2023-07-06T00:52:59.134 INFO:teuthology.orchestra.run.smithi194.stderr:done 2023-07-06T00:52:59.137 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-07-06T00:52:59.177 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.sByiLGyekG 2023-07-06T00:52:59.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sByiLGyekG 2023-07-06T00:52:59.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.sByiLGyekG 2023-07-06T00:52:59.404 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.sByiLGyekG is 6KB 2023-07-06T00:52:59.426 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.sByiLGyekG 2023-07-06T00:52:59.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2023-07-06T00:52:59.519 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-06T00:52:59.519 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-06T00:52:59.520 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-06T00:52:59.520 INFO:teuthology.orchestra.run.smithi194.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-06T00:52:59.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-06T00:52:59.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2023-07-06T00:53:01.322 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-06T00:53:01.322 DEBUG:teuthology.orchestra.run.smithi071:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-06T00:53:01.374 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/System.map-6.4.0-g84139c18d56f 2023-07-06T00:53:01.374 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/config-6.4.0-g84139c18d56f 2023-07-06T00:53:01.374 INFO:teuthology.orchestra.run.smithi071.stdout:/boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-06T00:53:01.374 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f 2023-07-06T00:53:01.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel 2023-07-06T00:53:01.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch 2023-07-06T00:53:01.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86 2023-07-06T00:53:01.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto 2023-07-06T00:53:01.375 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-06T00:53:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-06T00:53:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-06T00:53:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-06T00:53:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-06T00:53:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-06T00:53:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-06T00:53:01.377 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel 2023-07-06T00:53:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto 2023-07-06T00:53:01.379 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-06T00:53:01.380 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-06T00:53:01.381 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-06T00:53:01.382 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-06T00:53:01.383 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-06T00:53:01.384 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-06T00:53:01.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-06T00:53:01.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-06T00:53:01.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-06T00:53:01.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-06T00:53:01.385 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-06T00:53:01.386 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-06T00:53:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-06T00:53:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-06T00:53:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-06T00:53:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-06T00:53:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-06T00:53:01.387 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/custom_method.ko 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-06T00:53:01.388 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-06T00:53:01.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-06T00:53:01.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-06T00:53:01.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata 2023-07-06T00:53:01.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-06T00:53:01.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-06T00:53:01.389 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ata_generic.ko 2023-07-06T00:53:01.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-06T00:53:01.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-06T00:53:01.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-06T00:53:01.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-06T00:53:01.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-06T00:53:01.390 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-06T00:53:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-06T00:53:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-06T00:53:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-06T00:53:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-06T00:53:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-06T00:53:01.391 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-06T00:53:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-06T00:53:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-06T00:53:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-06T00:53:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-06T00:53:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-06T00:53:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-06T00:53:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-06T00:53:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-06T00:53:01.393 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-06T00:53:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-06T00:53:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-06T00:53:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-06T00:53:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-06T00:53:01.394 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-06T00:53:01.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-06T00:53:01.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-06T00:53:01.395 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-06T00:53:01.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-06T00:53:01.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-06T00:53:01.396 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-06T00:53:01.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-06T00:53:01.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-06T00:53:01.397 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-06T00:53:01.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sis.ko 2023-07-06T00:53:01.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-06T00:53:01.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-06T00:53:01.398 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-06T00:53:01.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-06T00:53:01.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-06T00:53:01.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-06T00:53:01.399 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-06T00:53:01.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-06T00:53:01.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-06T00:53:01.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-06T00:53:01.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-06T00:53:01.400 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-06T00:53:01.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-06T00:53:01.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-06T00:53:01.401 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap 2023-07-06T00:53:01.402 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-06T00:53:01.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma 2023-07-06T00:53:01.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-06T00:53:01.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block 2023-07-06T00:53:01.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe 2023-07-06T00:53:01.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-06T00:53:01.403 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/brd.ko 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/loop.ko 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-06T00:53:01.404 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/virtio_blk.ko 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-06T00:53:01.405 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkfront.ko 2023-07-06T00:53:01.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram 2023-07-06T00:53:01.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-06T00:53:01.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char 2023-07-06T00:53:01.406 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-06T00:53:01.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random 2023-07-06T00:53:01.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-06T00:53:01.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-06T00:53:01.407 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-06T00:53:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-06T00:53:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-06T00:53:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi 2023-07-06T00:53:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-06T00:53:01.408 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-06T00:53:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-06T00:53:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-06T00:53:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-06T00:53:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-06T00:53:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-06T00:53:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave 2023-07-06T00:53:01.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-06T00:53:01.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-06T00:53:01.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-06T00:53:01.410 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm 2023-07-06T00:53:01.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm.ko 2023-07-06T00:53:01.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-06T00:53:01.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-06T00:53:01.411 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-06T00:53:01.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-06T00:53:01.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-06T00:53:01.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/uv_mmtimer.ko 2023-07-06T00:53:01.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/virtio_console.ko 2023-07-06T00:53:01.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq 2023-07-06T00:53:01.412 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto 2023-07-06T00:53:01.413 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-06T00:53:01.414 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq 2023-07-06T00:53:01.415 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-06T00:53:01.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma 2023-07-06T00:53:01.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw 2023-07-06T00:53:01.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-06T00:53:01.416 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat 2023-07-06T00:53:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-06T00:53:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac 2023-07-06T00:53:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-06T00:53:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-06T00:53:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-06T00:53:01.417 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-06T00:53:01.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-06T00:53:01.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-06T00:53:01.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-06T00:53:01.418 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-06T00:53:01.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-06T00:53:01.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-06T00:53:01.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-06T00:53:01.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-06T00:53:01.419 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-06T00:53:01.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware 2023-07-06T00:53:01.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/edd.ko 2023-07-06T00:53:01.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-06T00:53:01.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio 2023-07-06T00:53:01.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-06T00:53:01.420 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-06T00:53:01.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid 2023-07-06T00:53:01.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-06T00:53:01.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-06T00:53:01.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-06T00:53:01.421 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-06T00:53:01.422 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-06T00:53:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-06T00:53:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-06T00:53:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-06T00:53:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-06T00:53:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-06T00:53:01.423 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-06T00:53:01.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-06T00:53:01.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-06T00:53:01.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-06T00:53:01.424 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-06T00:53:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-06T00:53:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-06T00:53:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-06T00:53:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-06T00:53:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-06T00:53:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-06T00:53:01.426 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-06T00:53:01.427 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-06T00:53:01.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-06T00:53:01.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-06T00:53:01.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-06T00:53:01.428 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-06T00:53:01.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-06T00:53:01.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-06T00:53:01.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-06T00:53:01.429 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-06T00:53:01.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-06T00:53:01.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-06T00:53:01.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-06T00:53:01.430 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-06T00:53:01.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-06T00:53:01.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-06T00:53:01.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-06T00:53:01.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-06T00:53:01.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-06T00:53:01.431 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-06T00:53:01.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-06T00:53:01.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-06T00:53:01.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-06T00:53:01.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-06T00:53:01.432 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-06T00:53:01.433 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-06T00:53:01.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-06T00:53:01.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-06T00:53:01.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-06T00:53:01.434 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-06T00:53:01.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-06T00:53:01.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-06T00:53:01.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-06T00:53:01.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-06T00:53:01.435 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-06T00:53:01.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-06T00:53:01.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-06T00:53:01.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-06T00:53:01.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-06T00:53:01.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-06T00:53:01.436 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-06T00:53:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-06T00:53:01.438 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-06T00:53:01.439 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-06T00:53:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-06T00:53:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-06T00:53:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-06T00:53:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-06T00:53:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-06T00:53:01.440 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-06T00:53:01.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-06T00:53:01.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-06T00:53:01.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-06T00:53:01.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-06T00:53:01.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-06T00:53:01.441 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-06T00:53:01.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-06T00:53:01.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-06T00:53:01.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-06T00:53:01.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-06T00:53:01.442 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-06T00:53:01.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-06T00:53:01.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-06T00:53:01.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-06T00:53:01.443 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-06T00:53:01.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-06T00:53:01.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-06T00:53:01.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-06T00:53:01.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-06T00:53:01.444 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-06T00:53:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-06T00:53:01.446 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-06T00:53:01.447 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-06T00:53:01.448 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-06T00:53:01.449 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-06T00:53:01.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-06T00:53:01.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-06T00:53:01.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-06T00:53:01.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-06T00:53:01.450 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-06T00:53:01.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-06T00:53:01.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-06T00:53:01.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-06T00:53:01.451 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-06T00:53:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-06T00:53:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-06T00:53:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-06T00:53:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-06T00:53:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-06T00:53:01.452 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-06T00:53:01.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-06T00:53:01.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-06T00:53:01.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-06T00:53:01.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-06T00:53:01.453 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-06T00:53:01.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-06T00:53:01.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-06T00:53:01.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-06T00:53:01.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-06T00:53:01.454 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-06T00:53:01.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-06T00:53:01.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-06T00:53:01.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c 2023-07-06T00:53:01.455 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos 2023-07-06T00:53:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-06T00:53:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-06T00:53:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses 2023-07-06T00:53:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-06T00:53:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-06T00:53:01.456 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-06T00:53:01.457 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-06T00:53:01.458 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-dev.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-06T00:53:01.459 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-06T00:53:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-06T00:53:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-06T00:53:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband 2023-07-06T00:53:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core 2023-07-06T00:53:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-06T00:53:01.460 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-06T00:53:01.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-06T00:53:01.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-06T00:53:01.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-06T00:53:01.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-06T00:53:01.461 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5 2023-07-06T00:53:01.462 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-06T00:53:01.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca 2023-07-06T00:53:01.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-06T00:53:01.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp 2023-07-06T00:53:01.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib 2023-07-06T00:53:01.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-06T00:53:01.463 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser 2023-07-06T00:53:01.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-06T00:53:01.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert 2023-07-06T00:53:01.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-06T00:53:01.464 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp 2023-07-06T00:53:01.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-06T00:53:01.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt 2023-07-06T00:53:01.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-06T00:53:01.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input 2023-07-06T00:53:01.465 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport 2023-07-06T00:53:01.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-06T00:53:01.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-06T00:53:01.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-06T00:53:01.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-06T00:53:01.466 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-06T00:53:01.467 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-06T00:53:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-06T00:53:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-06T00:53:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-06T00:53:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-06T00:53:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-06T00:53:01.468 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-06T00:53:01.469 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-06T00:53:01.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu 2023-07-06T00:53:01.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd 2023-07-06T00:53:01.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-06T00:53:01.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds 2023-07-06T00:53:01.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-06T00:53:01.470 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-06T00:53:01.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-06T00:53:01.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-06T00:53:01.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger 2023-07-06T00:53:01.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-06T00:53:01.471 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-06T00:53:01.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-06T00:53:01.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-06T00:53:01.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-06T00:53:01.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-06T00:53:01.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-06T00:53:01.472 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-06T00:53:01.473 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-06T00:53:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-06T00:53:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-06T00:53:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-06T00:53:01.474 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-06T00:53:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-06T00:53:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-06T00:53:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-06T00:53:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-06T00:53:01.475 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-06T00:53:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-06T00:53:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-06T00:53:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-06T00:53:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-06T00:53:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data 2023-07-06T00:53:01.476 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion 2023-07-06T00:53:01.477 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-06T00:53:01.478 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mfd-core.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-06T00:53:01.479 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710 2023-07-06T00:53:01.480 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-06T00:53:01.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom 2023-07-06T00:53:01.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-06T00:53:01.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-06T00:53:01.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-06T00:53:01.481 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-06T00:53:01.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-06T00:53:01.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-06T00:53:01.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-06T00:53:01.482 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-06T00:53:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d 2023-07-06T00:53:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-06T00:53:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-06T00:53:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei 2023-07-06T00:53:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-06T00:53:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-06T00:53:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-06T00:53:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru 2023-07-06T00:53:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-06T00:53:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp 2023-07-06T00:53:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-06T00:53:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-06T00:53:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-06T00:53:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-06T00:53:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-06T00:53:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-06T00:53:01.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-06T00:53:01.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci 2023-07-06T00:53:01.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-06T00:53:01.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net 2023-07-06T00:53:01.487 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-06T00:53:01.488 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-06T00:53:01.489 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-06T00:53:01.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-06T00:53:01.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-06T00:53:01.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390 2023-07-06T00:53:01.490 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-06T00:53:01.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-06T00:53:01.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-06T00:53:01.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-06T00:53:01.491 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec 2023-07-06T00:53:01.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-06T00:53:01.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere 2023-07-06T00:53:01.492 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-06T00:53:01.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon 2023-07-06T00:53:01.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-06T00:53:01.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera 2023-07-06T00:53:01.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-06T00:53:01.493 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd 2023-07-06T00:53:01.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-06T00:53:01.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-06T00:53:01.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-06T00:53:01.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros 2023-07-06T00:53:01.494 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx 2023-07-06T00:53:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-06T00:53:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-06T00:53:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-06T00:53:01.495 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-06T00:53:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-06T00:53:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx 2023-07-06T00:53:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-06T00:53:01.496 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-06T00:53:01.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom 2023-07-06T00:53:01.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-06T00:53:01.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-06T00:53:01.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-06T00:53:01.497 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-06T00:53:01.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-06T00:53:01.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet 2023-07-06T00:53:01.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-06T00:53:01.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-06T00:53:01.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade 2023-07-06T00:53:01.498 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-06T00:53:01.499 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-06T00:53:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-06T00:53:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-06T00:53:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-06T00:53:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-06T00:53:01.500 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco 2023-07-06T00:53:01.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic 2023-07-06T00:53:01.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-06T00:53:01.501 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-06T00:53:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet 2023-07-06T00:53:01.503 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-06T00:53:01.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-06T00:53:01.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-06T00:53:01.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel 2023-07-06T00:53:01.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-06T00:53:01.504 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000 2023-07-06T00:53:01.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-06T00:53:01.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e 2023-07-06T00:53:01.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-06T00:53:01.505 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k 2023-07-06T00:53:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-06T00:53:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e 2023-07-06T00:53:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-06T00:53:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf 2023-07-06T00:53:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-06T00:53:01.506 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb 2023-07-06T00:53:01.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-06T00:53:01.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf 2023-07-06T00:53:01.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-06T00:53:01.507 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-06T00:53:01.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-06T00:53:01.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-06T00:53:01.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-06T00:53:01.508 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-06T00:53:01.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell 2023-07-06T00:53:01.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-06T00:53:01.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-06T00:53:01.509 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-06T00:53:01.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox 2023-07-06T00:53:01.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-06T00:53:01.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-06T00:53:01.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-06T00:53:01.510 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-06T00:53:01.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-06T00:53:01.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-06T00:53:01.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel 2023-07-06T00:53:01.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-06T00:53:01.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom 2023-07-06T00:53:01.511 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-06T00:53:01.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-06T00:53:01.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi 2023-07-06T00:53:01.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-06T00:53:01.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-06T00:53:01.512 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion 2023-07-06T00:53:01.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-06T00:53:01.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia 2023-07-06T00:53:01.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-06T00:53:01.513 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines 2023-07-06T00:53:01.514 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-06T00:53:01.514 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-06T00:53:01.514 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic 2023-07-06T00:53:01.514 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-06T00:53:01.514 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-06T00:53:01.514 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-06T00:53:01.515 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-06T00:53:01.516 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan 2023-07-06T00:53:01.517 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-06T00:53:01.517 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis 2023-07-06T00:53:01.517 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-06T00:53:01.517 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-06T00:53:01.517 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc 2023-07-06T00:53:01.518 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-06T00:53:01.518 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-06T00:53:01.518 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-06T00:53:01.518 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-06T00:53:01.519 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro 2023-07-06T00:53:01.519 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-06T00:53:01.519 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-06T00:53:01.519 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-06T00:53:01.519 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun 2023-07-06T00:53:01.519 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti 2023-07-06T00:53:01.520 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-06T00:53:01.521 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via 2023-07-06T00:53:01.521 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-06T00:53:01.521 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-06T00:53:01.521 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet 2023-07-06T00:53:01.521 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-06T00:53:01.522 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-06T00:53:01.522 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom 2023-07-06T00:53:01.522 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-06T00:53:01.523 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-06T00:53:01.523 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv 2023-07-06T00:53:01.523 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-06T00:53:01.523 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154 2023-07-06T00:53:01.523 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-06T00:53:01.524 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-06T00:53:01.524 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan 2023-07-06T00:53:01.524 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-06T00:53:01.524 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-06T00:53:01.525 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-06T00:53:01.525 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio 2023-07-06T00:53:01.525 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-06T00:53:01.525 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-06T00:53:01.526 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-06T00:53:01.526 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-06T00:53:01.526 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/net_failover.ko 2023-07-06T00:53:01.526 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-06T00:53:01.526 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-06T00:53:01.526 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-06T00:53:01.527 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-06T00:53:01.528 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-06T00:53:01.528 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-06T00:53:01.528 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-06T00:53:01.528 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-06T00:53:01.528 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/dp83640.ko 2023-07-06T00:53:01.529 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-06T00:53:01.529 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-06T00:53:01.529 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-06T00:53:01.529 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-06T00:53:01.529 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-06T00:53:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-06T00:53:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-06T00:53:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-06T00:53:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-06T00:53:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-06T00:53:01.530 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-06T00:53:01.531 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-06T00:53:01.532 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-06T00:53:01.532 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-06T00:53:01.532 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-06T00:53:01.533 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-06T00:53:01.533 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip 2023-07-06T00:53:01.533 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slhc.ko 2023-07-06T00:53:01.533 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-06T00:53:01.534 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-06T00:53:01.534 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-06T00:53:01.534 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team 2023-07-06T00:53:01.534 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-06T00:53:01.535 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-06T00:53:01.535 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-06T00:53:01.535 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-06T00:53:01.536 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-06T00:53:01.536 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-06T00:53:01.536 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tun.ko 2023-07-06T00:53:01.536 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-06T00:53:01.537 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/virtio_net.ko 2023-07-06T00:53:01.537 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3 2023-07-06T00:53:01.537 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-06T00:53:01.538 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan 2023-07-06T00:53:01.538 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-06T00:53:01.538 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback 2023-07-06T00:53:01.538 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-06T00:53:01.539 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netfront.ko 2023-07-06T00:53:01.539 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb 2023-07-06T00:53:01.539 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-06T00:53:01.540 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme 2023-07-06T00:53:01.540 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host 2023-07-06T00:53:01.540 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-06T00:53:01.540 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-06T00:53:01.541 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport 2023-07-06T00:53:01.541 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-06T00:53:01.541 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-06T00:53:01.541 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-06T00:53:01.542 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-06T00:53:01.542 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci 2023-07-06T00:53:01.542 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug 2023-07-06T00:53:01.542 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-06T00:53:01.543 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie 2023-07-06T00:53:01.543 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-06T00:53:01.543 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-06T00:53:01.544 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia 2023-07-06T00:53:01.544 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-06T00:53:01.544 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-06T00:53:01.544 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-06T00:53:01.544 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-06T00:53:01.545 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-06T00:53:01.546 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-06T00:53:01.546 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-06T00:53:01.546 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-06T00:53:01.546 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-06T00:53:01.547 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-06T00:53:01.547 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-06T00:53:01.547 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-06T00:53:01.548 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-06T00:53:01.548 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-06T00:53:01.548 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel 2023-07-06T00:53:01.548 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-06T00:53:01.549 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-06T00:53:01.549 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-06T00:53:01.549 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-06T00:53:01.549 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-06T00:53:01.550 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-06T00:53:01.550 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-06T00:53:01.550 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-06T00:53:01.550 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-06T00:53:01.551 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-06T00:53:01.551 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-06T00:53:01.551 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-06T00:53:01.551 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap 2023-07-06T00:53:01.552 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-06T00:53:01.552 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-06T00:53:01.552 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps 2023-07-06T00:53:01.553 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients 2023-07-06T00:53:01.553 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-06T00:53:01.553 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-06T00:53:01.553 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-06T00:53:01.554 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-06T00:53:01.554 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp 2023-07-06T00:53:01.554 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-06T00:53:01.554 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-06T00:53:01.555 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc 2023-07-06T00:53:01.555 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-06T00:53:01.555 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-06T00:53:01.555 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-06T00:53:01.556 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-06T00:53:01.556 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-06T00:53:01.556 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-06T00:53:01.557 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-06T00:53:01.557 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-06T00:53:01.557 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-06T00:53:01.557 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-06T00:53:01.558 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-06T00:53:01.558 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-06T00:53:01.558 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-06T00:53:01.558 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-06T00:53:01.559 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-06T00:53:01.559 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-06T00:53:01.559 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-06T00:53:01.559 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-06T00:53:01.559 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-06T00:53:01.560 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-06T00:53:01.560 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-06T00:53:01.560 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-06T00:53:01.560 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-06T00:53:01.561 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-06T00:53:01.561 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-06T00:53:01.561 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-06T00:53:01.561 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-06T00:53:01.562 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-06T00:53:01.562 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-06T00:53:01.562 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-06T00:53:01.562 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-06T00:53:01.563 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-06T00:53:01.563 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi 2023-07-06T00:53:01.563 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-06T00:53:01.563 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-06T00:53:01.564 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-06T00:53:01.564 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-06T00:53:01.564 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-06T00:53:01.564 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid 2023-07-06T00:53:01.565 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-06T00:53:01.565 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-06T00:53:01.565 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx 2023-07-06T00:53:01.566 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-06T00:53:01.566 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-06T00:53:01.566 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-06T00:53:01.566 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr 2023-07-06T00:53:01.567 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-06T00:53:01.567 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-06T00:53:01.567 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi 2023-07-06T00:53:01.567 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-06T00:53:01.568 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa 2023-07-06T00:53:01.568 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-06T00:53:01.568 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc 2023-07-06T00:53:01.568 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-06T00:53:01.569 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i 2023-07-06T00:53:01.569 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-06T00:53:01.569 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-06T00:53:01.570 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor 2023-07-06T00:53:01.570 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-06T00:53:01.570 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi 2023-07-06T00:53:01.570 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-06T00:53:01.571 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-06T00:53:01.571 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-06T00:53:01.571 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-06T00:53:01.571 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-06T00:53:01.572 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-06T00:53:01.572 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler 2023-07-06T00:53:01.572 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-06T00:53:01.573 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-06T00:53:01.573 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-06T00:53:01.573 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-06T00:53:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-06T00:53:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r 2023-07-06T00:53:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-06T00:53:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-06T00:53:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe 2023-07-06T00:53:01.574 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-06T00:53:01.575 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-06T00:53:01.575 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic 2023-07-06T00:53:01.575 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-06T00:53:01.575 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-06T00:53:01.576 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-06T00:53:01.576 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-06T00:53:01.576 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-06T00:53:01.576 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-06T00:53:01.576 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-06T00:53:01.577 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci 2023-07-06T00:53:01.577 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-06T00:53:01.577 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-06T00:53:01.577 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-06T00:53:01.577 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc 2023-07-06T00:53:01.578 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-06T00:53:01.578 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-06T00:53:01.578 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-06T00:53:01.578 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas 2023-07-06T00:53:01.579 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-06T00:53:01.579 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc 2023-07-06T00:53:01.579 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-06T00:53:01.580 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid 2023-07-06T00:53:01.580 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-06T00:53:01.580 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-06T00:53:01.580 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-06T00:53:01.581 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-06T00:53:01.581 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas 2023-07-06T00:53:01.581 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-06T00:53:01.581 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas 2023-07-06T00:53:01.582 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-06T00:53:01.582 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-06T00:53:01.582 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001 2023-07-06T00:53:01.583 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-06T00:53:01.583 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-06T00:53:01.583 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-06T00:53:01.584 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx 2023-07-06T00:53:01.584 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-06T00:53:01.584 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-06T00:53:01.584 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx 2023-07-06T00:53:01.585 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-06T00:53:01.585 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-06T00:53:01.585 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-06T00:53:01.586 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-06T00:53:01.586 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-06T00:53:01.586 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-06T00:53:01.586 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-06T00:53:01.587 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-06T00:53:01.587 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-06T00:53:01.587 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-06T00:53:01.587 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-06T00:53:01.587 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2 2023-07-06T00:53:01.588 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-06T00:53:01.588 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-06T00:53:01.588 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-06T00:53:01.589 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-06T00:53:01.589 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb 2023-07-06T00:53:01.589 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-06T00:53:01.590 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target 2023-07-06T00:53:01.590 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi 2023-07-06T00:53:01.590 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-06T00:53:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback 2023-07-06T00:53:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-06T00:53:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-06T00:53:01.591 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-06T00:53:01.592 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-06T00:53:01.592 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-06T00:53:01.592 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-06T00:53:01.593 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc 2023-07-06T00:53:01.593 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-06T00:53:01.593 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal 2023-07-06T00:53:01.593 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel 2023-07-06T00:53:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal 2023-07-06T00:53:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-06T00:53:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-06T00:53:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-06T00:53:01.594 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-06T00:53:01.595 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-06T00:53:01.595 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-06T00:53:01.595 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-06T00:53:01.596 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-06T00:53:01.596 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-06T00:53:01.596 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-06T00:53:01.597 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-06T00:53:01.597 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-06T00:53:01.597 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-06T00:53:01.597 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-06T00:53:01.598 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-06T00:53:01.598 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty 2023-07-06T00:53:01.598 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless 2023-07-06T00:53:01.599 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-06T00:53:01.599 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-06T00:53:01.599 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-06T00:53:01.599 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-06T00:53:01.600 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial 2023-07-06T00:53:01.600 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250 2023-07-06T00:53:01.600 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-06T00:53:01.601 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-06T00:53:01.601 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm 2023-07-06T00:53:01.601 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-06T00:53:01.601 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-06T00:53:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs 2023-07-06T00:53:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core 2023-07-06T00:53:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-06T00:53:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host 2023-07-06T00:53:01.602 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-06T00:53:01.603 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb 2023-07-06T00:53:01.604 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class 2023-07-06T00:53:01.604 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-06T00:53:01.604 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-06T00:53:01.604 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-06T00:53:01.604 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc 2023-07-06T00:53:01.605 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-06T00:53:01.606 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-06T00:53:01.607 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-06T00:53:01.608 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-06T00:53:01.609 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-06T00:53:01.610 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-06T00:53:01.611 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-06T00:53:01.612 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-06T00:53:01.613 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-06T00:53:01.614 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-06T00:53:01.615 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-06T00:53:01.616 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci 2023-07-06T00:53:01.617 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-06T00:53:01.618 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio.ko 2023-07-06T00:53:01.619 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_balloon.ko 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_mmio.ko 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci.ko 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/virtio/virtio_ring.ko 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1 2023-07-06T00:53:01.620 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-06T00:53:01.621 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-06T00:53:01.622 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-06T00:53:01.623 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog 2023-07-06T00:53:01.623 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-06T00:53:01.623 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-06T00:53:01.623 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-06T00:53:01.623 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-06T00:53:01.623 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-06T00:53:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-06T00:53:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-06T00:53:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-06T00:53:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-06T00:53:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-06T00:53:01.624 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-06T00:53:01.625 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-06T00:53:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-06T00:53:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-06T00:53:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-06T00:53:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-06T00:53:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-06T00:53:01.626 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-06T00:53:01.627 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-06T00:53:01.627 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen 2023-07-06T00:53:01.627 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-06T00:53:01.627 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-06T00:53:01.628 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-06T00:53:01.628 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-06T00:53:01.628 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback 2023-07-06T00:53:01.628 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-06T00:53:01.629 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-06T00:53:01.629 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs 2023-07-06T00:53:01.629 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-06T00:53:01.630 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs 2023-07-06T00:53:01.630 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p 2023-07-06T00:53:01.630 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-06T00:53:01.630 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs 2023-07-06T00:53:01.631 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-06T00:53:01.631 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs 2023-07-06T00:53:01.631 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-06T00:53:01.631 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-06T00:53:01.632 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs 2023-07-06T00:53:01.632 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-06T00:53:01.632 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles 2023-07-06T00:53:01.633 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-06T00:53:01.633 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph 2023-07-06T00:53:01.633 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-06T00:53:01.633 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda 2023-07-06T00:53:01.634 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-06T00:53:01.634 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs 2023-07-06T00:53:01.634 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-06T00:53:01.634 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm 2023-07-06T00:53:01.635 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-06T00:53:01.635 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs 2023-07-06T00:53:01.635 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-06T00:53:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs 2023-07-06T00:53:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-06T00:53:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat 2023-07-06T00:53:01.636 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/fat.ko 2023-07-06T00:53:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-06T00:53:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/vfat.ko 2023-07-06T00:53:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache 2023-07-06T00:53:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-06T00:53:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse 2023-07-06T00:53:01.637 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-06T00:53:01.638 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/fuse.ko 2023-07-06T00:53:01.638 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2 2023-07-06T00:53:01.638 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-06T00:53:01.638 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs 2023-07-06T00:53:01.639 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-06T00:53:01.639 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus 2023-07-06T00:53:01.639 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-06T00:53:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs 2023-07-06T00:53:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-06T00:53:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs 2023-07-06T00:53:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-06T00:53:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd 2023-07-06T00:53:01.640 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout 2023-07-06T00:53:01.641 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-06T00:53:01.642 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2 2023-07-06T00:53:01.643 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-06T00:53:01.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls 2023-07-06T00:53:01.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-06T00:53:01.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-06T00:53:01.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-06T00:53:01.644 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-06T00:53:01.645 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-06T00:53:01.646 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-06T00:53:01.647 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-06T00:53:01.648 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-06T00:53:01.649 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-06T00:53:01.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-06T00:53:01.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-06T00:53:01.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-06T00:53:01.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-06T00:53:01.650 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-06T00:53:01.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-06T00:53:01.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-06T00:53:01.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2 2023-07-06T00:53:01.651 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster 2023-07-06T00:53:01.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-06T00:53:01.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm 2023-07-06T00:53:01.652 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-06T00:53:01.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs 2023-07-06T00:53:01.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-06T00:53:01.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-06T00:53:01.653 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-06T00:53:01.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-06T00:53:01.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-06T00:53:01.654 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs 2023-07-06T00:53:01.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-06T00:53:01.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore 2023-07-06T00:53:01.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-06T00:53:01.655 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs 2023-07-06T00:53:01.656 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-06T00:53:01.656 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs 2023-07-06T00:53:01.656 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-06T00:53:01.657 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb 2023-07-06T00:53:01.657 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client 2023-07-06T00:53:01.657 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-06T00:53:01.657 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common 2023-07-06T00:53:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-06T00:53:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-06T00:53:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs 2023-07-06T00:53:01.658 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-06T00:53:01.659 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv 2023-07-06T00:53:01.659 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-06T00:53:01.659 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf 2023-07-06T00:53:01.659 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-06T00:53:01.660 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs 2023-07-06T00:53:01.660 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-06T00:53:01.660 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs 2023-07-06T00:53:01.660 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-06T00:53:01.661 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel 2023-07-06T00:53:01.661 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu 2023-07-06T00:53:01.661 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/rcu/rcutorture.ko 2023-07-06T00:53:01.662 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-06T00:53:01.662 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace 2023-07-06T00:53:01.662 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-06T00:53:01.662 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib 2023-07-06T00:53:01.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/asn1_encoder.ko 2023-07-06T00:53:01.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-06T00:53:01.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-06T00:53:01.663 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto 2023-07-06T00:53:01.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-06T00:53:01.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-06T00:53:01.664 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-06T00:53:01.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-06T00:53:01.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4 2023-07-06T00:53:01.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-06T00:53:01.665 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-06T00:53:01.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math 2023-07-06T00:53:01.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-06T00:53:01.666 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6 2023-07-06T00:53:01.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-06T00:53:01.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon 2023-07-06T00:53:01.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-06T00:53:01.667 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-06T00:53:01.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-06T00:53:01.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-06T00:53:01.668 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd 2023-07-06T00:53:01.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/lib/zstd/zstd_compress.ko 2023-07-06T00:53:01.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm 2023-07-06T00:53:01.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-06T00:53:01.669 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net 2023-07-06T00:53:01.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan 2023-07-06T00:53:01.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-06T00:53:01.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-06T00:53:01.670 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-06T00:53:01.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-06T00:53:01.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-06T00:53:01.671 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-06T00:53:01.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-06T00:53:01.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-06T00:53:01.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802 2023-07-06T00:53:01.672 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-06T00:53:01.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-06T00:53:01.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-06T00:53:01.673 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-06T00:53:01.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-06T00:53:01.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q 2023-07-06T00:53:01.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-06T00:53:01.674 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p 2023-07-06T00:53:01.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-06T00:53:01.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-06T00:53:01.675 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-06T00:53:01.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-06T00:53:01.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv 2023-07-06T00:53:01.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-06T00:53:01.676 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge 2023-07-06T00:53:01.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-06T00:53:01.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-06T00:53:01.677 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter 2023-07-06T00:53:01.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-06T00:53:01.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-06T00:53:01.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-06T00:53:01.678 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-06T00:53:01.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-06T00:53:01.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-06T00:53:01.679 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-06T00:53:01.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-06T00:53:01.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-06T00:53:01.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-06T00:53:01.680 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-06T00:53:01.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-06T00:53:01.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-06T00:53:01.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-06T00:53:01.681 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-06T00:53:01.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-06T00:53:01.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-06T00:53:01.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-06T00:53:01.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-06T00:53:01.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-06T00:53:01.682 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-06T00:53:01.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-06T00:53:01.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-06T00:53:01.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-06T00:53:01.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph 2023-07-06T00:53:01.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-06T00:53:01.683 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core 2023-07-06T00:53:01.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/failover.ko 2023-07-06T00:53:01.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-06T00:53:01.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp 2023-07-06T00:53:01.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-06T00:53:01.684 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-06T00:53:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-06T00:53:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-06T00:53:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver 2023-07-06T00:53:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dns_resolver/dns_resolver.ko 2023-07-06T00:53:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa 2023-07-06T00:53:01.685 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-06T00:53:01.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-06T00:53:01.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-06T00:53:01.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-06T00:53:01.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-06T00:53:01.686 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154 2023-07-06T00:53:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan 2023-07-06T00:53:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-06T00:53:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-06T00:53:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-06T00:53:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4 2023-07-06T00:53:01.687 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-06T00:53:01.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-06T00:53:01.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-06T00:53:01.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-06T00:53:01.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-06T00:53:01.688 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-06T00:53:01.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-06T00:53:01.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-06T00:53:01.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-06T00:53:01.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-06T00:53:01.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter 2023-07-06T00:53:01.689 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-06T00:53:01.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-06T00:53:01.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-06T00:53:01.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-06T00:53:01.690 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-06T00:53:01.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-06T00:53:01.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-06T00:53:01.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-06T00:53:01.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-06T00:53:01.691 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-06T00:53:01.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-06T00:53:01.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-06T00:53:01.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-06T00:53:01.692 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-06T00:53:01.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-06T00:53:01.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-06T00:53:01.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-06T00:53:01.693 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-06T00:53:01.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-06T00:53:01.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-06T00:53:01.694 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-06T00:53:01.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-06T00:53:01.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-06T00:53:01.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-06T00:53:01.695 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-06T00:53:01.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-06T00:53:01.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-06T00:53:01.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-06T00:53:01.696 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-06T00:53:01.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-06T00:53:01.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-06T00:53:01.697 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-06T00:53:01.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-06T00:53:01.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-06T00:53:01.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-06T00:53:01.698 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-06T00:53:01.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-06T00:53:01.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-06T00:53:01.699 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6 2023-07-06T00:53:01.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-06T00:53:01.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-06T00:53:01.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-06T00:53:01.700 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-06T00:53:01.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-06T00:53:01.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-06T00:53:01.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-06T00:53:01.701 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter 2023-07-06T00:53:01.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-06T00:53:01.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-06T00:53:01.702 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-06T00:53:01.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-06T00:53:01.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-06T00:53:01.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-06T00:53:01.703 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-06T00:53:01.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-06T00:53:01.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-06T00:53:01.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-06T00:53:01.704 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-06T00:53:01.705 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-06T00:53:01.706 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-06T00:53:01.707 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154 2023-07-06T00:53:01.708 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-06T00:53:01.709 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-06T00:53:01.710 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-06T00:53:01.711 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-06T00:53:01.712 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-06T00:53:01.713 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-06T00:53:01.714 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-06T00:53:01.715 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-06T00:53:01.716 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-06T00:53:01.717 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-06T00:53:01.718 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_quota.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-06T00:53:01.719 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tunnel.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-06T00:53:01.720 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-06T00:53:01.721 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-06T00:53:01.722 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-06T00:53:01.723 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-06T00:53:01.724 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-06T00:53:01.725 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-06T00:53:01.726 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-06T00:53:01.727 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-06T00:53:01.728 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-06T00:53:01.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-06T00:53:01.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-06T00:53:01.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-06T00:53:01.729 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-06T00:53:01.730 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-06T00:53:01.731 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-06T00:53:01.732 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-06T00:53:01.733 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-06T00:53:01.734 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-06T00:53:01.735 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-06T00:53:01.736 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp 2023-07-06T00:53:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma 2023-07-06T00:53:01.738 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-06T00:53:01.739 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security 2023-07-06T00:53:01.740 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/security/keys/trusted-keys/trusted.ko 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib 2023-07-06T00:53:01.741 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-06T00:53:01.742 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-06T00:53:01.743 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-06T00:53:01.743 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-06T00:53:01.743 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-06T00:53:01.743 INFO:teuthology.orchestra.run.smithi071.stdout:/lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-06T00:53:01.744 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-06T00:53:01.744 DEBUG:teuthology.orchestra.run.smithi071:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-06T00:53:01.771 INFO:teuthology.orchestra.run.smithi071.stdout:postinstall scriptlet (using /bin/sh): 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-g84139c18d56f -a -r /boot/System.map-6.4.0-g84139c18d56f ]; then 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:cp /boot/vmlinuz-6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:cp /boot/System.map-6.4.0-g84139c18d56f /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:rm -f /boot/vmlinuz-6.4.0-g84139c18d56f /boot/System.map-6.4.0-g84139c18d56f 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/installkernel 6.4.0-g84139c18d56f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:rm -f /boot/.vmlinuz-6.4.0-g84139c18d56f-rpm /boot/.System.map-6.4.0-g84139c18d56f-rpm 2023-07-06T00:53:01.772 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2023-07-06T00:53:01.773 INFO:teuthology.orchestra.run.smithi071.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-06T00:53:01.773 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-06T00:53:01.773 INFO:teuthology.orchestra.run.smithi071.stdout:new-kernel-pkg --remove 6.4.0-g84139c18d56f --rminitrd --initrdfile=/boot/initramfs-6.4.0-g84139c18d56f.img 2023-07-06T00:53:01.773 INFO:teuthology.orchestra.run.smithi071.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-06T00:53:01.773 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-install remove 6.4.0-g84139c18d56f 2023-07-06T00:53:01.773 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2023-07-06T00:53:01.774 INFO:teuthology.orchestra.run.smithi071.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-06T00:53:01.774 INFO:teuthology.orchestra.run.smithi071.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-06T00:53:01.774 INFO:teuthology.orchestra.run.smithi071.stdout:/sbin/update-bootloader --remove 6.4.0-g84139c18d56f 2023-07-06T00:53:01.774 INFO:teuthology.orchestra.run.smithi071.stdout:fi 2023-07-06T00:53:01.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2023-07-06T00:53:01.847 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2023-07-06T00:53:01.847 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2023-07-06T00:53:01.847 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.02 2023-07-06T00:53:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 129.el8 2023-07-06T00:53:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2023-07-06T00:53:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-07-06T00:53:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:Group : System Environment/Base 2023-07-06T00:53:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 9265586 2023-07-06T00:53:01.848 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : kbuilder.bsys.centos.org 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Relocations : (not relocatable) 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : CentOS BuildSystem 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2023-07-06T00:53:01.849 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2023-07-06T00:53:01.850 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T00:53:01.851 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2023-07-06T00:53:01.852 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-06T00:53:01.852 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 6.4.0-g84139c18d56f 2023-07-06T00:53:01.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-06T00:53:07.154 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2023-07-06T00:53:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:done 2023-07-06T00:53:09.323 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-07-06T00:53:09.356 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.RdJgfsxXsF 2023-07-06T00:53:09.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RdJgfsxXsF 2023-07-06T00:53:09.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.RdJgfsxXsF 2023-07-06T00:53:09.578 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.RdJgfsxXsF is 6KB 2023-07-06T00:53:09.627 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.RdJgfsxXsF 2023-07-06T00:53:09.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2023-07-06T00:53:09.721 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-07-06T00:53:09.722 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-07-06T00:53:09.722 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-07-06T00:53:09.722 INFO:teuthology.orchestra.run.smithi071.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f.conf 2023-07-06T00:53:09.723 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-g84139c18d56f 2023-07-06T00:53:09.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2023-07-06T00:53:29.696 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-06T00:53:29.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-06T00:53:29.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:53:39.896 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-06T00:53:39.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-06T00:53:39.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:54:29.748 DEBUG:teuthology.orchestra.remote:timed out 2023-07-06T00:54:38.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-06T00:54:38.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:54:39.900 DEBUG:teuthology.orchestra.remote:timed out 2023-07-06T00:54:46.232 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-07-06T00:54:46.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-06T00:54:46.638 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-g84139c18d56f"... 2023-07-06T00:54:46.638 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2023-07-06T00:54:46.683 INFO:teuthology.orchestra.run.smithi194.stdout:6.4.0-g84139c18d56f 2023-07-06T00:54:46.684 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-06T00:54:46.684 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-06T00:54:46.684 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-06T00:54:47.686 DEBUG:teuthology.parallel:result is None 2023-07-06T00:54:48.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-06T00:54:48.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:54:50.335 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-07-06T00:54:50.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-06T00:54:50.741 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-g84139c18d56f"... 2023-07-06T00:54:50.741 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-07-06T00:54:50.785 INFO:teuthology.orchestra.run.smithi071.stdout:6.4.0-g84139c18d56f 2023-07-06T00:54:50.785 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-06T00:54:50.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-06T00:54:50.786 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-07-06T00:54:51.787 DEBUG:teuthology.parallel:result is None 2023-07-06T00:54:51.787 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-06T00:54:51.800 INFO:teuthology.task.internal:Creating test directory... 2023-07-06T00:54:51.801 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-06T00:54:51.806 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-06T00:54:51.855 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-06T00:54:51.870 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-06T00:54:51.885 INFO:teuthology.task.internal:Creating archive directory... 2023-07-06T00:54:51.885 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-06T00:54:51.890 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-06T00:54:51.988 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-06T00:54:51.999 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-06T00:54:52.000 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-06T00:54:52.004 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-06T00:54:52.093 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T00:54:52.124 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T00:54:52.125 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T00:54:52.170 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T00:54:52.173 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-06T00:54:52.183 INFO:teuthology.task.internal:Configuring sudo... 2023-07-06T00:54:52.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-06T00:54:52.188 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-06T00:54:52.257 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-06T00:54:52.267 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-06T00:54:52.267 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-06T00:54:52.272 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-06T00:54:52.317 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T00:54:52.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T00:54:52.498 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T00:54:52.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T00:54:52.642 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T00:54:52.643 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-06T00:54:52.711 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T00:54:52.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T00:54:52.874 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T00:54:52.951 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T00:54:53.035 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T00:54:53.035 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-06T00:54:53.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2023-07-06T00:54:53.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2023-07-06T00:54:53.227 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T00:54:53.265 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T00:54:53.756 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-06T00:54:53.771 INFO:teuthology.task.internal:Starting timer... 2023-07-06T00:54:53.771 INFO:teuthology.run_tasks:Running task pcp... 2023-07-06T00:54:53.784 INFO:teuthology.run_tasks:Running task selinux... 2023-07-06T00:54:53.796 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-06T00:54:53.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2023-07-06T00:54:53.947 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2023-07-06T00:54:53.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2023-07-06T00:54:54.094 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2023-07-06T00:54:54.097 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-06T00:54:54.097 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2023-07-06T00:54:54.148 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2023-07-06T00:54:54.149 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2023-07-06T00:54:54.200 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2023-07-06T00:54:54.200 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2023-07-06T00:54:54.201 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T00:54:54.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T00:54:54.271 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T00:54:54.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T00:54:54.340 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-06T00:54:54.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2023-07-06T00:54:54.408 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2023-07-06T00:54:54.503 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-06T00:54:54.518 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-06T00:54:54.525 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-06T00:54:54.706 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-06T00:54:54.727 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-06T00:54:54.729 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-06T01:04:55.195 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2023-07-06T01:04:55.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-06T01:04:55.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T01:04:55.284 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-07-06T01:04:55.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-06T01:04:55.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-06T01:04:55.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T01:04:55.483 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-07-06T01:04:55.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-06T01:04:55.606 INFO:teuthology.run_tasks:Running task clock... 2023-07-06T01:04:55.618 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-06T01:04:55.619 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-06T01:04:55.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T01:04:55.624 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-06T01:04:55.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T01:04:55.693 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-06T01:04:55.720 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-06T01:04:55.726 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-06T01:04:55.753 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-06T01:04:55.815 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2023-07-06T01:04:55.842 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2023-07-06T01:04:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2023-07-06T01:04:55.872 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2023-07-06T01:04:55.875 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-06T01:04:55.904 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-06T01:04:55.907 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-06T01:04:55.936 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-06T01:04:55.993 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2023-07-06T01:04:55.999 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T01:04:56.000 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-07-06T01:04:56.000 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.000 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.000 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.000 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.022 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2023-07-06T01:04:56.030 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T01:04:56.030 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-07-06T01:04:56.030 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.030 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.030 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.030 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:04:56.031 INFO:teuthology.run_tasks:Running task install... 2023-07-06T01:04:56.039 DEBUG:teuthology.task.install:project ceph 2023-07-06T01:04:56.040 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}} 2023-07-06T01:04:56.040 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'} 2023-07-06T01:04:56.040 INFO:teuthology.task.install:Using flavor: default 2023-07-06T01:04:56.046 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-06T01:04:56.046 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-06T01:04:56.047 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'tag': None, 'wait_for_package': False} 2023-07-06T01:04:56.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T01:04:56.050 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'tag': None, 'wait_for_package': False} 2023-07-06T01:04:56.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T01:04:56.193 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/ 2023-07-06T01:04:56.194 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4742.g79365bb3 2023-07-06T01:04:56.284 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/ 2023-07-06T01:04:56.284 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4742.g79365bb3 2023-07-06T01:04:56.588 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-06T01:04:56.589 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:04:56.589 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-06T01:04:56.658 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-06T01:04:56.659 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/79365bb3b803780276d69efb2cc4afe5b160de9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-06T01:04:56.674 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-06T01:04:56.674 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:04:56.674 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-06T01:04:56.745 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-06T01:04:56.745 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/79365bb3b803780276d69efb2cc4afe5b160de9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-06T01:04:56.768 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-06T01:04:56.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-06T01:04:56.862 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-06T01:04:56.932 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2023-07-06T01:04:56.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2023-07-06T01:04:56.950 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-06T01:04:57.017 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2023-07-06T01:04:57.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2023-07-06T01:04:57.272 INFO:teuthology.orchestra.run.smithi194.stdout:73 files removed 2023-07-06T01:04:57.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-06T01:04:57.363 INFO:teuthology.orchestra.run.smithi071.stdout:73 files removed 2023-07-06T01:04:57.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-06T01:04:58.643 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 101 kB/s | 81 kB 00:00 2023-07-06T01:04:58.839 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 89 kB/s | 81 kB 00:00 2023-07-06T01:04:59.178 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-07-06T01:04:59.473 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-07-06T01:04:59.811 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-07-06T01:05:00.149 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-07-06T01:05:01.161 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - AppStream 23 MB/s | 31 MB 00:01 2023-07-06T01:05:02.407 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - AppStream 14 MB/s | 31 MB 00:02 2023-07-06T01:05:17.581 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - BaseOS 4.4 MB/s | 41 MB 00:09 2023-07-06T01:05:20.719 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - BaseOS 3.0 MB/s | 41 MB 00:13 2023-07-06T01:05:24.180 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2023-07-06T01:05:24.922 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - Extras common packages 12 kB/s | 6.6 kB 00:00 2023-07-06T01:05:27.148 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 8 - PowerTools 3.0 MB/s | 6.3 MB 00:02 2023-07-06T01:05:27.661 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-07-06T01:05:28.069 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 6.6 kB 00:00 2023-07-06T01:05:28.871 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 8 - PowerTools 9.7 MB/s | 6.3 MB 00:00 2023-07-06T01:05:31.150 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-06T01:05:32.231 INFO:teuthology.orchestra.run.smithi194.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:02 2023-07-06T01:05:32.999 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2023-07-06T01:05:37.325 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 308 kB/s | 24 kB 00:00 2023-07-06T01:05:38.392 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 16 MB 00:05 2023-07-06T01:05:41.291 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T01:05:41.292 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T01:05:41.305 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-06T01:05:41.313 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-06T01:05:41.313 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-06T01:05:41.313 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-06T01:05:41.313 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-06T01:05:41.314 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-06T01:05:41.314 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-06T01:05:41.314 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T01:05:41.502 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-07-06T01:05:41.516 INFO:teuthology.orchestra.run.smithi071.stdout:==================================================================================================== 2023-07-06T01:05:41.517 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-07-06T01:05:41.517 INFO:teuthology.orchestra.run.smithi071.stdout:==================================================================================================== 2023-07-06T01:05:41.517 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-07-06T01:05:41.517 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-06T01:05:41.517 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.4 k 2023-07-06T01:05:41.517 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 5.4 M 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 847 k 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 165 k 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 1.5 M 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 129 k 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 1.7 M 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 7.4 M 2023-07-06T01:05:41.518 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 47 k 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 13 M 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 48 M 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 258 k 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 166 k 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 258 k 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 18 k 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-06T01:05:41.519 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-06T01:05:41.520 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-06T01:05:41.520 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 31 k 2023-07-06T01:05:41.520 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 770 k 2023-07-06T01:05:41.520 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 139 k 2023-07-06T01:05:41.520 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-06T01:05:41.520 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-06T01:05:41.521 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-06T01:05:41.521 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-06T01:05:41.521 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-06T01:05:41.521 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-06T01:05:41.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 197 k 2023-07-06T01:05:41.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 370 k 2023-07-06T01:05:41.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 364 k 2023-07-06T01:05:41.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 107 k 2023-07-06T01:05:41.522 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 94 k 2023-07-06T01:05:41.523 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.5 M 2023-07-06T01:05:41.523 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 179 k 2023-07-06T01:05:41.523 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-06T01:05:41.523 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2023-07-06T01:05:41.523 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-06T01:05:41.524 INFO:teuthology.orchestra.run.smithi071.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-06T01:05:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.7 M 2023-07-06T01:05:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.6 M 2023-07-06T01:05:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-06T01:05:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-06T01:05:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-06T01:05:41.525 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 22 M 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 23 k 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 2.3 M 2023-07-06T01:05:41.526 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 240 k 2023-07-06T01:05:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 4.6 M 2023-07-06T01:05:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 18 M 2023-07-06T01:05:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 15 k 2023-07-06T01:05:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 24 k 2023-07-06T01:05:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-06T01:05:41.527 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-06T01:05:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-06T01:05:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-06T01:05:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-06T01:05:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 137 k 2023-07-06T01:05:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-06T01:05:41.528 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 475 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.7 M 2023-07-06T01:05:41.529 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-06T01:05:41.530 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-06T01:05:41.531 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-06T01:05:41.531 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-06T01:05:41.531 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-06T01:05:41.531 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-06T01:05:41.531 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-06T01:05:41.531 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-06T01:05:41.532 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-06T01:05:41.532 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-06T01:05:41.532 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-06T01:05:41.532 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 45 k 2023-07-06T01:05:41.532 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 119 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-06T01:05:41.533 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-06T01:05:41.534 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-06T01:05:41.534 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-06T01:05:41.534 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-06T01:05:41.534 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-06T01:05:41.534 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-06T01:05:41.535 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-06T01:05:41.536 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-06T01:05:41.537 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-06T01:05:41.538 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-06T01:05:41.539 INFO:teuthology.orchestra.run.smithi071.stdout:Enabling module streams: 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql 10 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout:==================================================================================================== 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout:Install 128 Packages 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 16 Packages 2023-07-06T01:05:41.540 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:05:41.541 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 212 M 2023-07-06T01:05:41.541 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-07-06T01:05:41.884 INFO:teuthology.orchestra.run.smithi071.stdout:(1/144): ceph-18.0.0-4742.g79365bb3.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-07-06T01:05:42.242 INFO:teuthology.orchestra.run.smithi071.stdout:(2/144): ceph-fuse-18.0.0-4742.g79365bb3.el8.x8 2.3 MB/s | 847 kB 00:00 2023-07-06T01:05:42.351 INFO:teuthology.orchestra.run.smithi071.stdout:(3/144): ceph-immutable-object-cache-18.0.0-474 1.5 MB/s | 165 kB 00:00 2023-07-06T01:05:42.830 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 229 kB/s | 24 kB 00:00 2023-07-06T01:05:42.918 INFO:teuthology.orchestra.run.smithi071.stdout:(4/144): ceph-mds-18.0.0-4742.g79365bb3.el8.x86 4.0 MB/s | 2.3 MB 00:00 2023-07-06T01:05:43.077 INFO:teuthology.orchestra.run.smithi071.stdout:(5/144): ceph-base-18.0.0-4742.g79365bb3.el8.x8 3.9 MB/s | 5.4 MB 00:01 2023-07-06T01:05:43.460 INFO:teuthology.orchestra.run.smithi071.stdout:(6/144): ceph-common-18.0.0-4742.g79365bb3.el8. 12 MB/s | 22 MB 00:01 2023-07-06T01:05:43.502 INFO:teuthology.orchestra.run.smithi071.stdout:(7/144): ceph-mgr-18.0.0-4742.g79365bb3.el8.x86 2.7 MB/s | 1.5 MB 00:00 2023-07-06T01:05:43.803 INFO:teuthology.orchestra.run.smithi071.stdout:(8/144): ceph-mon-18.0.0-4742.g79365bb3.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-07-06T01:05:43.902 INFO:teuthology.orchestra.run.smithi071.stdout:(9/144): ceph-selinux-18.0.0-4742.g79365bb3.el8 244 kB/s | 24 kB 00:00 2023-07-06T01:05:44.586 INFO:teuthology.orchestra.run.smithi071.stdout:(10/144): ceph-osd-18.0.0-4742.g79365bb3.el8.x8 16 MB/s | 18 MB 00:01 2023-07-06T01:05:44.653 INFO:teuthology.orchestra.run.smithi071.stdout:(11/144): cephfs-mirror-18.0.0-4742.g79365bb3.e 3.8 MB/s | 258 kB 00:00 2023-07-06T01:05:44.711 INFO:teuthology.orchestra.run.smithi071.stdout:(12/144): libcephfs-devel-18.0.0-4742.g79365bb3 534 kB/s | 31 kB 00:00 2023-07-06T01:05:44.811 INFO:teuthology.orchestra.run.smithi071.stdout:(13/144): libcephfs2-18.0.0-4742.g79365bb3.el8. 7.6 MB/s | 770 kB 00:00 2023-07-06T01:05:44.870 INFO:teuthology.orchestra.run.smithi071.stdout:(14/144): libcephsqlite-18.0.0-4742.g79365bb3.e 2.3 MB/s | 137 kB 00:00 2023-07-06T01:05:44.937 INFO:teuthology.orchestra.run.smithi071.stdout:(15/144): librados-devel-18.0.0-4742.g79365bb3. 2.0 MB/s | 139 kB 00:00 2023-07-06T01:05:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:(16/144): libradosstriper1-18.0.0-4742.g79365bb 5.6 MB/s | 475 kB 00:00 2023-07-06T01:05:45.679 INFO:teuthology.orchestra.run.smithi071.stdout:(17/144): librgw2-18.0.0-4742.g79365bb3.el8.x86 10 MB/s | 6.7 MB 00:00 2023-07-06T01:05:45.738 INFO:teuthology.orchestra.run.smithi071.stdout:(18/144): python3-ceph-argparse-18.0.0-4742.g79 767 kB/s | 45 kB 00:00 2023-07-06T01:05:45.805 INFO:teuthology.orchestra.run.smithi071.stdout:(19/144): python3-ceph-common-18.0.0-4742.g7936 1.8 MB/s | 119 kB 00:00 2023-07-06T01:05:45.872 INFO:teuthology.orchestra.run.smithi071.stdout:(20/144): python3-cephfs-18.0.0-4742.g79365bb3. 2.9 MB/s | 197 kB 00:00 2023-07-06T01:05:45.947 INFO:teuthology.orchestra.run.smithi071.stdout:(21/144): python3-rados-18.0.0-4742.g79365bb3.e 4.8 MB/s | 370 kB 00:00 2023-07-06T01:05:46.014 INFO:teuthology.orchestra.run.smithi071.stdout:(22/144): python3-rbd-18.0.0-4742.g79365bb3.el8 5.4 MB/s | 364 kB 00:00 2023-07-06T01:05:46.072 INFO:teuthology.orchestra.run.smithi071.stdout:(23/144): python3-rgw-18.0.0-4742.g79365bb3.el8 1.8 MB/s | 107 kB 00:00 2023-07-06T01:05:46.140 INFO:teuthology.orchestra.run.smithi071.stdout:(24/144): rbd-fuse-18.0.0-4742.g79365bb3.el8.x8 1.4 MB/s | 94 kB 00:00 2023-07-06T01:05:46.523 INFO:teuthology.orchestra.run.smithi071.stdout:(25/144): rbd-mirror-18.0.0-4742.g79365bb3.el8. 9.0 MB/s | 3.5 MB 00:00 2023-07-06T01:05:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:(26/144): rbd-nbd-18.0.0-4742.g79365bb3.el8.x86 2.6 MB/s | 179 kB 00:00 2023-07-06T01:05:46.649 INFO:teuthology.orchestra.run.smithi071.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4742.g 395 kB/s | 23 kB 00:00 2023-07-06T01:05:46.724 INFO:teuthology.orchestra.run.smithi071.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4742.g79365bb 1.7 MB/s | 129 kB 00:00 2023-07-06T01:05:46.822 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T01:05:46.823 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T01:05:46.836 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-07-06T01:05:46.836 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-07-06T01:05:46.837 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-07-06T01:05:46.838 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-07-06T01:05:46.839 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-06T01:05:46.841 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-06T01:05:46.844 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-06T01:05:46.845 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T01:05:46.941 INFO:teuthology.orchestra.run.smithi071.stdout:(29/144): ceph-mgr-dashboard-18.0.0-4742.g79365 7.9 MB/s | 1.7 MB 00:00 2023-07-06T01:05:47.037 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-07-06T01:05:47.050 INFO:teuthology.orchestra.run.smithi194.stdout:==================================================================================================== 2023-07-06T01:05:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2023-07-06T01:05:47.051 INFO:teuthology.orchestra.run.smithi194.stdout:==================================================================================================== 2023-07-06T01:05:47.051 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2023-07-06T01:05:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-07-06T01:05:47.051 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.4 k 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 5.4 M 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 847 k 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 165 k 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 1.5 M 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 129 k 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 1.7 M 2023-07-06T01:05:47.052 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 7.4 M 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 47 k 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 13 M 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 48 M 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 258 k 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 166 k 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 258 k 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 18 k 2023-07-06T01:05:47.053 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 31 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 770 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 139 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-07-06T01:05:47.054 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 197 k 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 370 k 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 364 k 2023-07-06T01:05:47.055 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 107 k 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 94 k 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.5 M 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 179 k 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-07-06T01:05:47.056 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.7 M 2023-07-06T01:05:47.057 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.6 M 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-07-06T01:05:47.058 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 22 M 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 23 k 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 2.3 M 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 240 k 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 4.6 M 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 18 M 2023-07-06T01:05:47.059 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 15 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 24 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 137 k 2023-07-06T01:05:47.060 INFO:teuthology.orchestra.run.smithi194.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 475 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-07-06T01:05:47.061 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.7 M 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-07-06T01:05:47.062 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-07-06T01:05:47.063 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 45 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 119 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-07-06T01:05:47.064 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-07-06T01:05:47.065 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-06T01:05:47.066 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-07-06T01:05:47.067 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-06T01:05:47.068 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-06T01:05:47.069 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-07-06T01:05:47.070 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout:Enabling module streams: 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql 10 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout:==================================================================================================== 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout:Install 128 Packages 2023-07-06T01:05:47.071 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 16 Packages 2023-07-06T01:05:47.072 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:05:47.072 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 212 M 2023-07-06T01:05:47.072 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-07-06T01:05:47.375 INFO:teuthology.orchestra.run.smithi071.stdout:(30/144): ceph-test-18.0.0-4742.g79365bb3.el8.x 14 MB/s | 48 MB 00:03 2023-07-06T01:05:47.458 INFO:teuthology.orchestra.run.smithi071.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4742.g79 2.8 MB/s | 240 kB 00:00 2023-07-06T01:05:47.542 INFO:teuthology.orchestra.run.smithi071.stdout:(32/144): ceph-mgr-rook-18.0.0-4742.g79365bb3.e 570 kB/s | 47 kB 00:00 2023-07-06T01:05:47.634 INFO:teuthology.orchestra.run.smithi071.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4742.g7 159 kB/s | 15 kB 00:00 2023-07-06T01:05:47.706 INFO:teuthology.orchestra.run.smithi194.stdout:(1/144): ceph-18.0.0-4742.g79365bb3.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-07-06T01:05:47.726 INFO:teuthology.orchestra.run.smithi071.stdout:(34/144): ceph-mgr-diskprediction-local-18.0.0- 9.4 MB/s | 7.4 MB 00:00 2023-07-06T01:05:47.751 INFO:teuthology.orchestra.run.smithi071.stdout:(35/144): ceph-volume-18.0.0-4742.g79365bb3.el8 2.2 MB/s | 258 kB 00:00 2023-07-06T01:05:47.793 INFO:teuthology.orchestra.run.smithi071.stdout:(36/144): cephadm-18.0.0-4742.g79365bb3.el8.noa 2.4 MB/s | 166 kB 00:00 2023-07-06T01:05:47.831 INFO:teuthology.orchestra.run.smithi071.stdout:(37/144): cephfs-top-18.0.0-4742.g79365bb3.el8. 239 kB/s | 18 kB 00:00 2023-07-06T01:05:47.977 INFO:teuthology.orchestra.run.smithi071.stdout:(38/144): ceph-radosgw-18.0.0-4742.g79365bb3.el 3.0 MB/s | 13 MB 00:04 2023-07-06T01:05:48.111 INFO:teuthology.orchestra.run.smithi071.stdout:(39/144): automake-1.16.1-7.el8.noarch.rpm 2.2 MB/s | 713 kB 00:00 2023-07-06T01:05:48.169 INFO:teuthology.orchestra.run.smithi071.stdout:(40/144): bison-3.0.4-10.el8.x86_64.rpm 2.0 MB/s | 688 kB 00:00 2023-07-06T01:05:48.182 INFO:teuthology.orchestra.run.smithi194.stdout:(2/144): ceph-fuse-18.0.0-4742.g79365bb3.el8.x8 1.7 MB/s | 847 kB 00:00 2023-07-06T01:05:48.194 INFO:teuthology.orchestra.run.smithi071.stdout:(41/144): jq-1.6-7.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2023-07-06T01:05:48.228 INFO:teuthology.orchestra.run.smithi071.stdout:(42/144): flex-2.6.1-9.el8.x86_64.rpm 1.2 MB/s | 320 kB 00:00 2023-07-06T01:05:48.253 INFO:teuthology.orchestra.run.smithi071.stdout:(43/144): libpq-13.5-1.el8.x86_64.rpm 2.3 MB/s | 198 kB 00:00 2023-07-06T01:05:48.279 INFO:teuthology.orchestra.run.smithi071.stdout:(44/144): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-07-06T01:05:48.304 INFO:teuthology.orchestra.run.smithi071.stdout:(45/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-07-06T01:05:48.307 INFO:teuthology.orchestra.run.smithi194.stdout:(3/144): ceph-immutable-object-cache-18.0.0-474 1.3 MB/s | 165 kB 00:00 2023-07-06T01:05:48.329 INFO:teuthology.orchestra.run.smithi071.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-07-06T01:05:48.371 INFO:teuthology.orchestra.run.smithi071.stdout:(47/144): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-07-06T01:05:48.521 INFO:teuthology.orchestra.run.smithi071.stdout:(48/144): openblas-0.3.15-4.el8.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2023-07-06T01:05:48.580 INFO:teuthology.orchestra.run.smithi071.stdout:(49/144): postgresql-10.23-1.module_el8+300+2c5 7.5 MB/s | 1.6 MB 00:00 2023-07-06T01:05:48.614 INFO:teuthology.orchestra.run.smithi071.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 9.6 MB/s | 903 kB 00:00 2023-07-06T01:05:48.689 INFO:teuthology.orchestra.run.smithi071.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-07-06T01:05:48.748 INFO:teuthology.orchestra.run.smithi071.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2023-07-06T01:05:48.857 INFO:teuthology.orchestra.run.smithi071.stdout:(53/144): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-07-06T01:05:48.882 INFO:teuthology.orchestra.run.smithi071.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2023-07-06T01:05:48.907 INFO:teuthology.orchestra.run.smithi071.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 400 kB/s | 20 kB 00:00 2023-07-06T01:05:48.941 INFO:teuthology.orchestra.run.smithi071.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-06T01:05:48.966 INFO:teuthology.orchestra.run.smithi071.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 659 kB/s | 39 kB 00:00 2023-07-06T01:05:49.033 INFO:teuthology.orchestra.run.smithi071.stdout:(58/144): postgresql-server-10.23-1.module_el8+ 11 MB/s | 5.1 MB 00:00 2023-07-06T01:05:49.058 INFO:teuthology.orchestra.run.smithi071.stdout:(59/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-07-06T01:05:49.084 INFO:teuthology.orchestra.run.smithi071.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 877 kB/s | 44 kB 00:00 2023-07-06T01:05:49.109 INFO:teuthology.orchestra.run.smithi071.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-06T01:05:49.134 INFO:teuthology.orchestra.run.smithi071.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2023-07-06T01:05:49.159 INFO:teuthology.orchestra.run.smithi071.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-07-06T01:05:49.185 INFO:teuthology.orchestra.run.smithi071.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-06T01:05:49.260 INFO:teuthology.orchestra.run.smithi071.stdout:(65/144): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-07-06T01:05:49.274 INFO:teuthology.orchestra.run.smithi194.stdout:(4/144): ceph-mds-18.0.0-4742.g79365bb3.el8.x86 2.4 MB/s | 2.3 MB 00:00 2023-07-06T01:05:49.294 INFO:teuthology.orchestra.run.smithi071.stdout:(66/144): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-07-06T01:05:49.319 INFO:teuthology.orchestra.run.smithi071.stdout:(67/144): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-06T01:05:49.344 INFO:teuthology.orchestra.run.smithi071.stdout:(68/144): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-07-06T01:05:49.370 INFO:teuthology.orchestra.run.smithi071.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-07-06T01:05:49.628 INFO:teuthology.orchestra.run.smithi071.stdout:(70/144): python3-scipy-1.0.0-21.module_el8.5.0 29 MB/s | 14 MB 00:00 2023-07-06T01:05:49.653 INFO:teuthology.orchestra.run.smithi071.stdout:(71/144): elfutils-libelf-devel-0.189-2.el8.x86 199 kB/s | 61 kB 00:00 2023-07-06T01:05:49.721 INFO:teuthology.orchestra.run.smithi071.stdout:(72/144): fuse-2.9.7-17.el8.x86_64.rpm 237 kB/s | 83 kB 00:00 2023-07-06T01:05:49.821 INFO:teuthology.orchestra.run.smithi071.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 186 kB/s | 19 kB 00:00 2023-07-06T01:05:49.832 INFO:teuthology.orchestra.run.smithi194.stdout:(5/144): ceph-mgr-18.0.0-4742.g79365bb3.el8.x86 2.8 MB/s | 1.5 MB 00:00 2023-07-06T01:05:49.921 INFO:teuthology.orchestra.run.smithi071.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 388 kB/s | 39 kB 00:00 2023-07-06T01:05:49.955 INFO:teuthology.orchestra.run.smithi071.stdout:(75/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 147 kB/s | 48 kB 00:00 2023-07-06T01:05:49.988 INFO:teuthology.orchestra.run.smithi071.stdout:(76/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2023-07-06T01:05:50.088 INFO:teuthology.orchestra.run.smithi071.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 470 kB/s | 47 kB 00:00 2023-07-06T01:05:50.122 INFO:teuthology.orchestra.run.smithi071.stdout:(78/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2023-07-06T01:05:50.189 INFO:teuthology.orchestra.run.smithi071.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-07-06T01:05:50.231 INFO:teuthology.orchestra.run.smithi071.stdout:(80/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2023-07-06T01:05:50.257 INFO:teuthology.orchestra.run.smithi071.stdout:(81/144): libsepol-devel-2.9-3.el8.x86_64.rpm 648 kB/s | 87 kB 00:00 2023-07-06T01:05:50.282 INFO:teuthology.orchestra.run.smithi071.stdout:(82/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.1 MB/s | 99 kB 00:00 2023-07-06T01:05:50.324 INFO:teuthology.orchestra.run.smithi071.stdout:(83/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 196 kB/s | 18 kB 00:00 2023-07-06T01:05:50.349 INFO:teuthology.orchestra.run.smithi071.stdout:(84/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 476 kB/s | 44 kB 00:00 2023-07-06T01:05:50.499 INFO:teuthology.orchestra.run.smithi071.stdout:(85/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-07-06T01:05:50.525 INFO:teuthology.orchestra.run.smithi071.stdout:(86/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2023-07-06T01:05:50.608 INFO:teuthology.orchestra.run.smithi071.stdout:(87/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-07-06T01:05:50.633 INFO:teuthology.orchestra.run.smithi071.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2023-07-06T01:05:50.767 INFO:teuthology.orchestra.run.smithi071.stdout:(89/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.6 MB/s | 3.2 MB 00:00 2023-07-06T01:05:50.782 INFO:teuthology.orchestra.run.smithi194.stdout:(6/144): ceph-common-18.0.0-4742.g79365bb3.el8. 6.8 MB/s | 22 MB 00:03 2023-07-06T01:05:50.784 INFO:teuthology.orchestra.run.smithi071.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 283 kB/s | 43 kB 00:00 2023-07-06T01:05:50.809 INFO:teuthology.orchestra.run.smithi071.stdout:(91/144): python3-cryptography-3.2.1-6.el8.x86_ 3.1 MB/s | 641 kB 00:00 2023-07-06T01:05:50.859 INFO:teuthology.orchestra.run.smithi071.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-07-06T01:05:50.885 INFO:teuthology.orchestra.run.smithi071.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-07-06T01:05:50.910 INFO:teuthology.orchestra.run.smithi071.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 424 kB/s | 43 kB 00:00 2023-07-06T01:05:50.952 INFO:teuthology.orchestra.run.smithi071.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 805 kB/s | 74 kB 00:00 2023-07-06T01:05:50.986 INFO:teuthology.orchestra.run.smithi071.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 577 kB/s | 58 kB 00:00 2023-07-06T01:05:51.482 INFO:teuthology.orchestra.run.smithi194.stdout:(7/144): ceph-base-18.0.0-4742.g79365bb3.el8.x8 1.4 MB/s | 5.4 MB 00:03 2023-07-06T01:05:51.552 INFO:teuthology.orchestra.run.smithi071.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 98 kB/s | 59 kB 00:00 2023-07-06T01:05:51.586 INFO:teuthology.orchestra.run.smithi071.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 125 kB/s | 75 kB 00:00 2023-07-06T01:05:51.703 INFO:teuthology.orchestra.run.smithi071.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-07-06T01:05:51.887 INFO:teuthology.orchestra.run.smithi071.stdout:(100/144): gperftools-libs-2.7-9.el8.x86_64.rpm 314 kB/s | 306 kB 00:00 2023-07-06T01:05:51.966 INFO:teuthology.orchestra.run.smithi194.stdout:(8/144): ceph-osd-18.0.0-4742.g79365bb3.el8.x86 15 MB/s | 18 MB 00:01 2023-07-06T01:05:52.012 INFO:teuthology.orchestra.run.smithi071.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 600 kB/s | 185 kB 00:00 2023-07-06T01:05:52.033 INFO:teuthology.orchestra.run.smithi194.stdout:(9/144): ceph-mon-18.0.0-4742.g79365bb3.el8.x86 2.1 MB/s | 4.6 MB 00:02 2023-07-06T01:05:52.037 INFO:teuthology.orchestra.run.smithi071.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 220 kB/s | 33 kB 00:00 2023-07-06T01:05:52.058 INFO:teuthology.orchestra.run.smithi194.stdout:(10/144): ceph-selinux-18.0.0-4742.g79365bb3.el 265 kB/s | 24 kB 00:00 2023-07-06T01:05:52.108 INFO:teuthology.orchestra.run.smithi194.stdout:(11/144): cephfs-mirror-18.0.0-4742.g79365bb3.e 5.1 MB/s | 258 kB 00:00 2023-07-06T01:05:52.129 INFO:teuthology.orchestra.run.smithi071.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 140 kB/s | 16 kB 00:00 2023-07-06T01:05:52.150 INFO:teuthology.orchestra.run.smithi194.stdout:(12/144): libcephfs-devel-18.0.0-4742.g79365bb3 751 kB/s | 31 kB 00:00 2023-07-06T01:05:52.196 INFO:teuthology.orchestra.run.smithi071.stdout:(104/144): python3-asyncssh-2.7.0-2.el8.noarch. 740 kB/s | 476 kB 00:00 2023-07-06T01:05:52.234 INFO:teuthology.orchestra.run.smithi194.stdout:(13/144): libcephfs2-18.0.0-4742.g79365bb3.el8. 9.1 MB/s | 770 kB 00:00 2023-07-06T01:05:52.284 INFO:teuthology.orchestra.run.smithi194.stdout:(14/144): libcephsqlite-18.0.0-4742.g79365bb3.e 2.7 MB/s | 137 kB 00:00 2023-07-06T01:05:52.330 INFO:teuthology.orchestra.run.smithi071.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 590 kB/s | 173 kB 00:00 2023-07-06T01:05:52.334 INFO:teuthology.orchestra.run.smithi194.stdout:(15/144): librados-devel-18.0.0-4742.g79365bb3. 2.7 MB/s | 139 kB 00:00 2023-07-06T01:05:52.393 INFO:teuthology.orchestra.run.smithi194.stdout:(16/144): libradosstriper1-18.0.0-4742.g79365bb 7.9 MB/s | 475 kB 00:00 2023-07-06T01:05:52.396 INFO:teuthology.orchestra.run.smithi071.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 406 kB/s | 81 kB 00:00 2023-07-06T01:05:52.447 INFO:teuthology.orchestra.run.smithi071.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-07-06T01:05:52.506 INFO:teuthology.orchestra.run.smithi071.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-07-06T01:05:52.631 INFO:teuthology.orchestra.run.smithi071.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 390 kB/s | 49 kB 00:00 2023-07-06T01:05:52.690 INFO:teuthology.orchestra.run.smithi071.stdout:(110/144): python3-cherrypy-18.4.0-1.el8.noarch 686 kB/s | 384 kB 00:00 2023-07-06T01:05:52.748 INFO:teuthology.orchestra.run.smithi071.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 503 kB/s | 59 kB 00:00 2023-07-06T01:05:52.785 INFO:teuthology.orchestra.run.smithi194.stdout:(17/144): librgw2-18.0.0-4742.g79365bb3.el8.x86 17 MB/s | 6.7 MB 00:00 2023-07-06T01:05:52.807 INFO:teuthology.orchestra.run.smithi071.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 515 kB/s | 60 kB 00:00 2023-07-06T01:05:52.827 INFO:teuthology.orchestra.run.smithi194.stdout:(18/144): python3-ceph-argparse-18.0.0-4742.g79 1.1 MB/s | 45 kB 00:00 2023-07-06T01:05:52.877 INFO:teuthology.orchestra.run.smithi194.stdout:(19/144): python3-ceph-common-18.0.0-4742.g7936 2.3 MB/s | 119 kB 00:00 2023-07-06T01:05:52.927 INFO:teuthology.orchestra.run.smithi194.stdout:(20/144): python3-cephfs-18.0.0-4742.g79365bb3. 3.9 MB/s | 197 kB 00:00 2023-07-06T01:05:52.932 INFO:teuthology.orchestra.run.smithi071.stdout:(113/144): python3-portend-2.6-1.el8.noarch.rpm 125 kB/s | 16 kB 00:00 2023-07-06T01:05:53.018 INFO:teuthology.orchestra.run.smithi194.stdout:(21/144): python3-rados-18.0.0-4742.g79365bb3.e 4.0 MB/s | 370 kB 00:00 2023-07-06T01:05:53.057 INFO:teuthology.orchestra.run.smithi071.stdout:(114/144): python3-repoze-lru-0.7-6.el8.noarch. 270 kB/s | 34 kB 00:00 2023-07-06T01:05:53.070 INFO:teuthology.orchestra.run.smithi194.stdout:(22/144): python3-rbd-18.0.0-4742.g79365bb3.el8 6.9 MB/s | 364 kB 00:00 2023-07-06T01:05:53.120 INFO:teuthology.orchestra.run.smithi194.stdout:(23/144): python3-rgw-18.0.0-4742.g79365bb3.el8 2.1 MB/s | 107 kB 00:00 2023-07-06T01:05:53.149 INFO:teuthology.orchestra.run.smithi071.stdout:(115/144): python3-pecan-1.3.2-9.el8.noarch.rpm 706 kB/s | 283 kB 00:00 2023-07-06T01:05:53.162 INFO:teuthology.orchestra.run.smithi194.stdout:(24/144): rbd-fuse-18.0.0-4742.g79365bb3.el8.x8 2.2 MB/s | 94 kB 00:00 2023-07-06T01:05:53.275 INFO:teuthology.orchestra.run.smithi071.stdout:(116/144): python3-rsa-4.8-1.el8.noarch.rpm 492 kB/s | 61 kB 00:00 2023-07-06T01:05:53.396 INFO:teuthology.orchestra.run.smithi194.stdout:(25/144): rbd-mirror-18.0.0-4742.g79365bb3.el8. 15 MB/s | 3.5 MB 00:00 2023-07-06T01:05:53.408 INFO:teuthology.orchestra.run.smithi071.stdout:(117/144): python3-simplegeneric-0.8.1-17.el8.n 141 kB/s | 19 kB 00:00 2023-07-06T01:05:53.434 INFO:teuthology.orchestra.run.smithi071.stdout:(118/144): python3-routes-2.4.1-12.el8.noarch.r 522 kB/s | 196 kB 00:00 2023-07-06T01:05:53.437 INFO:teuthology.orchestra.run.smithi194.stdout:(26/144): rbd-nbd-18.0.0-4742.g79365bb3.el8.x86 4.3 MB/s | 179 kB 00:00 2023-07-06T01:05:53.480 INFO:teuthology.orchestra.run.smithi194.stdout:(27/144): ceph-grafana-dashboards-18.0.0-4742.g 552 kB/s | 23 kB 00:00 2023-07-06T01:05:53.530 INFO:teuthology.orchestra.run.smithi194.stdout:(28/144): ceph-mgr-cephadm-18.0.0-4742.g79365bb 2.5 MB/s | 129 kB 00:00 2023-07-06T01:05:53.534 INFO:teuthology.orchestra.run.smithi071.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 191 kB/s | 24 kB 00:00 2023-07-06T01:05:53.551 INFO:teuthology.orchestra.run.smithi071.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 250 kB/s | 29 kB 00:00 2023-07-06T01:05:53.643 INFO:teuthology.orchestra.run.smithi071.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 254 kB/s | 27 kB 00:00 2023-07-06T01:05:53.655 INFO:teuthology.orchestra.run.smithi194.stdout:(29/144): ceph-mgr-dashboard-18.0.0-4742.g79365 14 MB/s | 1.7 MB 00:00 2023-07-06T01:05:53.951 INFO:teuthology.orchestra.run.smithi071.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 638 kB/s | 255 kB 00:00 2023-07-06T01:05:54.018 INFO:teuthology.orchestra.run.smithi071.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 670 kB/s | 251 kB 00:00 2023-07-06T01:05:54.068 INFO:teuthology.orchestra.run.smithi071.stdout:(124/144): python3-websocket-client-0.56.0-5.el 525 kB/s | 61 kB 00:00 2023-07-06T01:05:54.081 INFO:teuthology.orchestra.run.smithi194.stdout:(30/144): ceph-mgr-diskprediction-local-18.0.0- 17 MB/s | 7.4 MB 00:00 2023-07-06T01:05:54.139 INFO:teuthology.orchestra.run.smithi194.stdout:(31/144): ceph-mgr-modules-core-18.0.0-4742.g79 4.1 MB/s | 240 kB 00:00 2023-07-06T01:05:54.177 INFO:teuthology.orchestra.run.smithi071.stdout:(125/144): python3-kubernetes-11.0.0-6.el8.noar 690 kB/s | 1.2 MB 00:01 2023-07-06T01:05:54.181 INFO:teuthology.orchestra.run.smithi194.stdout:(32/144): ceph-mgr-rook-18.0.0-4742.g79365bb3.e 1.1 MB/s | 47 kB 00:00 2023-07-06T01:05:54.203 INFO:teuthology.orchestra.run.smithi071.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 171 kB/s | 23 kB 00:00 2023-07-06T01:05:54.223 INFO:teuthology.orchestra.run.smithi194.stdout:(33/144): ceph-prometheus-alerts-18.0.0-4742.g7 349 kB/s | 15 kB 00:00 2023-07-06T01:05:54.228 INFO:teuthology.orchestra.run.smithi071.stdout:(127/144): python3-webtest-2.0.33-1.el8.noarch. 408 kB/s | 85 kB 00:00 2023-07-06T01:05:54.291 INFO:teuthology.orchestra.run.smithi194.stdout:(34/144): ceph-volume-18.0.0-4742.g79365bb3.el8 3.8 MB/s | 258 kB 00:00 2023-07-06T01:05:54.340 INFO:teuthology.orchestra.run.smithi194.stdout:(35/144): cephadm-18.0.0-4742.g79365bb3.el8.noa 3.3 MB/s | 166 kB 00:00 2023-07-06T01:05:54.390 INFO:teuthology.orchestra.run.smithi194.stdout:(36/144): cephfs-top-18.0.0-4742.g79365bb3.el8. 358 kB/s | 18 kB 00:00 2023-07-06T01:05:54.599 INFO:teuthology.orchestra.run.smithi194.stdout:(37/144): automake-1.16.1-7.el8.noarch.rpm 3.4 MB/s | 713 kB 00:00 2023-07-06T01:05:54.666 INFO:teuthology.orchestra.run.smithi194.stdout:(38/144): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-07-06T01:05:54.678 INFO:teuthology.orchestra.run.smithi071.stdout:(128/144): librbd1-18.0.0-4742.g79365bb3.el8.x8 7.9 MB/s | 3.6 MB 00:00 2023-07-06T01:05:54.724 INFO:teuthology.orchestra.run.smithi194.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-07-06T01:05:54.792 INFO:teuthology.orchestra.run.smithi194.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-07-06T01:05:54.842 INFO:teuthology.orchestra.run.smithi194.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-07-06T01:05:54.900 INFO:teuthology.orchestra.run.smithi194.stdout:(42/144): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-07-06T01:05:54.976 INFO:teuthology.orchestra.run.smithi194.stdout:(43/144): libtool-2.4.6-25.el8.x86_64.rpm 9.3 MB/s | 709 kB 00:00 2023-07-06T01:05:55.020 INFO:teuthology.orchestra.run.smithi071.stdout:(129/144): NetworkManager-initscripts-updown-1. 419 kB/s | 143 kB 00:00 2023-07-06T01:05:55.026 INFO:teuthology.orchestra.run.smithi194.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-06T01:05:55.084 INFO:teuthology.orchestra.run.smithi194.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 3.2 MB/s | 187 kB 00:00 2023-07-06T01:05:55.120 INFO:teuthology.orchestra.run.smithi071.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 764 kB/s | 76 kB 00:00 2023-07-06T01:05:55.221 INFO:teuthology.orchestra.run.smithi071.stdout:(131/144): librados2-18.0.0-4742.g79365bb3.el8. 3.6 MB/s | 3.7 MB 00:01 2023-07-06T01:05:55.260 INFO:teuthology.orchestra.run.smithi194.stdout:(46/144): openblas-0.3.15-4.el8.x86_64.rpm 27 MB/s | 4.7 MB 00:00 2023-07-06T01:05:55.329 INFO:teuthology.orchestra.run.smithi071.stdout:(132/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.1 MB/s | 232 kB 00:00 2023-07-06T01:05:55.427 INFO:teuthology.orchestra.run.smithi194.stdout:(47/144): openblas-threads-0.3.15-4.el8.x86_64. 29 MB/s | 4.9 MB 00:00 2023-07-06T01:05:55.510 INFO:teuthology.orchestra.run.smithi194.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 19 MB/s | 1.6 MB 00:00 2023-07-06T01:05:55.571 INFO:teuthology.orchestra.run.smithi071.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 3.6 MB/s | 880 kB 00:00 2023-07-06T01:05:55.586 INFO:teuthology.orchestra.run.smithi194.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 12 MB/s | 903 kB 00:00 2023-07-06T01:05:55.606 INFO:teuthology.orchestra.run.smithi071.stdout:(134/144): elfutils-libs-0.189-2.el8.x86_64.rpm 788 kB/s | 302 kB 00:00 2023-07-06T01:05:55.672 INFO:teuthology.orchestra.run.smithi071.stdout:(135/144): libblkid-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 220 kB 00:00 2023-07-06T01:05:55.714 INFO:teuthology.orchestra.run.smithi071.stdout:(136/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2023-07-06T01:05:55.753 INFO:teuthology.orchestra.run.smithi194.stdout:(50/144): postgresql-server-10.23-1.module_el8+ 31 MB/s | 5.1 MB 00:00 2023-07-06T01:05:55.764 INFO:teuthology.orchestra.run.smithi071.stdout:(137/144): libmount-2.32.1-42.el8.x86_64.rpm 2.5 MB/s | 236 kB 00:00 2023-07-06T01:05:55.831 INFO:teuthology.orchestra.run.smithi071.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.5 MB/s | 179 kB 00:00 2023-07-06T01:05:55.857 INFO:teuthology.orchestra.run.smithi071.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 1.0 MB/s | 98 kB 00:00 2023-07-06T01:05:55.920 INFO:teuthology.orchestra.run.smithi194.stdout:(51/144): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-07-06T01:05:55.957 INFO:teuthology.orchestra.run.smithi071.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.0 MB/s | 102 kB 00:00 2023-07-06T01:05:55.987 INFO:teuthology.orchestra.run.smithi194.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-07-06T01:05:56.037 INFO:teuthology.orchestra.run.smithi194.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 535 kB/s | 27 kB 00:00 2023-07-06T01:05:56.065 INFO:teuthology.orchestra.run.smithi071.stdout:(141/144): xfsdump-3.1.8-6.el8.x86_64.rpm 3.0 MB/s | 334 kB 00:00 2023-07-06T01:05:56.087 INFO:teuthology.orchestra.run.smithi194.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-07-06T01:05:56.138 INFO:teuthology.orchestra.run.smithi194.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-07-06T01:05:56.188 INFO:teuthology.orchestra.run.smithi194.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 780 kB/s | 39 kB 00:00 2023-07-06T01:05:56.249 INFO:teuthology.orchestra.run.smithi071.stdout:(142/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2023-07-06T01:05:56.299 INFO:teuthology.orchestra.run.smithi071.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 5.5 MB/s | 2.6 MB 00:00 2023-07-06T01:05:56.330 INFO:teuthology.orchestra.run.smithi194.stdout:(57/144): python3-numpy-1.14.3-10.el8.x86_64.rp 26 MB/s | 3.7 MB 00:00 2023-07-06T01:05:56.380 INFO:teuthology.orchestra.run.smithi194.stdout:(58/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-07-06T01:05:56.430 INFO:teuthology.orchestra.run.smithi194.stdout:(59/144): python3-prettytable-0.7.2-14.el8.noar 878 kB/s | 44 kB 00:00 2023-07-06T01:05:56.481 INFO:teuthology.orchestra.run.smithi194.stdout:(60/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-06T01:05:56.531 INFO:teuthology.orchestra.run.smithi194.stdout:(61/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-07-06T01:05:56.581 INFO:teuthology.orchestra.run.smithi194.stdout:(62/144): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-07-06T01:05:56.632 INFO:teuthology.orchestra.run.smithi194.stdout:(63/144): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-07-06T01:05:56.699 INFO:teuthology.orchestra.run.smithi071.stdout:(144/144): thrift-0.13.0-2.el8.x86_64.rpm 704 kB/s | 1.7 MB 00:02 2023-07-06T01:05:56.705 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-07-06T01:05:56.706 INFO:teuthology.orchestra.run.smithi071.stdout:Total 14 MB/s | 212 MB 00:15 2023-07-06T01:05:56.932 INFO:teuthology.orchestra.run.smithi194.stdout:(64/144): ceph-radosgw-18.0.0-4742.g79365bb3.el 2.5 MB/s | 13 MB 00:05 2023-07-06T01:05:57.082 INFO:teuthology.orchestra.run.smithi194.stdout:(65/144): python3-scipy-1.0.0-21.module_el8.5.0 30 MB/s | 14 MB 00:00 2023-07-06T01:05:57.141 INFO:teuthology.orchestra.run.smithi194.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-07-06T01:05:57.191 INFO:teuthology.orchestra.run.smithi194.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-07-06T01:05:57.241 INFO:teuthology.orchestra.run.smithi194.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2023-07-06T01:05:57.275 INFO:teuthology.orchestra.run.smithi194.stdout:(69/144): python3-werkzeug-0.12.2-4.el8.noarch. 1.3 MB/s | 457 kB 00:00 2023-07-06T01:05:57.550 INFO:teuthology.orchestra.run.smithi194.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 199 kB/s | 61 kB 00:00 2023-07-06T01:05:57.583 INFO:teuthology.orchestra.run.smithi194.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 269 kB/s | 83 kB 00:00 2023-07-06T01:05:57.650 INFO:teuthology.orchestra.run.smithi194.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 480 kB/s | 48 kB 00:00 2023-07-06T01:05:57.751 INFO:teuthology.orchestra.run.smithi194.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 186 kB/s | 19 kB 00:00 2023-07-06T01:05:57.859 INFO:teuthology.orchestra.run.smithi194.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 359 kB/s | 39 kB 00:00 2023-07-06T01:05:57.918 INFO:teuthology.orchestra.run.smithi194.stdout:(75/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2023-07-06T01:05:58.027 INFO:teuthology.orchestra.run.smithi194.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.6 MB/s | 172 kB 00:00 2023-07-06T01:05:58.127 INFO:teuthology.orchestra.run.smithi194.stdout:(77/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 471 kB/s | 47 kB 00:00 2023-07-06T01:05:58.194 INFO:teuthology.orchestra.run.smithi194.stdout:(78/144): libgfortran-8.5.0-20.el8.x86_64.rpm 1.9 MB/s | 645 kB 00:00 2023-07-06T01:05:58.219 INFO:teuthology.orchestra.run.smithi194.stdout:(79/144): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-07-06T01:05:58.295 INFO:teuthology.orchestra.run.smithi194.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 865 kB/s | 87 kB 00:00 2023-07-06T01:05:58.328 INFO:teuthology.orchestra.run.smithi194.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 917 kB/s | 99 kB 00:00 2023-07-06T01:05:58.379 INFO:teuthology.orchestra.run.smithi194.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 216 kB/s | 18 kB 00:00 2023-07-06T01:05:58.412 INFO:teuthology.orchestra.run.smithi194.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 524 kB/s | 44 kB 00:00 2023-07-06T01:05:58.503 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-07-06T01:05:58.587 INFO:teuthology.orchestra.run.smithi194.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-07-06T01:05:58.688 INFO:teuthology.orchestra.run.smithi194.stdout:(85/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-07-06T01:05:58.788 INFO:teuthology.orchestra.run.smithi194.stdout:(86/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.2 MB/s | 220 kB 00:00 2023-07-06T01:05:58.916 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-07-06T01:05:58.917 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-07-06T01:05:58.930 INFO:teuthology.orchestra.run.smithi194.stdout:(87/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 5.8 MB/s | 3.2 MB 00:00 2023-07-06T01:05:58.955 INFO:teuthology.orchestra.run.smithi194.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2023-07-06T01:05:59.047 INFO:teuthology.orchestra.run.smithi194.stdout:(89/144): python3-cryptography-3.2.1-6.el8.x86_ 5.4 MB/s | 641 kB 00:00 2023-07-06T01:05:59.072 INFO:teuthology.orchestra.run.smithi194.stdout:(90/144): python3-jwt-1.6.1-2.el8.noarch.rpm 365 kB/s | 43 kB 00:00 2023-07-06T01:05:59.156 INFO:teuthology.orchestra.run.smithi194.stdout:(91/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2023-07-06T01:05:59.181 INFO:teuthology.orchestra.run.smithi194.stdout:(92/144): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-07-06T01:05:59.257 INFO:teuthology.orchestra.run.smithi194.stdout:(93/144): python3-requests-oauthlib-1.0.0-1.el8 426 kB/s | 43 kB 00:00 2023-07-06T01:05:59.282 INFO:teuthology.orchestra.run.smithi194.stdout:(94/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 743 kB/s | 74 kB 00:00 2023-07-06T01:05:59.357 INFO:teuthology.orchestra.run.smithi194.stdout:(95/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 579 kB/s | 58 kB 00:00 2023-07-06T01:05:59.433 INFO:teuthology.orchestra.run.smithi194.stdout:(96/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2023-07-06T01:05:59.483 INFO:teuthology.orchestra.run.smithi194.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2023-07-06T01:05:59.509 INFO:teuthology.orchestra.run.smithi194.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 998 kB/s | 75 kB 00:00 2023-07-06T01:05:59.550 INFO:teuthology.orchestra.run.smithi194.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-07-06T01:05:59.592 INFO:teuthology.orchestra.run.smithi194.stdout:(100/144): python3-asyncssh-2.7.0-2.el8.noarch. 4.3 MB/s | 476 kB 00:00 2023-07-06T01:05:59.617 INFO:teuthology.orchestra.run.smithi194.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 2.7 MB/s | 185 kB 00:00 2023-07-06T01:05:59.643 INFO:teuthology.orchestra.run.smithi194.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 661 kB/s | 33 kB 00:00 2023-07-06T01:05:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 310 kB/s | 16 kB 00:00 2023-07-06T01:05:59.695 INFO:teuthology.orchestra.run.smithi194.stdout:(104/144): python3-cheroot-8.5.2-1.el8.noarch.r 3.2 MB/s | 173 kB 00:00 2023-07-06T01:05:59.737 INFO:teuthology.orchestra.run.smithi194.stdout:(105/144): python3-cherrypy-18.4.0-1.el8.noarch 5.6 MB/s | 384 kB 00:00 2023-07-06T01:05:59.763 INFO:teuthology.orchestra.run.smithi194.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-07-06T01:05:59.780 INFO:teuthology.orchestra.run.smithi194.stdout:(107/144): python3-jaraco-6.2-6.el8.noarch.rpm 266 kB/s | 11 kB 00:00 2023-07-06T01:05:59.797 INFO:teuthology.orchestra.run.smithi194.stdout:(108/144): python3-jaraco-functools-2.0-4.el8.n 526 kB/s | 18 kB 00:00 2023-07-06T01:05:59.830 INFO:teuthology.orchestra.run.smithi194.stdout:(109/144): python3-logutils-0.3.5-11.el8.noarch 1.4 MB/s | 49 kB 00:00 2023-07-06T01:05:59.864 INFO:teuthology.orchestra.run.smithi194.stdout:(110/144): python3-kubernetes-11.0.0-6.el8.noar 14 MB/s | 1.2 MB 00:00 2023-07-06T01:05:59.881 INFO:teuthology.orchestra.run.smithi194.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-07-06T01:05:59.898 INFO:teuthology.orchestra.run.smithi194.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.8 MB/s | 60 kB 00:00 2023-07-06T01:05:59.931 INFO:teuthology.orchestra.run.smithi194.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-07-06T01:05:59.949 INFO:teuthology.orchestra.run.smithi194.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-07-06T01:05:59.973 INFO:teuthology.orchestra.run.smithi194.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 805 kB/s | 34 kB 00:00 2023-07-06T01:05:59.999 INFO:teuthology.orchestra.run.smithi194.stdout:(116/144): python3-routes-2.4.1-12.el8.noarch.r 3.8 MB/s | 196 kB 00:00 2023-07-06T01:06:00.024 INFO:teuthology.orchestra.run.smithi194.stdout:(117/144): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-07-06T01:06:00.216 INFO:teuthology.orchestra.run.smithi194.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 86 kB/s | 19 kB 00:00 2023-07-06T01:06:00.242 INFO:teuthology.orchestra.run.smithi194.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 110 kB/s | 24 kB 00:00 2023-07-06T01:06:00.267 INFO:teuthology.orchestra.run.smithi194.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 581 kB/s | 29 kB 00:00 2023-07-06T01:06:00.284 INFO:teuthology.orchestra.run.smithi194.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 658 kB/s | 27 kB 00:00 2023-07-06T01:06:00.317 INFO:teuthology.orchestra.run.smithi194.stdout:(122/144): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-07-06T01:06:00.343 INFO:teuthology.orchestra.run.smithi194.stdout:(123/144): python3-webob-1.8.5-1.el8.1.noarch.r 4.2 MB/s | 251 kB 00:00 2023-07-06T01:06:00.360 INFO:teuthology.orchestra.run.smithi194.stdout:(124/144): python3-websocket-client-0.56.0-5.el 1.4 MB/s | 61 kB 00:00 2023-07-06T01:06:00.385 INFO:teuthology.orchestra.run.smithi194.stdout:(125/144): python3-webtest-2.0.33-1.el8.noarch. 2.0 MB/s | 85 kB 00:00 2023-07-06T01:06:00.402 INFO:teuthology.orchestra.run.smithi194.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 551 kB/s | 23 kB 00:00 2023-07-06T01:06:00.421 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-07-06T01:06:00.425 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-07-06T01:06:00.469 INFO:teuthology.orchestra.run.smithi194.stdout:(127/144): thrift-0.13.0-2.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2023-07-06T01:06:01.328 INFO:teuthology.orchestra.run.smithi194.stdout:(128/144): librbd1-18.0.0-4742.g79365bb3.el8.x8 4.1 MB/s | 3.6 MB 00:00 2023-07-06T01:06:01.628 INFO:teuthology.orchestra.run.smithi194.stdout:(129/144): NetworkManager-initscripts-updown-1. 479 kB/s | 143 kB 00:00 2023-07-06T01:06:01.744 INFO:teuthology.orchestra.run.smithi194.stdout:(130/144): elfutils-debuginfod-client-0.189-2.e 651 kB/s | 76 kB 00:00 2023-07-06T01:06:01.912 INFO:teuthology.orchestra.run.smithi194.stdout:(131/144): elfutils-libelf-0.189-2.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2023-07-06T01:06:02.020 INFO:teuthology.orchestra.run.smithi194.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 2.7 MB/s | 302 kB 00:00 2023-07-06T01:06:02.204 INFO:teuthology.orchestra.run.smithi194.stdout:(133/144): iproute-6.2.0-2.el8.x86_64.rpm 4.7 MB/s | 880 kB 00:00 2023-07-06T01:06:02.313 INFO:teuthology.orchestra.run.smithi194.stdout:(134/144): libblkid-2.32.1-42.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-07-06T01:06:02.421 INFO:teuthology.orchestra.run.smithi194.stdout:(135/144): libfdisk-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2023-07-06T01:06:02.530 INFO:teuthology.orchestra.run.smithi194.stdout:(136/144): libmount-2.32.1-42.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-07-06T01:06:02.613 INFO:teuthology.orchestra.run.smithi194.stdout:(137/144): librados2-18.0.0-4742.g79365bb3.el8. 1.7 MB/s | 3.7 MB 00:02 2023-07-06T01:06:02.639 INFO:teuthology.orchestra.run.smithi194.stdout:(138/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-07-06T01:06:02.914 INFO:teuthology.orchestra.run.smithi194.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 328 kB/s | 98 kB 00:00 2023-07-06T01:06:03.014 INFO:teuthology.orchestra.run.smithi194.stdout:(140/144): util-linux-user-2.32.1-42.el8.x86_64 1.0 MB/s | 102 kB 00:00 2023-07-06T01:06:03.065 INFO:teuthology.orchestra.run.smithi194.stdout:(141/144): util-linux-2.32.1-42.el8.x86_64.rpm 6.1 MB/s | 2.6 MB 00:00 2023-07-06T01:06:03.181 INFO:teuthology.orchestra.run.smithi194.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.0 MB/s | 334 kB 00:00 2023-07-06T01:06:03.248 INFO:teuthology.orchestra.run.smithi194.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2023-07-06T01:06:04.074 INFO:teuthology.orchestra.run.smithi194.stdout:(144/144): ceph-test-18.0.0-4742.g79365bb3.el8. 4.0 MB/s | 48 MB 00:12 2023-07-06T01:06:04.077 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-07-06T01:06:04.078 INFO:teuthology.orchestra.run.smithi194.stdout:Total 12 MB/s | 212 MB 00:17 2023-07-06T01:06:05.664 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-07-06T01:06:05.881 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-07-06T01:06:05.889 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-06T01:06:06.081 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-06T01:06:06.243 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-06T01:06:06.301 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-07-06T01:06:06.302 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-07-06T01:06:06.331 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-06T01:06:06.485 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-06T01:06:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-06T01:06:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-06T01:06:06.973 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-06T01:06:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-06T01:06:07.351 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-06T01:06:07.798 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-07-06T01:06:07.802 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-07-06T01:06:07.815 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-06T01:06:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/160 2023-07-06T01:06:08.474 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/160 2023-07-06T01:06:08.676 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 9/160 2023-07-06T01:06:08.823 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 9/160 2023-07-06T01:06:09.034 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 10/160 2023-07-06T01:06:09.152 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 10/160 2023-07-06T01:06:09.352 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 11/160 2023-07-06T01:06:09.509 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-06T01:06:09.777 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-06T01:06:09.998 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-06T01:06:10.083 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-06T01:06:10.478 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-06T01:06:10.685 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-06T01:06:11.109 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-06T01:06:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-06T01:06:11.492 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 18/160 2023-07-06T01:06:11.620 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 18/160 2023-07-06T01:06:11.767 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 19/160 2023-07-06T01:06:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 19/160 2023-07-06T01:06:12.122 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-06T01:06:12.295 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-06T01:06:12.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-06T01:06:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-06T01:06:12.717 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-06T01:06:13.101 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-07-06T01:06:13.321 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-07-06T01:06:13.377 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-06T01:06:13.490 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-07-06T01:06:13.567 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-06T01:06:13.635 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-06T01:06:13.735 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-07-06T01:06:13.893 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-06T01:06:13.981 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-07-06T01:06:14.161 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-07-06T01:06:14.247 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-06T01:06:14.348 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-07-06T01:06:14.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-06T01:06:14.538 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-07-06T01:06:14.693 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-06T01:06:15.151 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-07-06T01:06:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-06T01:06:15.326 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/160 2023-07-06T01:06:15.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-06T01:06:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-06T01:06:15.958 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/160 2023-07-06T01:06:16.023 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-06T01:06:16.134 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 9/160 2023-07-06T01:06:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-06T01:06:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 9/160 2023-07-06T01:06:16.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 10/160 2023-07-06T01:06:16.473 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 30/160 2023-07-06T01:06:16.517 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 10/160 2023-07-06T01:06:16.621 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 31/160 2023-07-06T01:06:16.702 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 11/160 2023-07-06T01:06:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 32/160 2023-07-06T01:06:16.851 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-06T01:06:17.099 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-07-06T01:06:17.320 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-06T01:06:17.413 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-07-06T01:06:17.600 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-07-06T01:06:17.785 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-07-06T01:06:17.926 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-06T01:06:18.183 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-07-06T01:06:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-06T01:06:18.405 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-07-06T01:06:18.529 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 18/160 2023-07-06T01:06:18.609 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-06T01:06:18.659 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 18/160 2023-07-06T01:06:18.815 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-06T01:06:18.826 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 19/160 2023-07-06T01:06:18.965 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 19/160 2023-07-06T01:06:19.143 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-07-06T01:06:19.278 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-07-06T01:06:19.400 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-06T01:06:19.547 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-07-06T01:06:19.684 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-06T01:06:20.358 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-07-06T01:06:20.809 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-07-06T01:06:20.899 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-06T01:06:21.194 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-06T01:06:21.373 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-06T01:06:21.501 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-07-06T01:06:21.578 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-06T01:06:21.709 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-06T01:06:21.755 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 40/160 2023-07-06T01:06:21.955 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 41/160 2023-07-06T01:06:22.138 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-06T01:06:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-06T01:06:22.530 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-07-06T01:06:22.540 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-06T01:06:22.633 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-06T01:06:22.823 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-06T01:06:22.891 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-07-06T01:06:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-06T01:06:23.044 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-06T01:06:23.075 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-07-06T01:06:23.231 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-06T01:06:23.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-07-06T01:06:23.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-07-06T01:06:23.682 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 30/160 2023-07-06T01:06:23.808 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-06T01:06:23.813 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 31/160 2023-07-06T01:06:24.043 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 32/160 2023-07-06T01:06:24.099 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-06T01:06:24.127 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-06T01:06:24.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-06T01:06:24.623 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-06T01:06:24.857 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-06T01:06:25.011 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-06T01:06:25.092 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-07-06T01:06:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-06T01:06:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-06T01:06:25.453 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-07-06T01:06:25.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-06T01:06:25.744 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-06T01:06:25.795 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-07-06T01:06:25.926 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-06T01:06:25.983 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-06T01:06:26.087 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-06T01:06:26.261 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-06T01:06:26.463 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-06T01:06:26.648 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-06T01:06:26.841 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-06T01:06:27.087 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-06T01:06:27.344 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-06T01:06:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-06T01:06:27.897 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-06T01:06:28.065 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-07-06T01:06:28.199 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-06T01:06:28.370 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-07-06T01:06:28.418 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-06T01:06:28.573 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-07-06T01:06:28.770 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/160 2023-07-06T01:06:28.956 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 40/160 2023-07-06T01:06:29.111 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 41/160 2023-07-06T01:06:29.253 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-06T01:06:29.277 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-07-06T01:06:29.449 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-07-06T01:06:29.463 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 70/160 2023-07-06T01:06:29.554 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 70/160 2023-07-06T01:06:29.665 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-06T01:06:29.763 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-07-06T01:06:29.765 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 71/160 2023-07-06T01:06:29.940 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-07-06T01:06:29.990 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-06T01:06:30.030 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-07-06T01:06:30.187 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-07-06T01:06:30.374 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-06T01:06:30.395 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-06T01:06:30.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-06T01:06:30.974 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-07-06T01:06:31.019 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-06T01:06:31.241 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-06T01:06:31.269 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-07-06T01:06:31.307 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-06T01:06:31.465 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-07-06T01:06:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-06T01:06:31.727 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-07-06T01:06:31.953 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-07-06T01:06:32.113 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-07-06T01:06:32.262 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-07-06T01:06:32.455 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-07-06T01:06:32.647 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-07-06T01:06:32.821 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-06T01:06:32.854 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-07-06T01:06:33.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-07-06T01:06:33.180 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-07-06T01:06:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-06T01:06:33.337 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-07-06T01:06:33.430 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-06T01:06:33.505 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-07-06T01:06:33.650 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-07-06T01:06:33.677 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-06T01:06:33.826 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-07-06T01:06:33.985 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-06T01:06:34.075 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-07-06T01:06:34.232 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-06T01:06:34.330 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-07-06T01:06:34.458 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-06T01:06:34.523 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-07-06T01:06:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-06T01:06:34.852 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-07-06T01:06:35.008 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-06T01:06:35.150 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-07-06T01:06:35.226 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-06T01:06:35.352 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-07-06T01:06:35.406 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-06T01:06:35.589 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-06T01:06:35.976 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-06T01:06:36.177 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-07-06T01:06:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-06T01:06:36.368 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-06T01:06:36.381 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 70/160 2023-07-06T01:06:36.481 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 70/160 2023-07-06T01:06:36.569 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-06T01:06:36.692 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 71/160 2023-07-06T01:06:36.798 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-06T01:06:36.942 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-07-06T01:06:36.989 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-06T01:06:37.200 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-06T01:06:37.356 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-07-06T01:06:37.389 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-06T01:06:37.512 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-06T01:06:37.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-07-06T01:06:37.713 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-06T01:06:37.771 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-07-06T01:06:37.862 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-06T01:06:38.007 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-07-06T01:06:38.248 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-07-06T01:06:39.500 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-07-06T01:06:39.871 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-07-06T01:06:40.090 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-07-06T01:06:40.329 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-07-06T01:06:40.611 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-07-06T01:06:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 100/160 2023-07-06T01:06:40.841 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-07-06T01:06:41.069 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-07-06T01:06:41.278 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-07-06T01:06:41.627 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-07-06T01:06:41.663 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 100/160 2023-07-06T01:06:41.853 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-07-06T01:06:41.991 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-07-06T01:06:42.176 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-07-06T01:06:42.354 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 100/160 2023-07-06T01:06:42.515 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-07-06T01:06:42.660 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 101/160 2023-07-06T01:06:42.727 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-07-06T01:06:42.841 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 101/160 2023-07-06T01:06:42.854 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-07-06T01:06:43.030 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-07-06T01:06:43.085 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 102/160 2023-07-06T01:06:43.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-07-06T01:06:43.434 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-07-06T01:06:43.642 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-07-06T01:06:43.834 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-07-06T01:06:43.957 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-07-06T01:06:44.148 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-07-06T01:06:44.297 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-07-06T01:06:47.108 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 100/160 2023-07-06T01:06:47.338 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 100/160 2023-07-06T01:06:48.036 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 100/160 2023-07-06T01:06:48.309 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 101/160 2023-07-06T01:06:48.490 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 101/160 2023-07-06T01:06:48.671 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 102/160 2023-07-06T01:07:03.609 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 102/160 2023-07-06T01:07:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2023-07-06T01:07:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2023-07-06T01:07:03.609 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /run 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2023-07-06T01:07:03.610 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:04.006 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 103/160 2023-07-06T01:07:05.726 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 103/160 2023-07-06T01:07:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 104/160 2023-07-06T01:07:06.229 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 104/160 2023-07-06T01:07:06.438 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 105/160 2023-07-06T01:07:06.972 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 105/160 2023-07-06T01:07:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 106/160 2023-07-06T01:07:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 106/160 2023-07-06T01:07:07.438 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-06T01:07:07.635 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-06T01:07:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-06T01:07:07.856 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-06T01:07:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-06T01:07:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-06T01:07:08.979 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 112/160 2023-07-06T01:07:09.166 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 112/160 2023-07-06T01:07:09.279 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 113/160 2023-07-06T01:07:09.336 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 102/160 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /run 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2023-07-06T01:07:09.337 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2023-07-06T01:07:09.338 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2023-07-06T01:07:09.338 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /dev 2023-07-06T01:07:09.338 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:09.477 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 114/160 2023-07-06T01:07:09.713 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 115/160 2023-07-06T01:07:09.726 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 103/160 2023-07-06T01:07:09.970 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 115/160 2023-07-06T01:07:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 116/160 2023-07-06T01:07:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 116/160 2023-07-06T01:07:11.454 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 103/160 2023-07-06T01:07:11.462 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 117/160 2023-07-06T01:07:11.588 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 117/160 2023-07-06T01:07:11.697 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 104/160 2023-07-06T01:07:11.963 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 104/160 2023-07-06T01:07:12.024 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 118/160 2023-07-06T01:07:12.158 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 105/160 2023-07-06T01:07:12.237 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 119/160 2023-07-06T01:07:12.301 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 119/160 2023-07-06T01:07:12.470 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 120/160 2023-07-06T01:07:12.497 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 120/160 2023-07-06T01:07:12.687 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 105/160 2023-07-06T01:07:12.718 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 121/160 2023-07-06T01:07:12.875 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 106/160 2023-07-06T01:07:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-06T01:07:12.924 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 106/160 2023-07-06T01:07:13.092 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-07-06T01:07:13.288 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-07-06T01:07:13.441 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-06T01:07:13.542 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-07-06T01:07:13.869 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-07-06T01:07:14.084 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-07-06T01:07:14.686 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 112/160 2023-07-06T01:07:14.849 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 112/160 2023-07-06T01:07:14.966 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 113/160 2023-07-06T01:07:15.162 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 114/160 2023-07-06T01:07:15.366 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 115/160 2023-07-06T01:07:15.620 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 115/160 2023-07-06T01:07:15.829 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 116/160 2023-07-06T01:07:16.935 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 116/160 2023-07-06T01:07:17.133 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 117/160 2023-07-06T01:07:17.260 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 117/160 2023-07-06T01:07:17.643 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 118/160 2023-07-06T01:07:17.832 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-06T01:07:17.838 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 119/160 2023-07-06T01:07:17.902 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 119/160 2023-07-06T01:07:18.074 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 120/160 2023-07-06T01:07:18.101 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 120/160 2023-07-06T01:07:18.301 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 121/160 2023-07-06T01:07:18.465 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-07-06T01:07:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 123/160 2023-07-06T01:07:19.594 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 124/160 2023-07-06T01:07:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 124/160 2023-07-06T01:07:19.853 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4742.g79365 125/160 2023-07-06T01:07:19.923 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4742.g79365 125/160 2023-07-06T01:07:20.127 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 126/160 2023-07-06T01:07:20.532 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 126/160 2023-07-06T01:07:20.744 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 127/160 2023-07-06T01:07:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 127/160 2023-07-06T01:07:21.392 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-06T01:07:22.580 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 129/160 2023-07-06T01:07:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-06T01:07:23.141 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-06T01:07:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-06T01:07:23.410 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-07-06T01:07:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-06T01:07:23.752 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 134/160 2023-07-06T01:07:24.883 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-06T01:07:24.950 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 123/160 2023-07-06T01:07:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-06T01:07:25.145 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 124/160 2023-07-06T01:07:25.215 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 124/160 2023-07-06T01:07:25.235 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-06T01:07:25.382 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4742.g79365 125/160 2023-07-06T01:07:25.452 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4742.g79365 125/160 2023-07-06T01:07:25.515 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-06T01:07:25.640 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 126/160 2023-07-06T01:07:25.786 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 137/160 2023-07-06T01:07:26.010 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 138/160 2023-07-06T01:07:26.052 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 126/160 2023-07-06T01:07:26.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 127/160 2023-07-06T01:07:26.365 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 139/160 2023-07-06T01:07:26.501 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 127/160 2023-07-06T01:07:26.620 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-06T01:07:26.767 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-06T01:07:26.793 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-06T01:07:26.845 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-07-06T01:07:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-06T01:07:27.234 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-06T01:07:27.343 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-06T01:07:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-06T01:07:27.601 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-06T01:07:27.794 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-06T01:07:27.985 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-06T01:07:28.029 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 129/160 2023-07-06T01:07:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-06T01:07:28.163 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-06T01:07:28.328 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-07-06T01:07:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-06T01:07:28.430 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-06T01:07:28.519 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-07-06T01:07:28.694 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-07-06T01:07:28.728 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-06T01:07:28.744 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-06T01:07:28.852 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-07-06T01:07:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-06T01:07:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-06T01:07:29.032 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 134/160 2023-07-06T01:07:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-06T01:07:29.336 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-06T01:07:29.502 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-06T01:07:29.727 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-06T01:07:29.727 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-06T01:07:29.953 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-06T01:07:29.954 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-06T01:07:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-06T01:07:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-06T01:07:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-06T01:07:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-06T01:07:30.379 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-06T01:07:30.448 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-06T01:07:30.528 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-07-06T01:07:30.603 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-06T01:07:30.603 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-06T01:07:30.769 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-07-06T01:07:30.828 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-06T01:07:31.018 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-06T01:07:31.023 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 137/160 2023-07-06T01:07:31.243 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-06T01:07:31.244 INFO:teuthology.orchestra.run.smithi071.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-06T01:07:31.244 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:31.257 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 138/160 2023-07-06T01:07:31.608 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 139/160 2023-07-06T01:07:31.858 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-07-06T01:07:31.954 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 1/160 2023-07-06T01:07:31.954 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2/160 2023-07-06T01:07:31.954 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 3/160 2023-07-06T01:07:31.954 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 4/160 2023-07-06T01:07:31.954 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4742.g79365 5/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 6/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 7/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 8/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 9/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 10/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 11/160 2023-07-06T01:07:31.955 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 12/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 13/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 14/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 15/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 16/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 17/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 18/160 2023-07-06T01:07:31.956 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 19/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 20/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 21/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 22/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 23/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 24/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 25/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 26/160 2023-07-06T01:07:31.957 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 27/160 2023-07-06T01:07:31.958 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 28/160 2023-07-06T01:07:31.966 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 29/160 2023-07-06T01:07:31.966 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 30/160 2023-07-06T01:07:31.966 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 31/160 2023-07-06T01:07:31.966 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 32/160 2023-07-06T01:07:31.966 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 33/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 34/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 35/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 36/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 37/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 38/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-06T01:07:31.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-06T01:07:31.968 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-06T01:07:31.969 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-06T01:07:31.970 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-06T01:07:31.971 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-06T01:07:31.972 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-06T01:07:31.973 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-06T01:07:31.974 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-06T01:07:31.975 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-06T01:07:31.976 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-06T01:07:31.977 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-06T01:07:31.978 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 129/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 131/160 2023-07-06T01:07:31.979 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-06T01:07:31.980 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-06T01:07:31.981 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-06T01:07:31.982 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-06T01:07:31.983 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-06T01:07:31.983 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-06T01:07:31.983 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-06T01:07:32.005 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-06T01:07:32.035 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-07-06T01:07:32.230 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-07-06T01:07:32.463 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-07-06T01:07:32.572 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-07-06T01:07:32.830 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-07-06T01:07:32.856 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-07-06T01:07:33.032 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-07-06T01:07:33.228 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-07-06T01:07:33.392 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-07-06T01:07:33.392 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-06T01:07:33.651 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-07-06T01:07:33.651 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-06T01:07:33.883 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-07-06T01:07:33.898 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-06T01:07:34.003 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-07-06T01:07:34.003 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-06T01:07:34.082 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-06T01:07:34.082 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-06T01:07:34.083 INFO:teuthology.orchestra.run.smithi071.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.084 INFO:teuthology.orchestra.run.smithi071.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.1-7.el8.noarch 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.0.4-10.el8.x86_64 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.085 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.086 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.087 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-06T01:07:34.088 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.1-9.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: jq-1.6-7.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-06T01:07:34.089 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: libpq-13.5-1.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-06T01:07:34.090 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-06T01:07:34.091 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-06T01:07:34.092 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-06T01:07:34.093 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.094 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-06T01:07:34.095 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-06T01:07:34.096 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-06T01:07:34.097 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-2.6-1.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-06T01:07:34.098 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-06T01:07:34.099 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-06T01:07:34.100 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-06T01:07:34.101 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-06T01:07:34.102 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-06T01:07:34.102 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-06T01:07:34.102 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-06T01:07:34.102 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-06T01:07:34.103 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:34.103 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-07-06T01:07:34.254 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-07-06T01:07:34.383 DEBUG:teuthology.parallel:result is None 2023-07-06T01:07:34.441 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-07-06T01:07:34.590 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-07-06T01:07:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-06T01:07:34.807 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-06T01:07:35.049 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-07-06T01:07:35.050 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-07-06T01:07:35.250 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-07-06T01:07:35.250 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-06T01:07:35.450 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-07-06T01:07:35.450 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-06T01:07:35.675 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-07-06T01:07:35.675 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-06T01:07:35.891 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-07-06T01:07:36.098 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-06T01:07:36.328 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-07-06T01:07:36.328 INFO:teuthology.orchestra.run.smithi194.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-06T01:07:36.329 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:37.050 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 1/160 2023-07-06T01:07:37.050 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2/160 2023-07-06T01:07:37.050 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 3/160 2023-07-06T01:07:37.050 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 4/160 2023-07-06T01:07:37.050 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4742.g79365 5/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 6/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 7/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 8/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 9/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 10/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 11/160 2023-07-06T01:07:37.051 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 12/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 13/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 14/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 15/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 16/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 17/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 18/160 2023-07-06T01:07:37.052 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 19/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 20/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 21/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 22/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 23/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 24/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 25/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 26/160 2023-07-06T01:07:37.053 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 27/160 2023-07-06T01:07:37.054 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 28/160 2023-07-06T01:07:37.054 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 29/160 2023-07-06T01:07:37.054 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 30/160 2023-07-06T01:07:37.054 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 31/160 2023-07-06T01:07:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 32/160 2023-07-06T01:07:37.062 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 33/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 34/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 35/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 36/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 37/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 38/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-07-06T01:07:37.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-07-06T01:07:37.064 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-07-06T01:07:37.065 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-07-06T01:07:37.066 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-07-06T01:07:37.067 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-07-06T01:07:37.068 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-07-06T01:07:37.069 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-07-06T01:07:37.070 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-07-06T01:07:37.071 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-07-06T01:07:37.072 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-07-06T01:07:37.073 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-07-06T01:07:37.074 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 129/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 131/160 2023-07-06T01:07:37.075 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-07-06T01:07:37.076 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-07-06T01:07:37.077 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-07-06T01:07:37.078 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-07-06T01:07:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-07-06T01:07:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-07-06T01:07:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-07-06T01:07:37.079 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-07-06T01:07:39.232 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-07-06T01:07:39.232 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout: iproute-6.2.0-2.el8.x86_64 2023-07-06T01:07:39.233 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: libmount-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.234 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.1-7.el8.noarch 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.0.4-10.el8.x86_64 2023-07-06T01:07:39.235 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.236 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.237 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.238 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.1-9.el8.x86_64 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.7-17.el8.x86_64 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-7.el8.x86_64 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-06T01:07:39.239 INFO:teuthology.orchestra.run.smithi194.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-07-06T01:07:39.240 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: libpq-13.5-1.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-06T01:07:39.241 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-07-06T01:07:39.242 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.15-4.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-07-06T01:07:39.243 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-06T01:07:39.244 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-06T01:07:39.245 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-06T01:07:39.246 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.0.6-14.el8.noarch 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-06T01:07:39.247 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-2.6-1.el8.noarch 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-06T01:07:39.248 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.249 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-06T01:07:39.250 INFO:teuthology.orchestra.run.smithi194.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.251 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T01:07:39.252 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-06T01:07:39.252 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-06T01:07:39.252 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-06T01:07:39.252 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-07-06T01:07:39.252 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-06T01:07:39.253 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-07-06T01:07:39.253 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:39.253 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-07-06T01:07:39.546 DEBUG:teuthology.parallel:result is None 2023-07-06T01:07:39.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T01:07:39.689 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-06T01:07:39.746 INFO:teuthology.orchestra.run.smithi071.stdout:18.0.0-4742.g79365bb3.el8 2023-07-06T01:07:39.748 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4742.g79365bb3.el8 2023-07-06T01:07:39.748 INFO:teuthology.task.install:The correct ceph version 18.0.0-4742.g79365bb3 is installed. 2023-07-06T01:07:39.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T01:07:39.962 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-06T01:07:40.017 INFO:teuthology.orchestra.run.smithi194.stdout:18.0.0-4742.g79365bb3.el8 2023-07-06T01:07:40.018 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4742.g79365bb3.el8 2023-07-06T01:07:40.018 INFO:teuthology.task.install:The correct ceph version 18.0.0-4742.g79365bb3 is installed. 2023-07-06T01:07:40.018 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-06T01:07:40.019 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:40.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-06T01:07:40.094 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:40.094 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-06T01:07:40.169 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-06T01:07:40.169 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:40.170 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2023-07-06T01:07:40.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-06T01:07:40.352 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:40.353 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2023-07-06T01:07:40.422 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-06T01:07:40.534 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-06T01:07:40.535 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:40.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-06T01:07:40.604 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-06T01:07:40.713 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:40.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-06T01:07:40.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-06T01:07:40.896 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-06T01:07:40.897 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:40.897 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2023-07-06T01:07:40.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-06T01:07:41.081 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:41.082 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2023-07-06T01:07:41.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-06T01:07:41.263 INFO:teuthology.run_tasks:Running task ceph... 2023-07-06T01:07:41.327 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-06T01:07:41.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2023-07-06T01:07:41.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2023-07-06T01:07:41.405 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-06T01:07:41.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-06T01:07:41.409 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-06T01:07:41.484 INFO:tasks.ceph:Creating extra log directories... 2023-07-06T01:07:41.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-06T01:07:41.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-06T01:07:41.564 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-06T01:07:41.565 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-06T01:07:41.565 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-06T01:07:41.565 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:41.565 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-06T01:07:41.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-06T01:07:41.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-06T01:07:41.915 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:41.916 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-06T01:07:41.962 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-06T01:07:42.177 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-06T01:07:42.254 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-06T01:07:42.254 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-06T01:07:42.255 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779', 'branch': 'wip-rishabh-2023Jul5', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7327779', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul5'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul5', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi071.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh1FiUsm6UWjQTeRcXz5Gm5JfU5CUddCynwS0utyfFwmoR4cf9H1CosIW6mi51Z3OFzYDuyLg+kZEXQnHAe+xMfYkin0D52pWlBe2vtVtegKV6gSi2bPZZBdvK9dw+XKtteBSJnNTpnHvTJF2Yrrqgek11b7ah2tmHBhEdSHAj1Lff9kWDlUVvXtG2FCfEl37pLFx3XJ4lLEn6TGGszrRKjupnTZdCPtNbvf1n81p+PDOrGSGFrISjdKfoIELpSuJCWfoeVt5YALjj/KgD6YeYmJ9pU7baL1MDSVLtBCSwGDTU++Lk18aP3dkOGhQZtfLdDeCTbEMhschHkOBsXyjtab3c1tYMR3CaSssoTTUlQuZXuKjlKRgV4Le9Qfug+CzWXpRv7CUD/J+qufAOOFaA5NL/HtrjDWHJ4LsKXCj3gKefs0CfPpVvKCY8vg407f1FtUglSKisDdNeUrRT5N3LkNYX7SnhtuQPSqMa5LVQ6MyiX/jAvcD+h4NlbUhrSD0=', 'smithi194.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDj5B0Sb4F/pfxtBCMrH5SFVfDCw3e5E78alRxLQitAg1KqDrFIra8rZ6nVmuYK2TrpQY3OnfmukqXMpeLB125bEAq3TGf6gWxwX7BRflCkJWEo2T18EYK8PKrcU2PJDga+4tQgIw1k2i6JbbtfPn54gYWDaNu6ON0m3Yaqs1qJ4wsLNmeVnzB39U9BxrxyTzG/W+9kjxC3ooaRCrc9V8l4kDJbQxXvXCuhjlKN40yMvaaupeV3AWoej876HFVczkrv8cXPicU3bv1linPy+XAwsfKPYE7QSj22Rj9KbG9EH8Hu+GN1WKFcK9LJN4vPpcGeIcnt13RYtfsUuQckfOG65pHn+wAjLx6adLuDL2G0zuDuGhNP+5wtlgZMFvb7JdfKr1iCtOeu4qVsmXZorH3SXd+eLwnH9O5x4Ytx2MSDyQ2qTxaHGppOJ0G2ST/SbacB+pWdccKDxhKf/Il6DuLTdHX4jYBnvRwqh56LpltlgQYwIdWPuCjawpJpKjuUEM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-05_22:21:20', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-06T01:07:42.255 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-06T01:07:42.260 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-06T01:07:42.307 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2023-07-06T01:07:42.345 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2023-07-06T01:07:42.417 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:42.418 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2023-07-06T01:07:42.462 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-06T01:07:42.463 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2023-07-06T01:07:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-06T01:07:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 446 Links: 1 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-07-06 01:07:31.445509316 +0000 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-07-06 01:04:08.496840309 +0000 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-07-06 01:04:08.496840309 +0000 2023-07-06T01:07:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-07-06 01:04:08.469840770 +0000 2023-07-06T01:07:42.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-06T01:07:42.652 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-07-06T01:07:42.652 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-07-06T01:07:42.652 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000292424 s, 1.8 MB/s 2023-07-06T01:07:42.654 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-06T01:07:42.701 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2023-07-06T01:07:42.746 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-06T01:07:42.746 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-07-06T01:07:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-07-06 01:07:31.446509299 +0000 2023-07-06T01:07:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-07-06 01:04:09.354825664 +0000 2023-07-06T01:07:42.747 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-07-06 01:04:09.354825664 +0000 2023-07-06T01:07:42.748 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-07-06 01:04:09.330826073 +0000 2023-07-06T01:07:42.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-06T01:07:42.851 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-07-06T01:07:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-07-06T01:07:42.852 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000266056 s, 1.9 MB/s 2023-07-06T01:07:42.854 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-06T01:07:42.901 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2023-07-06T01:07:42.946 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-06T01:07:42.946 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:42.946 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-07-06T01:07:42.947 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:42.947 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:42.947 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-07-06 01:07:31.446509299 +0000 2023-07-06T01:07:42.947 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-07-06 01:04:10.209811070 +0000 2023-07-06T01:07:42.947 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-07-06 01:04:10.209811070 +0000 2023-07-06T01:07:42.947 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-07-06 01:04:10.185811479 +0000 2023-07-06T01:07:42.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-06T01:07:43.051 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-07-06T01:07:43.051 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-07-06T01:07:43.051 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00028658 s, 1.8 MB/s 2023-07-06T01:07:43.053 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-06T01:07:43.099 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2023-07-06T01:07:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-06T01:07:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:43.144 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-07-06T01:07:43.144 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:43.144 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:43.144 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-07-06 01:07:31.446509299 +0000 2023-07-06T01:07:43.145 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-07-06 01:04:11.037796937 +0000 2023-07-06T01:07:43.145 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-07-06 01:04:11.037796937 +0000 2023-07-06T01:07:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2023-07-06 01:04:11.010797398 +0000 2023-07-06T01:07:43.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-06T01:07:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-07-06T01:07:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-07-06T01:07:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000287924 s, 1.8 MB/s 2023-07-06T01:07:43.251 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-06T01:07:43.298 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T01:07:43.298 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:43.298 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2023-07-06T01:07:43.345 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-06T01:07:43.345 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2023-07-06T01:07:43.432 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-06T01:07:43.433 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:43.433 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-07-06T01:07:43.433 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:43.434 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:43.434 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-07-06 01:07:36.533155844 +0000 2023-07-06T01:07:43.434 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-07-06 01:04:08.512187838 +0000 2023-07-06T01:07:43.434 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-07-06 01:04:08.512187838 +0000 2023-07-06T01:07:43.435 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-07-06 01:04:08.482188431 +0000 2023-07-06T01:07:43.435 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-06T01:07:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-07-06T01:07:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-07-06T01:07:43.503 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000258171 s, 2.0 MB/s 2023-07-06T01:07:43.505 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-06T01:07:43.554 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2023-07-06T01:07:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-06T01:07:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-07-06 01:07:36.533155844 +0000 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-07-06 01:04:09.362171039 +0000 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-07-06 01:04:09.362171039 +0000 2023-07-06T01:07:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-07-06 01:04:09.336171553 +0000 2023-07-06T01:07:43.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-06T01:07:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-07-06T01:07:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-07-06T01:07:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000268972 s, 1.9 MB/s 2023-07-06T01:07:43.708 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-06T01:07:43.756 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2023-07-06T01:07:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-06T01:07:43.803 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:43.803 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-07-06T01:07:43.803 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:43.803 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:43.804 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-07-06 01:07:36.534155824 +0000 2023-07-06T01:07:43.804 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-07-06 01:04:10.184154793 +0000 2023-07-06T01:07:43.804 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-07-06 01:04:10.184154793 +0000 2023-07-06T01:07:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-07-06 01:04:10.162155227 +0000 2023-07-06T01:07:43.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-06T01:07:43.873 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-07-06T01:07:43.873 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-07-06T01:07:43.873 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000278135 s, 1.8 MB/s 2023-07-06T01:07:43.876 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-06T01:07:43.924 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2023-07-06T01:07:43.970 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-06T01:07:43.970 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T01:07:43.971 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-07-06T01:07:43.971 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T01:07:43.971 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T01:07:43.972 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-07-06 01:07:36.534155824 +0000 2023-07-06T01:07:43.972 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-07-06 01:04:11.024138191 +0000 2023-07-06T01:07:43.972 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-07-06 01:04:11.024138191 +0000 2023-07-06T01:07:43.972 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-07-06 01:04:10.999138685 +0000 2023-07-06T01:07:43.973 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-06T01:07:44.077 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-07-06T01:07:44.077 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-07-06T01:07:44.077 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000300919 s, 1.7 MB/s 2023-07-06T01:07:44.079 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-06T01:07:44.127 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T01:07:44.128 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-06T01:07:44.128 INFO:tasks.ceph:Generating config... 2023-07-06T01:07:44.130 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-06T01:07:44.130 INFO:tasks.ceph:[client] debug client = 20 2023-07-06T01:07:44.130 INFO:tasks.ceph:[client] debug ms = 1 2023-07-06T01:07:44.130 INFO:tasks.ceph:[client] pid file = 2023-07-06T01:07:44.130 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-06T01:07:44.131 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-06T01:07:44.131 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-06T01:07:44.131 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-06T01:07:44.131 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-06T01:07:44.132 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-06T01:07:44.132 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-06T01:07:44.132 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-06T01:07:44.132 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-06T01:07:44.132 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-06T01:07:44.133 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-06T01:07:44.133 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-06T01:07:44.133 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-06T01:07:44.133 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-06T01:07:44.133 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-06T01:07:44.134 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-06T01:07:44.134 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-06T01:07:44.134 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-06T01:07:44.134 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-06T01:07:44.135 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-06T01:07:44.135 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-06T01:07:44.135 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-06T01:07:44.135 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-06T01:07:44.136 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-06T01:07:44.136 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-06T01:07:44.136 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-06T01:07:44.136 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-06T01:07:44.136 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-06T01:07:44.137 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-06T01:07:44.137 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-06T01:07:44.137 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-06T01:07:44.138 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-06T01:07:44.138 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-06T01:07:44.138 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-06T01:07:44.138 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-06T01:07:44.139 INFO:tasks.ceph:Setting up mon.a... 2023-07-06T01:07:44.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-06T01:07:44.254 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2023-07-06T01:07:44.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-06T01:07:44.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T01:07:44.429 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.b', '172.21.15.194'), ('mon.c', '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]')] 2023-07-06T01:07:44.430 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-06T01:07:44.431 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:44.431 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-06T01:07:44.475 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --add b 172.21.15.194 --addv c '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:44.604 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:44.605 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 2e134b12-52b2-40d1-8145-7c2e3ab16f64 2023-07-06T01:07:44.605 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = pacific 2023-07-06T01:07:44.605 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2023-07-06T01:07:44.605 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 2e134b12-52b2-40d1-8145-7c2e3ab16f64 2023-07-06T01:07:44.605 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2023-07-06T01:07:44.603539+0000 2023-07-06T01:07:44.605 INFO:teuthology.orchestra.run.smithi071.stdout:created 2023-07-06T01:07:44.603539+0000 2023-07-06T01:07:44.606 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 16 (pacific) 2023-07-06T01:07:44.606 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2023-07-06T01:07:44.606 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2023-07-06T01:07:44.606 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2023-07-06T01:07:44.606 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] mon.c 2023-07-06T01:07:44.606 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-06T01:07:44.607 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-06T01:07:44.652 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2e134b12-52b2-40d1-8145-7c2e3ab16f64... 2023-07-06T01:07:44.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-06T01:07:44.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-06T01:07:44.806 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2023-07-06T01:07:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2023-07-06T01:07:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-06T01:07:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2023-07-06T01:07:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-06T01:07:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2023-07-06T01:07:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-06T01:07:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2023-07-06T01:07:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on skipped message = False 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 2e134b12-52b2-40d1-8145-7c2e3ab16f64 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2023-07-06T01:07:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2023-07-06T01:07:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2023-07-06T01:07:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2023-07-06T01:07:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2023-07-06T01:07:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2023-07-06T01:07:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2023-07-06T01:07:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2023-07-06T01:07:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2023-07-06T01:07:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2023-07-06T01:07:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2023-07-06T01:07:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2023-07-06T01:07:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-06T01:07:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-06T01:07:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2023-07-06T01:07:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2023-07-06T01:07:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2023-07-06T01:07:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2023-07-06T01:07:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:07:44.824 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2023-07-06T01:07:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2023-07-06T01:07:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-07-06T01:07:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = "" 2023-07-06T01:07:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2023-07-06T01:07:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2023-07-06T01:07:44.826 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2023-07-06T01:07:44.826 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2023-07-06T01:07:44.826 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2023-07-06T01:07:44.826 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds balancer = 20 2023-07-06T01:07:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2023-07-06T01:07:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2023-07-06T01:07:44.829 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2023-07-06T01:07:44.829 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2023-07-06T01:07:44.829 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-06T01:07:44.829 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2023-07-06T01:07:44.830 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.831 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2023-07-06T01:07:44.831 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2023-07-06T01:07:44.831 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.831 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-06T01:07:44.831 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2023-07-06T01:07:44.831 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.832 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2023-07-06T01:07:44.832 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-06T01:07:44.832 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.832 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2023-07-06T01:07:44.832 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.832 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2023-07-06T01:07:44.833 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.834 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.71,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on skipped message = False 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 2e134b12-52b2-40d1-8145-7c2e3ab16f64 2023-07-06T01:07:44.835 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2023-07-06T01:07:44.836 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.837 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2023-07-06T01:07:44.838 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2023-07-06T01:07:44.839 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2023-07-06T01:07:44.840 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.841 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2023-07-06T01:07:44.842 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2023-07-06T01:07:44.843 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2023-07-06T01:07:44.844 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2023-07-06T01:07:44.844 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2023-07-06T01:07:44.844 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2023-07-06T01:07:44.844 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2023-07-06T01:07:44.844 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.844 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-06T01:07:44.845 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-06T01:07:44.846 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2023-07-06T01:07:44.847 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2023-07-06T01:07:44.847 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2023-07-06T01:07:44.847 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2023-07-06T01:07:44.848 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-06T01:07:44.848 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-06T01:07:44.848 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2023-07-06T01:07:44.848 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2023-07-06T01:07:44.849 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-07-06T01:07:44.849 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = "" 2023-07-06T01:07:44.849 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2023-07-06T01:07:44.850 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2023-07-06T01:07:44.850 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2023-07-06T01:07:44.850 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2023-07-06T01:07:44.850 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2023-07-06T01:07:44.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2023-07-06T01:07:44.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2023-07-06T01:07:44.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2023-07-06T01:07:44.851 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2023-07-06T01:07:44.852 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2023-07-06T01:07:44.852 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2023-07-06T01:07:44.852 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2023-07-06T01:07:44.852 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-07-06T01:07:44.853 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2023-07-06T01:07:44.853 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2023-07-06T01:07:44.853 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2023-07-06T01:07:44.854 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2023-07-06T01:07:44.854 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2023-07-06T01:07:44.854 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2023-07-06T01:07:44.854 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2023-07-06T01:07:44.857 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-06T01:07:44.857 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-06T01:07:44.968 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-06T01:07:44.968 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:44.969 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-06T01:07:45.013 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:45.014 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-06T01:07:45.097 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:07:45.098 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:45.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-06T01:07:45.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T01:07:45.229 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:07:45.229 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:45.314 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:07:45.314 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:45.314 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-06T01:07:45.315 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T01:07:45.412 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:07:45.413 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:45.497 INFO:tasks.ceph:Setting up mon nodes... 2023-07-06T01:07:45.497 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-06T01:07:45.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-06T01:07:45.617 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-06T01:07:45.623 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-06T01:07:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-06T01:07:45.763 INFO:tasks.ceph:Setting up mds nodes... 2023-07-06T01:07:45.764 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-06T01:07:45.883 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-06T01:07:45.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-06T01:07:45.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-06T01:07:46.076 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-06T01:07:46.081 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-06T01:07:46.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-06T01:07:46.271 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-06T01:07:46.276 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-06T01:07:46.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-06T01:07:46.466 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-06T01:07:46.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-06T01:07:46.540 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-06T01:07:46.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-06T01:07:46.635 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-06T01:07:46.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-06T01:07:46.759 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-06T01:07:46.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-06T01:07:46.884 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-06T01:07:46.914 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-06T01:07:47.008 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-06T01:07:47.038 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-06T01:07:47.038 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-06T01:07:47.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-06T01:07:47.107 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T01:07:47.107 INFO:tasks.ceph:role: osd.0 2023-07-06T01:07:47.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:07:47.108 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-06T01:07:47.182 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:07:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:07:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:07:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:07:47.183 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:07:47.183 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:07:47.183 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:07:47.184 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:07:47.184 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:07:47.184 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:07:47.614 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-07-06T01:07:47.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-07-06T01:07:47.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-06T01:07:47.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-06T01:07:47.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-06T01:07:47.963 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T01:07:47.963 INFO:tasks.ceph:role: osd.1 2023-07-06T01:07:47.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:07:47.964 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-06T01:07:48.039 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:07:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:07:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:07:48.039 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:07:48.039 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:07:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:07:48.040 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:07:48.040 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:07:48.040 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:07:48.040 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:07:48.451 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-07-06T01:07:48.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-07-06T01:07:48.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-06T01:07:48.594 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-06T01:07:48.668 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-06T01:07:48.738 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T01:07:48.738 INFO:tasks.ceph:role: osd.2 2023-07-06T01:07:48.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:07:48.738 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-06T01:07:48.814 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:07:48.814 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:07:48.814 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:07:48.814 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:07:48.815 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:07:48.815 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:07:48.815 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:07:48.815 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:07:48.815 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:07:48.815 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:07:49.250 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-07-06T01:07:49.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-07-06T01:07:49.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-06T01:07:49.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-06T01:07:49.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-06T01:07:49.575 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T01:07:49.575 INFO:tasks.ceph:role: osd.3 2023-07-06T01:07:49.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:07:49.575 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-06T01:07:49.649 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:07:49.649 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:07:49.649 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:07:49.649 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:07:49.650 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:07:49.650 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:07:49.650 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:07:49.650 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:07:49.650 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:07:49.650 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:07:50.087 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-07-06T01:07:50.091 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-07-06T01:07:50.091 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-06T01:07:50.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-06T01:07:50.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:50.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:50.849+0000 7f7da4882640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-06T01:07:50.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:50.849+0000 7f7da4882640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-06T01:07:50.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:50.849+0000 7f7da4882640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T01:07:50.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:50.849+0000 7f7da4882640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T01:07:50.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:50.849+0000 7f7da4882640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T01:07:50.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:50.852+0000 7f7da4882640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-06T01:07:53.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-06T01:07:53.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:53.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:53.907+0000 7fb9174c4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-06T01:07:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:53.907+0000 7fb9174c4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-06T01:07:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:53.907+0000 7fb9174c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T01:07:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:53.907+0000 7fb9174c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T01:07:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:53.907+0000 7fb9174c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T01:07:53.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:53.909+0000 7fb9174c4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-06T01:07:56.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-06T01:07:56.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:07:56.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:56.958+0000 7f17a81e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-06T01:07:56.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:56.959+0000 7f17a81e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-06T01:07:56.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:56.959+0000 7f17a81e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T01:07:56.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:56.959+0000 7f17a81e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T01:07:56.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:56.959+0000 7f17a81e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T01:07:56.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:07:56.960+0000 7f17a81e8640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-06T01:07:59.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-06T01:07:59.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:00.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:00.021+0000 7f1791c1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-06T01:08:00.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:00.021+0000 7f1791c1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-06T01:08:00.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:00.021+0000 7f1791c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T01:08:00.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:00.021+0000 7f1791c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T01:08:00.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:00.021+0000 7f1791c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T01:08:00.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:00.023+0000 7f1791c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-06T01:08:02.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-06T01:08:02.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-06T01:08:03.045 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T01:08:03.046 INFO:tasks.ceph:role: osd.4 2023-07-06T01:08:03.046 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:08:03.046 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-06T01:08:03.124 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:08:03.124 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:08:03.124 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:08:03.125 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:08:03.559 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-07-06T01:08:03.563 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-07-06T01:08:03.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-06T01:08:03.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-06T01:08:03.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-06T01:08:03.904 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T01:08:03.904 INFO:tasks.ceph:role: osd.5 2023-07-06T01:08:03.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:08:03.905 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-06T01:08:03.980 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:08:03.981 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:08:03.981 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:08:03.981 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:08:03.981 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:08:03.981 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:08:03.981 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:08:03.982 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:08:03.982 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:08:03.982 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:08:04.397 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-07-06T01:08:04.400 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-07-06T01:08:04.400 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-06T01:08:04.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-06T01:08:04.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-06T01:08:04.688 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T01:08:04.688 INFO:tasks.ceph:role: osd.6 2023-07-06T01:08:04.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:08:04.689 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-06T01:08:04.765 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:08:04.766 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:08:04.766 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:08:04.767 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:08:04.767 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:08:04.767 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:08:04.768 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:08:04.768 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:08:04.768 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:08:04.768 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:08:05.210 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-07-06T01:08:05.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-07-06T01:08:05.214 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-06T01:08:05.394 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-06T01:08:05.470 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-06T01:08:05.538 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T01:08:05.538 INFO:tasks.ceph:role: osd.7 2023-07-06T01:08:05.539 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:08:05.539 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-06T01:08:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T01:08:05.616 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T01:08:05.616 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T01:08:05.616 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T01:08:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T01:08:05.616 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-07-06T01:08:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T01:08:05.617 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T01:08:05.617 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T01:08:05.617 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T01:08:06.051 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-07-06T01:08:06.055 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-07-06T01:08:06.055 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-06T01:08:06.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-06T01:08:06.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:06.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:06.380+0000 7faf42098640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-06T01:08:06.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:06.380+0000 7faf42098640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-06T01:08:06.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:06.380+0000 7faf42098640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T01:08:06.384 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:06.380+0000 7faf42098640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T01:08:06.384 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:06.380+0000 7faf42098640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T01:08:06.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:06.382+0000 7faf42098640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-06T01:08:09.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-06T01:08:09.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:09.439 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:09.437+0000 7fdfdb1fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-06T01:08:09.440 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:09.437+0000 7fdfdb1fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-06T01:08:09.440 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:09.437+0000 7fdfdb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T01:08:09.440 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:09.437+0000 7fdfdb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T01:08:09.440 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:09.437+0000 7fdfdb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T01:08:09.441 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:09.439+0000 7fdfdb1fd640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-06T01:08:12.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:08:12.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:08:12.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-06T01:08:12.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:12.500 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:12.497+0000 7f6a8bbc1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-06T01:08:12.500 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:12.497+0000 7f6a8bbc1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-06T01:08:12.500 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:12.497+0000 7f6a8bbc1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T01:08:12.500 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:12.497+0000 7f6a8bbc1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T01:08:12.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:12.497+0000 7f6a8bbc1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T01:08:12.501 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:12.499+0000 7f6a8bbc1640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-06T01:08:15.382 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-06T01:08:15.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:15.556 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:15.553+0000 7f379f60c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-06T01:08:15.556 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:15.554+0000 7f379f60c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-06T01:08:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:15.554+0000 7f379f60c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T01:08:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:15.554+0000 7f379f60c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T01:08:15.557 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:15.554+0000 7f379f60c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T01:08:15.558 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:15.555+0000 7f379f60c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-06T01:08:18.445 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-06T01:08:18.517 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-06T01:08:18.517 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:18.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-06T01:08:18.592 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:18.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-06T01:08:18.662 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:18.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-06T01:08:18.770 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:18.771 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-06T01:08:18.878 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:18.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-06T01:08:18.985 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:18.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-06T01:08:19.092 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:19.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-06T01:08:19.200 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-06T01:08:19.275 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-06T01:08:19.345 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.345 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-06T01:08:19.454 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-06T01:08:19.562 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-06T01:08:19.670 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.670 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-06T01:08:19.777 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:19.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-06T01:08:19.884 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:19.885 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-06T01:08:19.930 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:19.931 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-06T01:08:20.015 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:20.015 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-06T01:08:20.061 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:20.062 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-06T01:08:20.145 INFO:tasks.ceph:Adding keys to all mons... 2023-07-06T01:08:20.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-06T01:08:20.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-06T01:08:20.211 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2023-07-06T01:08:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDhE6ZkqSHBJBAAalKKakpiGT35gIEVwLwbzQ== 2023-07-06T01:08:20.211 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2023-07-06T01:08:20.211 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDhE6ZkweSeNBAAbB1tK2pCmw4pXUN8iQlxJA== 2023-07-06T01:08:20.211 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2023-07-06T01:08:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkQKN/BBAA3o7Q8u+yJ+bEt4prnsXqUg== 2023-07-06T01:08:20.212 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2023-07-06T01:08:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDmE6Zkk7WxMhAA88Tetkf95whY37AgIrC/Hg== 2023-07-06T01:08:20.212 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2023-07-06T01:08:20.212 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDpE6ZkuDAaNhAAItdBDYa9zBZr/fQKrCY1Pg== 2023-07-06T01:08:20.212 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDsE6ZkSgYrORAALgAPdMxwqjAaN0QHpWLk9w== 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDwE6Zkc7NHARAAyFbEI24Vi6Ga2Ub7BIPFOg== 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDhE6ZkD98MLRAA4B5otR+ybcrSF23Z0XR1Bw== 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2023-07-06T01:08:20.213 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkFtkbEBAANoTePxPvCD/oYp17q4N0Cg== 2023-07-06T01:08:20.214 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2023-07-06T01:08:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkAY65GxAAheP2as13roTmaYT7boNQyA== 2023-07-06T01:08:20.214 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2023-07-06T01:08:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD2E6ZkNm29FhAAStt4urz8jqHbSMoERSEnmw== 2023-07-06T01:08:20.214 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2023-07-06T01:08:20.214 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD5E6ZkttchGhAAQ4/V8xvGztIU7bMVsIwnqg== 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD8E6Zk6Ie5HRAASeYosHk9ICshB/OpQ3En4A== 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQD/E6Zkx/YUIRAAwioJsTbk5U8UqUUArKFcjQ== 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkSzPRJRAAmgb9CVEUw/PXwFq+mKxoFg== 2023-07-06T01:08:20.215 INFO:teuthology.orchestra.run.smithi071.stdout:[client.2] 2023-07-06T01:08:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkrU86LRAA2uZKu0vNeItQHde5ZLasuA== 2023-07-06T01:08:20.216 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2023-07-06T01:08:20.216 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkkumoNBAA0UkxAJL2wIveN2aW4qZ15Q== 2023-07-06T01:08:20.216 INFO:teuthology.orchestra.run.smithi071.stdout:[client.3] 2023-07-06T01:08:20.217 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDjE6ZkZ3RzABAARBuSN5hGsUNT4xYD/w1CXg== 2023-07-06T01:08:20.250 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2023-07-06T01:08:20.250 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhE6ZkqSHBJBAAalKKakpiGT35gIEVwLwbzQ== 2023-07-06T01:08:20.250 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhE6ZkweSeNBAAbB1tK2pCmw4pXUN8iQlxJA== 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDiE6ZkQKN/BBAA3o7Q8u+yJ+bEt4prnsXqUg== 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDmE6Zkk7WxMhAA88Tetkf95whY37AgIrC/Hg== 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDpE6ZkuDAaNhAAItdBDYa9zBZr/fQKrCY1Pg== 2023-07-06T01:08:20.251 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDsE6ZkSgYrORAALgAPdMxwqjAaN0QHpWLk9w== 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDwE6Zkc7NHARAAyFbEI24Vi6Ga2Ub7BIPFOg== 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhE6ZkD98MLRAA4B5otR+ybcrSF23Z0XR1Bw== 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2023-07-06T01:08:20.252 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDiE6ZkFtkbEBAANoTePxPvCD/oYp17q4N0Cg== 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDiE6ZkAY65GxAAheP2as13roTmaYT7boNQyA== 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD2E6ZkNm29FhAAStt4urz8jqHbSMoERSEnmw== 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD5E6ZkttchGhAAQ4/V8xvGztIU7bMVsIwnqg== 2023-07-06T01:08:20.253 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2023-07-06T01:08:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD8E6Zk6Ie5HRAASeYosHk9ICshB/OpQ3En4A== 2023-07-06T01:08:20.254 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2023-07-06T01:08:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQD/E6Zkx/YUIRAAwioJsTbk5U8UqUUArKFcjQ== 2023-07-06T01:08:20.254 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2023-07-06T01:08:20.254 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDiE6ZkSzPRJRAAmgb9CVEUw/PXwFq+mKxoFg== 2023-07-06T01:08:20.254 INFO:teuthology.orchestra.run.smithi194.stdout:[client.2] 2023-07-06T01:08:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDiE6ZkrU86LRAA2uZKu0vNeItQHde5ZLasuA== 2023-07-06T01:08:20.255 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2023-07-06T01:08:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDiE6ZkkumoNBAA0UkxAJL2wIveN2aW4qZ15Q== 2023-07-06T01:08:20.255 INFO:teuthology.orchestra.run.smithi194.stdout:[client.3] 2023-07-06T01:08:20.255 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDjE6ZkZ3RzABAARBuSN5hGsUNT4xYD/w1CXg== 2023-07-06T01:08:20.256 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T01:08:20.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T01:08:20.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:20.408 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:20.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:20.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:20.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.742 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.858 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:20.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T01:08:21.082 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T01:08:21.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:21.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:21.307 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:21.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T01:08:21.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.427 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.652 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.771 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T01:08:21.879 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:21.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:21.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:22.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:22.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:22.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:22.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:22.233 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T01:08:22.344 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-06T01:08:22.345 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-06T01:08:22.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T01:08:22.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-06T01:08:22.606 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-06T01:08:22.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T01:08:22.797 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-06T01:08:22.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-06T01:08:22.933 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T01:08:23.054 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-06T01:08:23.122 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:23.127 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-06T01:08:23.170 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-06T01:08:23.170 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-06T01:08:23.171 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-06T01:08:23.212 INFO:tasks.ceph.mon.a:Started 2023-07-06T01:08:23.213 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-06T01:08:23.213 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-06T01:08:23.217 INFO:tasks.ceph.mon.b:Started 2023-07-06T01:08:23.218 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-06T01:08:23.218 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-06T01:08:23.222 INFO:tasks.ceph.mon.c:Started 2023-07-06T01:08:23.222 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-06T01:08:23.222 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-06T01:08:23.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-06T01:08:23.227 INFO:tasks.ceph.mgr.y:Started 2023-07-06T01:08:23.227 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-06T01:08:23.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-06T01:08:23.231 INFO:tasks.ceph.mgr.x:Started 2023-07-06T01:08:23.232 INFO:tasks.ceph:Setting crush tunables to default 2023-07-06T01:08:23.232 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2023-07-06T01:08:23.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.426+0000 7fa1db5ff700 1 Processor -- start 2023-07-06T01:08:23.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.426+0000 7fa1db5ff700 1 -- start start 2023-07-06T01:08:23.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.427+0000 7fa1db5ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 0x7fa1d40cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.427+0000 7fa1db5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1d40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.427+0000 7fa1db5ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d40cf920 con 0x7fa1d40d0220 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.427+0000 7fa1db5ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40d06c0 con 0x7fa1d415c790 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.427+0000 7fa1db5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40ca500 con 0x7fa1d406a670 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1d40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1d40cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:47052/0 (socket says 172.21.15.71:47052) 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 learned_addr learned my addr 172.21.15.71:0/166643690 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d939b700 1 --2- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 0x7fa1d40cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 msgr2=0x7fa1d40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 msgr2=0x7fa1d40cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1d40cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1d40cd6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d939b700 1 -- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 msgr2=0x7fa1d40cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d939b700 1 -- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 msgr2=0x7fa1d40cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d939b700 1 --2- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 0x7fa1d40cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-06T01:08:23.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.428+0000 7fa1d939b700 1 --2- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 0x7fa1d40cf2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T01:08:23.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.620+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111268459 0 0) 0x7fa1d40cf920 con 0x7fa1d40d0220 2023-07-06T01:08:23.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.620+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c00035b0 con 0x7fa1d40d0220 2023-07-06T01:08:23.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2270518721 0 0) 0x7fa1c00035b0 con 0x7fa1d40d0220 2023-07-06T01:08:23.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 msgr2=0x7fa1d40cd6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T01:08:23.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1d40cd6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 msgr2=0x7fa1d40cf2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T01:08:23.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 --2- 172.21.15.71:0/166643690 >> v2:172.21.15.194:3300/0 conn(0x7fa1d415c790 0x7fa1d40cf2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4070a50 con 0x7fa1d40d0220 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fa1c4001670 con 0x7fa1d40d0220 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 >> v1:172.21.15.194:6789/0 conn(0x7fa1d40d0220 legacy=0x7fa1d4069f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c0003a00 0x7fa1c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1c0004850 0x7fa1c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1c00052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40d06c0 con 0x7fa1c0004850 2023-07-06T01:08:23.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40ca500 con 0x7fa1c0003a00 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c000bc20 con 0x7fa1d406a670 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.628+0000 7fa1d939b700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c0003a00 0x7fa1c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1c00052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d8b9a700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1c0004850 0x7fa1c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c0003a00 msgr2=0x7fa1c0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c0003a00 0x7fa1c0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1c0004850 msgr2=0x7fa1c0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1c0004850 0x7fa1c0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c00035b0 con 0x7fa1d406a670 2023-07-06T01:08:23.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.629+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1c00052b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009cc0 tx=0x7fa1c0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3112a47eb990fdb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.630+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc017070 con 0x7fa1d406a670 2023-07-06T01:08:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.630+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc00f040 con 0x7fa1d406a670 2023-07-06T01:08:23.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1cbfff700 1 -- 172.21.15.71:0/166643690 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc003c60 con 0x7fa1d406a670 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1db5ff700 1 -- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 msgr2=0x7fa1c00052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1db5ff700 1 --2- 172.21.15.71:0/166643690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d406a670 0x7fa1c00052b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009cc0 tx=0x7fa1c0005880 comp rx=0 tx=0).stop 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1d9b9c700 1 -- 172.21.15.71:0/166643690 reap_dead start 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1db5ff700 1 -- 172.21.15.71:0/166643690 shutdown_connections 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1db5ff700 1 -- 172.21.15.71:0/166643690 >> 172.21.15.71:0/166643690 conn(0x7fa1d40b22f0 msgr2=0x7fa1d40cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1db5ff700 1 -- 172.21.15.71:0/166643690 shutdown_connections 2023-07-06T01:08:23.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.631+0000 7fa1db5ff700 1 -- 172.21.15.71:0/166643690 wait complete. 2023-07-06T01:08:23.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.633+0000 7fa1db5ff700 1 Processor -- start 2023-07-06T01:08:23.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.633+0000 7fa1db5ff700 1 -- start start 2023-07-06T01:08:23.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1db5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1d406a670 0x7fa1d40c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1db5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 0x7fa1d41f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1db5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d41f5a00 0x7fa1d41f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1db5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d415ff60 con 0x7fa1d415d4c0 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1db5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40c7cc0 con 0x7fa1d406a670 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1db5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d415d930 con 0x7fa1d41f5a00 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1d8b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 0x7fa1d41f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.634+0000 7fa1d8b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 0x7fa1d41f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55094/0 (socket says 172.21.15.71:55094) 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 -- 172.21.15.71:0/3826796914 learned_addr learned my addr 172.21.15.71:0/3826796914 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d9b9c700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d41f5a00 0x7fa1d41f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d939b700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1d406a670 0x7fa1d40c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 -- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d41f5a00 msgr2=0x7fa1d41f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d41f5a00 0x7fa1d41f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 -- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1d406a670 msgr2=0x7fa1d40c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1d406a670 0x7fa1d40c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 -- 172.21.15.71:0/3826796914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40c7700 con 0x7fa1d415d4c0 2023-07-06T01:08:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1d8b9a700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 0x7fa1d41f54c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4000fb0 tx=0x7fa1c400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40052e0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c4005440 con 0x7fa1d415d4c0 2023-07-06T01:08:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d40c79e0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40038c0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.635+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d40b3af0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.636+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa1c4003d20 con 0x7fa1d415d4c0 2023-07-06T01:08:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.636+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa1c40147c0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.636+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d41600a0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.639+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa1c4023060 con 0x7fa1d415d4c0 2023-07-06T01:08:23.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.714+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa1d40008d0 con 0x7fa1d415d4c0 2023-07-06T01:08:23.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.717+0000 7fa1c9ffb700 1 -- 172.21.15.71:0/3826796914 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa1c4019070 con 0x7fa1d415d4c0 2023-07-06T01:08:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 msgr2=0x7fa1d41f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:23.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 0x7fa1d41f54c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4000fb0 tx=0x7fa1c400eaf0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 shutdown_connections 2023-07-06T01:08:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1d41f5a00 0x7fa1d41f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1d406a670 0x7fa1d40c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 --2- 172.21.15.71:0/3826796914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d415d4c0 0x7fa1d41f54c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 >> 172.21.15.71:0/3826796914 conn(0x7fa1d40b22f0 msgr2=0x7fa1d415bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:23.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 shutdown_connections 2023-07-06T01:08:23.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:23.718+0000 7fa1db5ff700 1 -- 172.21.15.71:0/3826796914 wait complete. 2023-07-06T01:08:23.722 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2023-07-06T01:08:23.738 INFO:tasks.ceph:check_enable_crimson: False 2023-07-06T01:08:23.738 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-06T01:08:23.738 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:23.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-06T01:08:23.783 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:23.782+0000 7f56128e2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T01:08:23.806 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:23.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-06T01:08:23.913 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:23.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-06T01:08:23.999 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:23.998+0000 7f56128e2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T01:08:24.023 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:08:24.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-06T01:08:24.132 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:24.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-06T01:08:24.141 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:24.138+0000 7f06576f7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T01:08:24.200 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:24.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-06T01:08:24.308 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:24.309 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-06T01:08:24.353 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:24.351+0000 7f06576f7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T01:08:24.416 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:08:24.416 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-06T01:08:24.443 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:24.441+0000 7f56128e2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T01:08:24.511 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 53f4df9c-8198-4bce-b372-8c7b7e613b15 0 2023-07-06T01:08:24.746 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.744+0000 7f4ef39ff700 1 Processor -- start 2023-07-06T01:08:24.747 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.745+0000 7f4ef39ff700 1 -- start start 2023-07-06T01:08:24.747 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef39ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4eec159fc0 0x7f4eec0d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:24.748 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef39ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec0cf0a0 0x7f4eec15d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:24.748 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef39ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec0cf540 con 0x7f4eec15a390 2023-07-06T01:08:24.748 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef39ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0cf820 con 0x7f4eec159fc0 2023-07-06T01:08:24.748 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef39ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0cdcb0 con 0x7f4eec0cf0a0 2023-07-06T01:08:24.749 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef179b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4eec159fc0 0x7f4eec0d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:24.749 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef0f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec0cf0a0 0x7f4eec15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:24.749 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef179b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4eec159fc0 0x7f4eec0d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54258/0 (socket says 172.21.15.194:54258) 2023-07-06T01:08:24.749 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef179b700 1 -- 172.21.15.194:0/3752832674 learned_addr learned my addr 172.21.15.194:0/3752832674 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:24.750 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef179b700 1 -- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec0cf0a0 msgr2=0x7f4eec15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:24.750 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef179b700 1 --2- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec0cf0a0 0x7f4eec15d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.746+0000 7f4ef179b700 1 -- 172.21.15.194:0/3752832674 >> v1:172.21.15.71:6789/0 conn(0x7f4eec15a390 legacy=0x7f4eec0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.747+0000 7f4ef179b700 1 -- 172.21.15.194:0/3752832674 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0cd660 con 0x7f4eec159fc0 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.747+0000 7f4ef0f9a700 1 --2- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec0cf0a0 0x7f4eec15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.747+0000 7f4ef179b700 1 --2- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec159fc0 0x7f4eec0d29b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098f0 tx=0x7f4ee8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dccc1c9a45db5a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.747+0000 7f4ee3fff700 1 -- 172.21.15.194:0/3752832674 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8004230 con 0x7f4eec159fc0 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.747+0000 7f4ee3fff700 1 -- 172.21.15.194:0/3752832674 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee8004390 con 0x7f4eec159fc0 2023-07-06T01:08:24.751 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.747+0000 7f4ee3fff700 1 -- 172.21.15.194:0/3752832674 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80036a0 con 0x7f4eec159fc0 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec159fc0 msgr2=0x7f4eec0d29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec159fc0 0x7f4eec0d29b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098f0 tx=0x7f4ee8009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3752832674 shutdown_connections 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec159fc0 0x7f4eec0d29b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3752832674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec0cf0a0 0x7f4eec15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3752832674 >> 172.21.15.194:0/3752832674 conn(0x7f4eec06c1e0 msgr2=0x7f4eec06c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:24.752 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3752832674 shutdown_connections 2023-07-06T01:08:24.753 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.748+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3752832674 wait complete. 2023-07-06T01:08:24.754 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.750+0000 7f4ef39ff700 1 Processor -- start 2023-07-06T01:08:24.754 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.750+0000 7f4ef39ff700 1 -- start start 2023-07-06T01:08:24.755 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef39ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec0cf0a0 0x7f4eec14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:24.755 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef39ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 0x7f4eec0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:24.755 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef39ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eec15a390 0x7f4eec0b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:24.755 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef39ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0cbca0 con 0x7f4eec15a390 2023-07-06T01:08:24.755 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef39ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0caee0 con 0x7f4eec0cf0a0 2023-07-06T01:08:24.755 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef39ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0cac00 con 0x7f4eec159fc0 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef0f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 0x7f4eec0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef0f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 0x7f4eec0c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:44632/0 (socket says 172.21.15.194:44632) 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef0f9a700 1 -- 172.21.15.194:0/3108994255 learned_addr learned my addr 172.21.15.194:0/3108994255 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef179b700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec0cf0a0 0x7f4eec14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.751+0000 7f4ef1f9c700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eec15a390 0x7f4eec0b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef0f9a700 1 -- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec0cf0a0 msgr2=0x7f4eec14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:24.756 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef0f9a700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec0cf0a0 0x7f4eec14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef0f9a700 1 -- 172.21.15.194:0/3108994255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eec15a390 msgr2=0x7f4eec0b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef0f9a700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eec15a390 0x7f4eec0b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef0f9a700 1 -- 172.21.15.194:0/3108994255 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0094a0 con 0x7f4eec159fc0 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef179b700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec0cf0a0 0x7f4eec14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef0f9a700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 0x7f4eec0c69a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00ebe0 tx=0x7f4edc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0097a0 con 0x7f4eec159fc0 2023-07-06T01:08:24.757 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc00c850 con 0x7f4eec159fc0 2023-07-06T01:08:24.758 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00cbe0 con 0x7f4eec159fc0 2023-07-06T01:08:24.758 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8009550 con 0x7f4eec159fc0 2023-07-06T01:08:24.758 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec0cb930 con 0x7f4eec159fc0 2023-07-06T01:08:24.758 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.752+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4edc005d20 con 0x7f4eec159fc0 2023-07-06T01:08:24.758 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.753+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4edc003bb0 con 0x7f4eec159fc0 2023-07-06T01:08:24.759 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.753+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec068190 con 0x7f4eec159fc0 2023-07-06T01:08:24.759 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.756+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4edc021060 con 0x7f4eec159fc0 2023-07-06T01:08:24.796 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:24.793+0000 7f06576f7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T01:08:24.845 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.843+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "53f4df9c-8198-4bce-b372-8c7b7e613b15", "id": 0} v 0) v1 -- 0x7f4eec0008d0 con 0x7f4eec159fc0 2023-07-06T01:08:24.852 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.851+0000 7f4ee1ffb700 1 -- 172.21.15.194:0/3108994255 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53f4df9c-8198-4bce-b372-8c7b7e613b15", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4edc017070 con 0x7f4eec159fc0 2023-07-06T01:08:24.853 INFO:teuthology.orchestra.run.smithi194.stdout:0 2023-07-06T01:08:24.854 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 msgr2=0x7f4eec0c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:24.854 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 0x7f4eec0c69a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00ebe0 tx=0x7f4edc00eef0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.854 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 shutdown_connections 2023-07-06T01:08:24.855 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eec15a390 0x7f4eec0b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.855 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eec0cf0a0 0x7f4eec14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.855 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 --2- 172.21.15.194:0/3108994255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4eec159fc0 0x7f4eec0c69a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:24.855 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.852+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 >> 172.21.15.194:0/3108994255 conn(0x7f4eec06c1e0 msgr2=0x7f4eec0d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:24.855 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.853+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 shutdown_connections 2023-07-06T01:08:24.855 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:24.853+0000 7f4ef39ff700 1 -- 172.21.15.194:0/3108994255 wait complete. 2023-07-06T01:08:24.871 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new fb64ec9d-673e-4daa-a510-42432ecb7b89 1 2023-07-06T01:08:25.062 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.060+0000 7f6a421ff700 1 Processor -- start 2023-07-06T01:08:25.062 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.061+0000 7f6a421ff700 1 -- start start 2023-07-06T01:08:25.064 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a421ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a3c0b5c90 0x7f6a3c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.064 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a421ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.064 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a421ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0cf780 con 0x7f6a3c15fca0 2023-07-06T01:08:25.064 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a421ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cd490 con 0x7f6a3c0b5c90 2023-07-06T01:08:25.065 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a421ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cd770 con 0x7f6a3c0b6110 2023-07-06T01:08:25.065 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a3bfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.065 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a3bfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38792/0 (socket says 172.21.15.194:38792) 2023-07-06T01:08:25.065 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a3bfff700 1 -- 172.21.15.194:0/367365237 learned_addr learned my addr 172.21.15.194:0/367365237 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:25.065 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.062+0000 7f6a33fff700 1 --2- 172.21.15.194:0/367365237 >> v2:172.21.15.194:3300/0 conn(0x7f6a3c0b5c90 0x7f6a3c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.066 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3bfff700 1 -- 172.21.15.194:0/367365237 >> v2:172.21.15.194:3300/0 conn(0x7f6a3c0b5c90 msgr2=0x7f6a3c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:25.066 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3bfff700 1 --2- 172.21.15.194:0/367365237 >> v2:172.21.15.194:3300/0 conn(0x7f6a3c0b5c90 0x7f6a3c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3bfff700 1 -- 172.21.15.194:0/367365237 >> v1:172.21.15.194:6789/0 conn(0x7f6a3c15fca0 legacy=0x7f6a3c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3bfff700 1 -- 172.21.15.194:0/367365237 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0cda50 con 0x7f6a3c0b6110 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3bfff700 1 --2- 172.21.15.194:0/367365237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0d3280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009e50 tx=0x7f6a3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a88a3d4175575cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3affd700 1 -- 172.21.15.194:0/367365237 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400e070 con 0x7f6a3c0b6110 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3affd700 1 -- 172.21.15.194:0/367365237 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400b910 con 0x7f6a3c0b6110 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.063+0000 7f6a3affd700 1 -- 172.21.15.194:0/367365237 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400bcc0 con 0x7f6a3c0b6110 2023-07-06T01:08:25.067 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 -- 172.21.15.194:0/367365237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 msgr2=0x7f6a3c0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 --2- 172.21.15.194:0/367365237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0d3280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009e50 tx=0x7f6a3400b330 comp rx=0 tx=0).stop 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 -- 172.21.15.194:0/367365237 shutdown_connections 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 --2- 172.21.15.194:0/367365237 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0d3280 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 --2- 172.21.15.194:0/367365237 >> v2:172.21.15.194:3300/0 conn(0x7f6a3c0b5c90 0x7f6a3c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 -- 172.21.15.194:0/367365237 >> 172.21.15.194:0/367365237 conn(0x7f6a3c06c150 msgr2=0x7f6a3c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 -- 172.21.15.194:0/367365237 shutdown_connections 2023-07-06T01:08:25.068 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.064+0000 7f6a421ff700 1 -- 172.21.15.194:0/367365237 wait complete. 2023-07-06T01:08:25.070 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.066+0000 7f6a421ff700 1 Processor -- start 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.066+0000 7f6a421ff700 1 -- start start 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a421ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a3c0b5c90 0x7f6a3c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a421ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a421ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a3c15fca0 0x7f6a3c1e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a421ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c9880 con 0x7f6a3c0b5c90 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a421ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c75e0 con 0x7f6a3c15fca0 2023-07-06T01:08:25.071 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a421ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c9020 con 0x7f6a3c0b6110 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a33fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.067+0000 7f6a3bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a3c15fca0 0x7f6a3c1e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38800/0 (socket says 172.21.15.194:38800) 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 -- 172.21.15.194:0/3625307239 learned_addr learned my addr 172.21.15.194:0/3625307239 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a3b7fe700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a3c0b5c90 0x7f6a3c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 -- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a3c15fca0 msgr2=0x7f6a3c1e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a3c15fca0 0x7f6a3c1e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.072 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 -- 172.21.15.194:0/3625307239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a3c0b5c90 msgr2=0x7f6a3c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a3c0b5c90 0x7f6a3c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 -- 172.21.15.194:0/3625307239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009b30 con 0x7f6a3c0b6110 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a33fff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0b3860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400e9b0 tx=0x7f6a2400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24009710 con 0x7f6a3c0b6110 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2400ee50 con 0x7f6a3c0b6110 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.068+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c0c92c0 con 0x7f6a3c0b6110 2023-07-06T01:08:25.073 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.069+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400ca50 con 0x7f6a3c0b6110 2023-07-06T01:08:25.074 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.069+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c0b3da0 con 0x7f6a3c0b6110 2023-07-06T01:08:25.074 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.069+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a24005a20 con 0x7f6a3c0b6110 2023-07-06T01:08:25.074 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.069+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6a24013820 con 0x7f6a3c0b6110 2023-07-06T01:08:25.074 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.070+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c0b4020 con 0x7f6a3c0b6110 2023-07-06T01:08:25.075 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.072+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6a24021060 con 0x7f6a3c0b6110 2023-07-06T01:08:25.075 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:25.074+0000 7f56128e2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-06T01:08:25.159 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.157+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fb64ec9d-673e-4daa-a510-42432ecb7b89", "id": 1} v 0) v1 -- 0x7f6a3c0c7310 con 0x7f6a3c0b6110 2023-07-06T01:08:25.167 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.165+0000 7f6a38ff9700 1 -- 172.21.15.194:0/3625307239 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb64ec9d-673e-4daa-a510-42432ecb7b89", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a24017070 con 0x7f6a3c0b6110 2023-07-06T01:08:25.167 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-07-06T01:08:25.168 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 msgr2=0x7f6a3c0b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.168 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0b3860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400e9b0 tx=0x7f6a2400ecc0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.168 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 shutdown_connections 2023-07-06T01:08:25.169 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a3c15fca0 0x7f6a3c1e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.169 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a3c0b5c90 0x7f6a3c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.169 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 --2- 172.21.15.194:0/3625307239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a3c0b6110 0x7f6a3c0b3860 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.169 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.166+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 >> 172.21.15.194:0/3625307239 conn(0x7f6a3c06c150 msgr2=0x7f6a3c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:25.169 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.167+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 shutdown_connections 2023-07-06T01:08:25.169 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.167+0000 7f6a421ff700 1 -- 172.21.15.194:0/3625307239 wait complete. 2023-07-06T01:08:25.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 9f221492-7c03-48aa-bb9e-36ee71725cc1 2 2023-07-06T01:08:25.321 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:25.319+0000 7f56128e2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-06T01:08:25.378 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.376+0000 7f20cb1ff700 1 Processor -- start 2023-07-06T01:08:25.379 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.377+0000 7f20cb1ff700 1 -- start start 2023-07-06T01:08:25.381 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20cb1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f20c40b5c90 0x7f20c40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.381 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20cb1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40cf780 con 0x7f20c415fca0 2023-07-06T01:08:25.381 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20cb1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40cd490 con 0x7f20c40b6110 2023-07-06T01:08:25.381 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20cb1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c40cd770 con 0x7f20c40b5c90 2023-07-06T01:08:25.381 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20c979c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f20c40b6110 0x7f20c40cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33386/0 (socket says 172.21.15.194:33386) 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20c979c700 1 -- 172.21.15.194:0/1702668749 learned_addr learned my addr 172.21.15.194:0/1702668749 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20c3fff700 1 --2- 172.21.15.194:0/1702668749 >> v2:172.21.15.71:3300/0 conn(0x7f20c40b5c90 0x7f20c40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.378+0000 7f20c37fe700 1 -- 172.21.15.194:0/1702668749 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834109886 0 0) 0x7f20c40cd490 con 0x7f20c40b6110 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c37fe700 1 -- 172.21.15.194:0/1702668749 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b40035b0 con 0x7f20c40b6110 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c3fff700 1 -- 172.21.15.194:0/1702668749 >> v1:172.21.15.194:6789/0 conn(0x7f20c40b6110 legacy=0x7f20c40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c3fff700 1 -- 172.21.15.194:0/1702668749 >> v1:172.21.15.71:6789/0 conn(0x7f20c415fca0 legacy=0x7f20c40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c37fe700 1 -- 172.21.15.194:0/1702668749 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328067698 0 0) 0x7f20c40cf780 con 0x7f20c415fca0 2023-07-06T01:08:25.382 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c3fff700 1 -- 172.21.15.194:0/1702668749 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40cda50 con 0x7f20c40b5c90 2023-07-06T01:08:25.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c3fff700 1 --2- 172.21.15.194:0/1702668749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c40b5c90 0x7f20c40d2d40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009840 tx=0x7f20b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56ff6661d7728f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:25.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c37fe700 1 -- 172.21.15.194:0/1702668749 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0011830 con 0x7f20c40b5c90 2023-07-06T01:08:25.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c37fe700 1 -- 172.21.15.194:0/1702668749 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b0011990 con 0x7f20c40b5c90 2023-07-06T01:08:25.383 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.379+0000 7f20c37fe700 1 -- 172.21.15.194:0/1702668749 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0011d20 con 0x7f20c40b5c90 2023-07-06T01:08:25.384 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:25.379+0000 7f06576f7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-06T01:08:25.384 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 -- 172.21.15.194:0/1702668749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c40b5c90 msgr2=0x7f20c40d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 --2- 172.21.15.194:0/1702668749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c40b5c90 0x7f20c40d2d40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009840 tx=0x7f20b0009b50 comp rx=0 tx=0).stop 2023-07-06T01:08:25.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 -- 172.21.15.194:0/1702668749 shutdown_connections 2023-07-06T01:08:25.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 --2- 172.21.15.194:0/1702668749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c40b5c90 0x7f20c40d2d40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 -- 172.21.15.194:0/1702668749 >> 172.21.15.194:0/1702668749 conn(0x7f20c406c150 msgr2=0x7f20c406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:25.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 -- 172.21.15.194:0/1702668749 shutdown_connections 2023-07-06T01:08:25.385 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.380+0000 7f20cb1ff700 1 -- 172.21.15.194:0/1702668749 wait complete. 2023-07-06T01:08:25.386 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.382+0000 7f20cb1ff700 1 Processor -- start 2023-07-06T01:08:25.386 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.383+0000 7f20cb1ff700 1 -- start start 2023-07-06T01:08:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20cb1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 0x7f20c40cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20cb1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b6110 0x7f20c414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20cb1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c415fca0 0x7f20c41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20cb1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40c9f10 con 0x7f20c415fca0 2023-07-06T01:08:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20cb1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40ca120 con 0x7f20c40b5c90 2023-07-06T01:08:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20cb1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40ca400 con 0x7f20c40b6110 2023-07-06T01:08:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20c8f9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 0x7f20c40cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20c3fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b6110 0x7f20c414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20c8f9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 0x7f20c40cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54592/0 (socket says 172.21.15.194:54592) 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20c8f9b700 1 -- 172.21.15.194:0/4035360712 learned_addr learned my addr 172.21.15.194:0/4035360712 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.384+0000 7f20c979c700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c415fca0 0x7f20c41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c8f9b700 1 -- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b6110 msgr2=0x7f20c414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c8f9b700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b6110 0x7f20c414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.389 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c8f9b700 1 -- 172.21.15.194:0/4035360712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c415fca0 msgr2=0x7f20c41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.390 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c8f9b700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c415fca0 0x7f20c41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.390 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c8f9b700 1 -- 172.21.15.194:0/4035360712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00094a0 con 0x7f20c40b5c90 2023-07-06T01:08:25.390 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c3fff700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b6110 0x7f20c414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:25.390 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c8f9b700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 0x7f20c40cb1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f20b800c550 tx=0x7f20b800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:25.390 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80054e0 con 0x7f20c40b5c90 2023-07-06T01:08:25.390 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8003680 con 0x7f20c40b5c90 2023-07-06T01:08:25.391 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8003a30 con 0x7f20c40b5c90 2023-07-06T01:08:25.391 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c40ca6e0 con 0x7f20c40b5c90 2023-07-06T01:08:25.391 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.385+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c40caca0 con 0x7f20c40b5c90 2023-07-06T01:08:25.391 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.386+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f20b801c440 con 0x7f20c40b5c90 2023-07-06T01:08:25.391 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.386+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f20b801cb10 con 0x7f20c40b5c90 2023-07-06T01:08:25.392 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.386+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c40008d0 con 0x7f20c40b5c90 2023-07-06T01:08:25.392 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.389+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f20b8017070 con 0x7f20c40b5c90 2023-07-06T01:08:25.477 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.475+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f221492-7c03-48aa-bb9e-36ee71725cc1", "id": 2} v 0) v1 -- 0x7f20c40b2b10 con 0x7f20c40b5c90 2023-07-06T01:08:25.484 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.483+0000 7f20c17fa700 1 -- 172.21.15.194:0/4035360712 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f221492-7c03-48aa-bb9e-36ee71725cc1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20b801c6f0 con 0x7f20c40b5c90 2023-07-06T01:08:25.485 INFO:teuthology.orchestra.run.smithi194.stdout:2 2023-07-06T01:08:25.485 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 msgr2=0x7f20c40cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.486 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 0x7f20c40cb1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f20b800c550 tx=0x7f20b800c860 comp rx=0 tx=0).stop 2023-07-06T01:08:25.486 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 shutdown_connections 2023-07-06T01:08:25.486 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c415fca0 0x7f20c41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.486 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20c40b5c90 0x7f20c40cb1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.486 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 --2- 172.21.15.194:0/4035360712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b6110 0x7f20c414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.486 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 >> 172.21.15.194:0/4035360712 conn(0x7f20c406c150 msgr2=0x7f20c4160070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:25.487 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 shutdown_connections 2023-07-06T01:08:25.487 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.484+0000 7f20cb1ff700 1 -- 172.21.15.194:0/4035360712 wait complete. 2023-07-06T01:08:25.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new eafdad02-28ed-4625-a6c8-28434bd7494d 3 2023-07-06T01:08:25.615 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:25.613+0000 7f06576f7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-06T01:08:25.696 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.693+0000 7f053bdff700 1 Processor -- start 2023-07-06T01:08:25.696 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.693+0000 7f053bdff700 1 -- start start 2023-07-06T01:08:25.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053bdff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 0x7f05340d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053bdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f053415a390 0x7f053415d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053bdff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340cf540 con 0x7f0534159fc0 2023-07-06T01:08:25.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053bdff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340cf820 con 0x7f05340cf0a0 2023-07-06T01:08:25.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053bdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340cdcb0 con 0x7f053415a390 2023-07-06T01:08:25.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053939a700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 0x7f05340d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053a39c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f053415a390 0x7f053415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.702 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053939a700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 0x7f05340d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54600/0 (socket says 172.21.15.194:54600) 2023-07-06T01:08:25.702 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053939a700 1 -- 172.21.15.194:0/813694214 learned_addr learned my addr 172.21.15.194:0/813694214 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:25.702 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053a39c700 1 -- 172.21.15.194:0/813694214 >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 msgr2=0x7f05340d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:25.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053a39c700 1 --2- 172.21.15.194:0/813694214 >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 0x7f05340d29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053a39c700 1 -- 172.21.15.194:0/813694214 >> v1:172.21.15.71:6789/0 conn(0x7f0534159fc0 legacy=0x7f05340b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053a39c700 1 -- 172.21.15.194:0/813694214 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340cd660 con 0x7f053415a390 2023-07-06T01:08:25.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.695+0000 7f053939a700 1 --2- 172.21.15.194:0/813694214 >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 0x7f05340d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:25.704 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.696+0000 7f053a39c700 1 --2- 172.21.15.194:0/813694214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f053415a390 0x7f053415d680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f052c009d90 tx=0x7f052c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620ff1280104da65 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:25.704 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.696+0000 7f0538b99700 1 -- 172.21.15.194:0/813694214 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00e070 con 0x7f053415a390 2023-07-06T01:08:25.704 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.696+0000 7f0538b99700 1 -- 172.21.15.194:0/813694214 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00bb20 con 0x7f053415a390 2023-07-06T01:08:25.704 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.696+0000 7f0538b99700 1 -- 172.21.15.194:0/813694214 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c012430 con 0x7f053415a390 2023-07-06T01:08:25.705 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.696+0000 7f053bdff700 1 -- 172.21.15.194:0/813694214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f053415a390 msgr2=0x7f053415d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.705 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.696+0000 7f053bdff700 1 --2- 172.21.15.194:0/813694214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f053415a390 0x7f053415d680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f052c009d90 tx=0x7f052c00b330 comp rx=0 tx=0).stop 2023-07-06T01:08:25.705 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.697+0000 7f053bdff700 1 -- 172.21.15.194:0/813694214 shutdown_connections 2023-07-06T01:08:25.706 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.697+0000 7f053bdff700 1 --2- 172.21.15.194:0/813694214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f053415a390 0x7f053415d680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.706 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.697+0000 7f053bdff700 1 --2- 172.21.15.194:0/813694214 >> v2:172.21.15.194:3300/0 conn(0x7f05340cf0a0 0x7f05340d29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.706 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.697+0000 7f053bdff700 1 -- 172.21.15.194:0/813694214 >> 172.21.15.194:0/813694214 conn(0x7f053406c1e0 msgr2=0x7f053406c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:25.706 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.697+0000 7f053bdff700 1 -- 172.21.15.194:0/813694214 shutdown_connections 2023-07-06T01:08:25.706 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.697+0000 7f053bdff700 1 -- 172.21.15.194:0/813694214 wait complete. 2023-07-06T01:08:25.709 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.698+0000 7f053bdff700 1 Processor -- start 2023-07-06T01:08:25.709 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.699+0000 7f053bdff700 1 -- start start 2023-07-06T01:08:25.709 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.699+0000 7f053bdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 0x7f0534153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.710 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.699+0000 7f053bdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0534159fc0 0x7f0534152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.710 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.699+0000 7f053bdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053415a390 0x7f0534155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:25.710 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f053bdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c8410 con 0x7f0534159fc0 2023-07-06T01:08:25.711 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f053bdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534152580 con 0x7f053415a390 2023-07-06T01:08:25.711 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f053bdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534152fe0 con 0x7f05340cf0a0 2023-07-06T01:08:25.711 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 0x7f0534153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.712 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 0x7f0534153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38834/0 (socket says 172.21.15.194:38834) 2023-07-06T01:08:25.712 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 -- 172.21.15.194:0/632311548 learned_addr learned my addr 172.21.15.194:0/632311548 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:25.712 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f053939a700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0534159fc0 0x7f0534152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.713 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f053a39c700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053415a390 0x7f0534155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:25.713 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 -- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053415a390 msgr2=0x7f0534155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.713 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053415a390 0x7f0534155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.716 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 -- 172.21.15.194:0/632311548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0534159fc0 msgr2=0x7f0534152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.716 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0534159fc0 0x7f0534152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.716 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 -- 172.21.15.194:0/632311548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524009550 con 0x7f05340cf0a0 2023-07-06T01:08:25.716 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f053939a700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0534159fc0 0x7f0534152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:25.716 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.700+0000 7f0539b9b700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 0x7f0534153430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f053000c4e0 tx=0x7f053000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300052d0 con 0x7f05340cf0a0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0530005430 con 0x7f05340cf0a0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300038c0 con 0x7f05340cf0a0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c009a70 con 0x7f05340cf0a0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05340c8900 con 0x7f05340cf0a0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0530003d20 con 0x7f05340cf0a0 2023-07-06T01:08:25.717 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.701+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0530011d60 con 0x7f05340cf0a0 2023-07-06T01:08:25.718 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.702+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0534068190 con 0x7f05340cf0a0 2023-07-06T01:08:25.718 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.704+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0530017070 con 0x7f05340cf0a0 2023-07-06T01:08:25.788 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:25.786+0000 7f56128e2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T01:08:25.793 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.792+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "eafdad02-28ed-4625-a6c8-28434bd7494d", "id": 3} v 0) v1 -- 0x7f05340cd180 con 0x7f05340cf0a0 2023-07-06T01:08:25.802 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.800+0000 7f052a7fc700 1 -- 172.21.15.194:0/632311548 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eafdad02-28ed-4625-a6c8-28434bd7494d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0530011590 con 0x7f05340cf0a0 2023-07-06T01:08:25.802 INFO:teuthology.orchestra.run.smithi194.stdout:3 2023-07-06T01:08:25.803 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 msgr2=0x7f0534153430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:25.803 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 0x7f0534153430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f053000c4e0 tx=0x7f053000c7f0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 shutdown_connections 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f053415a390 0x7f0534155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05340cf0a0 0x7f0534153430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 --2- 172.21.15.194:0/632311548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0534159fc0 0x7f0534152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 >> 172.21.15.194:0/632311548 conn(0x7f053406c1e0 msgr2=0x7f053415a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 shutdown_connections 2023-07-06T01:08:25.804 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:25.801+0000 7f053bdff700 1 -- 172.21.15.194:0/632311548 wait complete. 2023-07-06T01:08:25.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 2dd5a1ec-5015-4f41-8377-986626f511f2 4 2023-07-06T01:08:26.011 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.010+0000 7fcf973ff700 1 Processor -- start 2023-07-06T01:08:26.012 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.010+0000 7fcf973ff700 1 -- start start 2023-07-06T01:08:26.013 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.011+0000 7fcf973ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf9006c330 0x7fcf9006c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.013 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.011+0000 7fcf973ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9006cc40 con 0x7fcf900c9010 2023-07-06T01:08:26.013 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.011+0000 7fcf973ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900c9a60 con 0x7fcf900c9480 2023-07-06T01:08:26.013 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.011+0000 7fcf973ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf90159b70 con 0x7fcf9006c330 2023-07-06T01:08:26.013 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.011+0000 7fcf9519b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf9006c330 0x7fcf9006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.013 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf9519b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf9006c330 0x7fcf9006c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54618/0 (socket says 172.21.15.194:54618) 2023-07-06T01:08:26.014 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf9519b700 1 -- 172.21.15.194:0/2926829713 learned_addr learned my addr 172.21.15.194:0/2926829713 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:26.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf9519b700 1 -- 172.21.15.194:0/2926829713 >> v1:172.21.15.194:6789/0 conn(0x7fcf900c9480 legacy=0x7fcf90156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf9519b700 1 -- 172.21.15.194:0/2926829713 >> v1:172.21.15.71:6789/0 conn(0x7fcf900c9010 legacy=0x7fcf901565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf87fff700 1 -- 172.21.15.194:0/2926829713 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495426555 0 0) 0x7fcf900c9a60 con 0x7fcf900c9480 2023-07-06T01:08:26.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf9519b700 1 -- 172.21.15.194:0/2926829713 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90159e50 con 0x7fcf9006c330 2023-07-06T01:08:26.015 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf9519b700 1 --2- 172.21.15.194:0/2926829713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf9006c700 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098f0 tx=0x7fcf8c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c1c12c83dcfcfa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf87fff700 1 -- 172.21.15.194:0/2926829713 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00b8a0 con 0x7fcf9006c330 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf87fff700 1 -- 172.21.15.194:0/2926829713 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c00ba00 con 0x7fcf9006c330 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.012+0000 7fcf87fff700 1 -- 172.21.15.194:0/2926829713 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00bd90 con 0x7fcf9006c330 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 -- 172.21.15.194:0/2926829713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 msgr2=0x7fcf9006c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 --2- 172.21.15.194:0/2926829713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf9006c700 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0098f0 tx=0x7fcf8c009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 -- 172.21.15.194:0/2926829713 shutdown_connections 2023-07-06T01:08:26.016 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 --2- 172.21.15.194:0/2926829713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf9006c700 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.017 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 -- 172.21.15.194:0/2926829713 >> 172.21.15.194:0/2926829713 conn(0x7fcf900cb440 msgr2=0x7fcf900cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.017 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 -- 172.21.15.194:0/2926829713 shutdown_connections 2023-07-06T01:08:26.017 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.013+0000 7fcf973ff700 1 -- 172.21.15.194:0/2926829713 wait complete. 2023-07-06T01:08:26.018 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.015+0000 7fcf973ff700 1 Processor -- start 2023-07-06T01:08:26.018 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.015+0000 7fcf973ff700 1 -- start start 2023-07-06T01:08:26.018 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf973ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf900c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf973ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf900c9010 0x7fcf90155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf973ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf900c9480 0x7fcf900b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf973ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b1300 con 0x7fcf900c9480 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf973ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf90156410 con 0x7fcf9006c330 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf973ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b0d40 con 0x7fcf900c9010 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf9519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf900c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf9519b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf900c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54632/0 (socket says 172.21.15.194:54632) 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf9519b700 1 -- 172.21.15.194:0/3748021274 learned_addr learned my addr 172.21.15.194:0/3748021274 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf9499a700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf900c9010 0x7fcf90155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.016+0000 7fcf9599c700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf900c9480 0x7fcf900b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9519b700 1 -- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf900c9010 msgr2=0x7fcf90155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9519b700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf900c9010 0x7fcf90155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9519b700 1 -- 172.21.15.194:0/3748021274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf900c9480 msgr2=0x7fcf900b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9519b700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf900c9480 0x7fcf900b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9519b700 1 -- 172.21.15.194:0/3748021274 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c009550 con 0x7fcf9006c330 2023-07-06T01:08:26.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9499a700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf900c9010 0x7fcf90155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:26.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf9519b700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf900c89a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c000c00 tx=0x7fcf8c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c011a70 con 0x7fcf9006c330 2023-07-06T01:08:26.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c01f070 con 0x7fcf9006c330 2023-07-06T01:08:26.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c011df0 con 0x7fcf9006c330 2023-07-06T01:08:26.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900b1020 con 0x7fcf9006c330 2023-07-06T01:08:26.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.017+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf900b2560 con 0x7fcf9006c330 2023-07-06T01:08:26.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.018+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf8c026780 con 0x7fcf9006c330 2023-07-06T01:08:26.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.018+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fcf8c021070 con 0x7fcf9006c330 2023-07-06T01:08:26.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.018+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf900008d0 con 0x7fcf9006c330 2023-07-06T01:08:26.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.021+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcf8c045b00 con 0x7fcf9006c330 2023-07-06T01:08:26.077 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:26.075+0000 7f06576f7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T01:08:26.108 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.107+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2dd5a1ec-5015-4f41-8377-986626f511f2", "id": 4} v 0) v1 -- 0x7fcf900b2750 con 0x7fcf9006c330 2023-07-06T01:08:26.114 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.112+0000 7fcf85ffb700 1 -- 172.21.15.194:0/3748021274 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2dd5a1ec-5015-4f41-8377-986626f511f2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf8c034030 con 0x7fcf9006c330 2023-07-06T01:08:26.114 INFO:teuthology.orchestra.run.smithi194.stdout:4 2023-07-06T01:08:26.115 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 msgr2=0x7fcf900c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.115 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf900c89a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c000c00 tx=0x7fcf8c004750 comp rx=0 tx=0).stop 2023-07-06T01:08:26.115 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 shutdown_connections 2023-07-06T01:08:26.115 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf900c9480 0x7fcf900b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.116 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf9006c330 0x7fcf900c89a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.116 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 --2- 172.21.15.194:0/3748021274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf900c9010 0x7fcf90155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.116 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 >> 172.21.15.194:0/3748021274 conn(0x7fcf900cb440 msgr2=0x7fcf900713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.116 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 shutdown_connections 2023-07-06T01:08:26.116 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.113+0000 7fcf973ff700 1 -- 172.21.15.194:0/3748021274 wait complete. 2023-07-06T01:08:26.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new b4c52b0f-894b-4178-9c5d-0b6dfe7f416f 5 2023-07-06T01:08:26.320 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.318+0000 7fe2f8dff700 1 Processor -- start 2023-07-06T01:08:26.320 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.318+0000 7fe2f8dff700 1 -- start start 2023-07-06T01:08:26.321 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.319+0000 7fe2f8dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f40b5c90 0x7fe2f40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.321 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.319+0000 7fe2f8dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40cf780 con 0x7fe2f415fca0 2023-07-06T01:08:26.321 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f8dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40cd490 con 0x7fe2f40b60e0 2023-07-06T01:08:26.322 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f8dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40cd770 con 0x7fe2f40b5c90 2023-07-06T01:08:26.322 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f1d9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f40b5c90 0x7fe2f40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.322 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f2d9d700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe2f40b60e0 0x7fe2f40cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33394/0 (socket says 172.21.15.194:33394) 2023-07-06T01:08:26.322 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f2d9d700 1 -- 172.21.15.194:0/597978402 learned_addr learned my addr 172.21.15.194:0/597978402 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-07-06T01:08:26.324 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f1d9b700 1 -- 172.21.15.194:0/597978402 >> v1:172.21.15.194:6789/0 conn(0x7fe2f40b60e0 legacy=0x7fe2f40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.324 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f1d9b700 1 -- 172.21.15.194:0/597978402 >> v1:172.21.15.71:6789/0 conn(0x7fe2f415fca0 legacy=0x7fe2f40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.324 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f159a700 1 -- 172.21.15.194:0/597978402 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435309608 0 0) 0x7fe2f40cd490 con 0x7fe2f40b60e0 2023-07-06T01:08:26.324 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f1d9b700 1 -- 172.21.15.194:0/597978402 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40cda50 con 0x7fe2f40b5c90 2023-07-06T01:08:26.324 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.320+0000 7fe2f1d9b700 1 --2- 172.21.15.194:0/597978402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f40b5c90 0x7fe2f40d2d40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91c33211050d8cf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f159a700 1 -- 172.21.15.194:0/597978402 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8011830 con 0x7fe2f40b5c90 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f159a700 1 -- 172.21.15.194:0/597978402 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8011990 con 0x7fe2f40b5c90 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f159a700 1 -- 172.21.15.194:0/597978402 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8011d20 con 0x7fe2f40b5c90 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f8dff700 1 -- 172.21.15.194:0/597978402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f40b5c90 msgr2=0x7fe2f40d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f8dff700 1 --2- 172.21.15.194:0/597978402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f40b5c90 0x7fe2f40d2d40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009870 tx=0x7fe2e8009b80 comp rx=0 tx=0).stop 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f8dff700 1 -- 172.21.15.194:0/597978402 shutdown_connections 2023-07-06T01:08:26.325 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f8dff700 1 --2- 172.21.15.194:0/597978402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f40b5c90 0x7fe2f40d2d40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.326 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f8dff700 1 -- 172.21.15.194:0/597978402 >> 172.21.15.194:0/597978402 conn(0x7fe2f406c150 msgr2=0x7fe2f406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.326 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.321+0000 7fe2f8dff700 1 -- 172.21.15.194:0/597978402 shutdown_connections 2023-07-06T01:08:26.326 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.322+0000 7fe2f8dff700 1 -- 172.21.15.194:0/597978402 wait complete. 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.323+0000 7fe2f8dff700 1 Processor -- start 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.323+0000 7fe2f8dff700 1 -- start start 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f8dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f40b5c90 0x7fe2f40c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f8dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2f40b60e0 0x7fe2f40d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f8dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 0x7fe2f40d3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f8dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40c9230 con 0x7fe2f40b60e0 2023-07-06T01:08:26.328 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f8dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4148f30 con 0x7fe2f40b5c90 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f8dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f41494f0 con 0x7fe2f415fca0 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f40b5c90 0x7fe2f40c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f2d9d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 0x7fe2f40d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f2d9d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 0x7fe2f40d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38874/0 (socket says 172.21.15.194:38874) 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f40b5c90 0x7fe2f40c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54646/0 (socket says 172.21.15.194:54646) 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f2d9d700 1 -- 172.21.15.194:0/758653973 learned_addr learned my addr 172.21.15.194:0/758653973 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:26.329 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.324+0000 7fe2f1d9b700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2f40b60e0 0x7fe2f40d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f2d9d700 1 -- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f40b5c90 msgr2=0x7fe2f40c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f2d9d700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f40b5c90 0x7fe2f40c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f2d9d700 1 -- 172.21.15.194:0/758653973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2f40b60e0 msgr2=0x7fe2f40d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f2d9d700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2f40b60e0 0x7fe2f40d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f2d9d700 1 -- 172.21.15.194:0/758653973 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e80094a0 con 0x7fe2f415fca0 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f2d9d700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 0x7fe2f40d3060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00cc70 tx=0x7fe2ec00cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.330 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00aaa0 con 0x7fe2f415fca0 2023-07-06T01:08:26.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec00ac20 con 0x7fe2f415fca0 2023-07-06T01:08:26.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f415c4f0 con 0x7fe2f415fca0 2023-07-06T01:08:26.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.325+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0070d0 con 0x7fe2f415fca0 2023-07-06T01:08:26.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.326+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f4149180 con 0x7fe2f415fca0 2023-07-06T01:08:26.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.326+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe2ec007530 con 0x7fe2f415fca0 2023-07-06T01:08:26.331 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.326+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe2ec01d440 con 0x7fe2f415fca0 2023-07-06T01:08:26.332 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.327+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f40008d0 con 0x7fe2f415fca0 2023-07-06T01:08:26.332 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.329+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe2ec018070 con 0x7fe2f415fca0 2023-07-06T01:08:26.416 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.415+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4c52b0f-894b-4178-9c5d-0b6dfe7f416f", "id": 5} v 0) v1 -- 0x7fe2f4149630 con 0x7fe2f415fca0 2023-07-06T01:08:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.423+0000 7fe2e2ffd700 1 -- 172.21.15.194:0/758653973 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4c52b0f-894b-4178-9c5d-0b6dfe7f416f", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2ec0077e0 con 0x7fe2f415fca0 2023-07-06T01:08:26.425 INFO:teuthology.orchestra.run.smithi194.stdout:5 2023-07-06T01:08:26.426 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 msgr2=0x7fe2f40d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.426 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 0x7fe2f40d3060 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00cc70 tx=0x7fe2ec00cf80 comp rx=0 tx=0).stop 2023-07-06T01:08:26.426 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 shutdown_connections 2023-07-06T01:08:26.426 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2f415fca0 0x7fe2f40d3060 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.426 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2f40b5c90 0x7fe2f40c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.426 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 --2- 172.21.15.194:0/758653973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2f40b60e0 0x7fe2f40d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.427 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 >> 172.21.15.194:0/758653973 conn(0x7fe2f406c150 msgr2=0x7fe2f40b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.427 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 shutdown_connections 2023-07-06T01:08:26.427 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.424+0000 7fe2f8dff700 1 -- 172.21.15.194:0/758653973 wait complete. 2023-07-06T01:08:26.445 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 982e7e97-484b-49c7-8121-de950b464b8b 6 2023-07-06T01:08:26.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.638+0000 7f4b2a3ff700 1 Processor -- start 2023-07-06T01:08:26.640 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.638+0000 7f4b2a3ff700 1 -- start start 2023-07-06T01:08:26.641 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.639+0000 7f4b2a3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4b2415fca0 0x7f4b240d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.641 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b2a3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240cf780 con 0x7f4b240b5c90 2023-07-06T01:08:26.641 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b2a3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240cd490 con 0x7f4b240b6110 2023-07-06T01:08:26.641 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b2a3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240cd770 con 0x7f4b2415fca0 2023-07-06T01:08:26.642 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b2899c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4b240b6110 0x7f4b240cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33396/0 (socket says 172.21.15.194:33396) 2023-07-06T01:08:26.643 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b2899c700 1 -- 172.21.15.194:0/2740990471 learned_addr learned my addr 172.21.15.194:0/2740990471 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-07-06T01:08:26.643 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b23fff700 1 --2- 172.21.15.194:0/2740990471 >> v2:172.21.15.71:3300/0 conn(0x7f4b2415fca0 0x7f4b240d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.643 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b22ffd700 1 -- 172.21.15.194:0/2740990471 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283743332 0 0) 0x7f4b240cd490 con 0x7f4b240b6110 2023-07-06T01:08:26.643 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b22ffd700 1 -- 172.21.15.194:0/2740990471 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c0035b0 con 0x7f4b240b6110 2023-07-06T01:08:26.643 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b23fff700 1 -- 172.21.15.194:0/2740990471 >> v1:172.21.15.194:6789/0 conn(0x7f4b240b6110 legacy=0x7f4b240cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.643 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b23fff700 1 -- 172.21.15.194:0/2740990471 >> v1:172.21.15.71:6789/0 conn(0x7f4b240b5c90 legacy=0x7f4b240d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.644 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b22ffd700 1 -- 172.21.15.194:0/2740990471 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1244493731 0 0) 0x7f4b240cf780 con 0x7f4b240b5c90 2023-07-06T01:08:26.644 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.640+0000 7f4b23fff700 1 -- 172.21.15.194:0/2740990471 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240cda50 con 0x7f4b2415fca0 2023-07-06T01:08:26.644 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.641+0000 7f4b23fff700 1 --2- 172.21.15.194:0/2740990471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2415fca0 0x7f4b240d1420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009840 tx=0x7f4b14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef458dafc19f8acc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.644 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.641+0000 7f4b22ffd700 1 -- 172.21.15.194:0/2740990471 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14011830 con 0x7f4b2415fca0 2023-07-06T01:08:26.645 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.641+0000 7f4b22ffd700 1 -- 172.21.15.194:0/2740990471 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14011990 con 0x7f4b2415fca0 2023-07-06T01:08:26.645 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.641+0000 7f4b22ffd700 1 -- 172.21.15.194:0/2740990471 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14011d20 con 0x7f4b2415fca0 2023-07-06T01:08:26.649 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.641+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/2740990471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2415fca0 msgr2=0x7f4b240d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.649 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.641+0000 7f4b2a3ff700 1 --2- 172.21.15.194:0/2740990471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2415fca0 0x7f4b240d1420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009840 tx=0x7f4b14009b50 comp rx=0 tx=0).stop 2023-07-06T01:08:26.650 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.642+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/2740990471 shutdown_connections 2023-07-06T01:08:26.650 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.642+0000 7f4b2a3ff700 1 --2- 172.21.15.194:0/2740990471 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b2415fca0 0x7f4b240d1420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.650 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.642+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/2740990471 >> 172.21.15.194:0/2740990471 conn(0x7f4b2406c150 msgr2=0x7f4b2406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.651 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.642+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/2740990471 shutdown_connections 2023-07-06T01:08:26.651 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.642+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/2740990471 wait complete. 2023-07-06T01:08:26.651 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.643+0000 7f4b2a3ff700 1 Processor -- start 2023-07-06T01:08:26.651 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.643+0000 7f4b2a3ff700 1 -- start start 2023-07-06T01:08:26.652 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.644+0000 7f4b2a3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b240b5c90 0x7f4b240b8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.652 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.644+0000 7f4b2a3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 0x7f4b241547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.652 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.644+0000 7f4b2a3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b2415fca0 0x7f4b240c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.653 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.644+0000 7f4b2a3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240c8af0 con 0x7f4b240b5c90 2023-07-06T01:08:26.653 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.644+0000 7f4b2a3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240c7ee0 con 0x7f4b240b6110 2023-07-06T01:08:26.653 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.644+0000 7f4b2a3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240c81c0 con 0x7f4b2415fca0 2023-07-06T01:08:26.653 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 0x7f4b241547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.653 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b240b5c90 0x7f4b240b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.654 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 0x7f4b241547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:54654/0 (socket says 172.21.15.194:54654) 2023-07-06T01:08:26.654 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b2899c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b2415fca0 0x7f4b240c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.654 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b237fe700 1 -- 172.21.15.194:0/992696300 learned_addr learned my addr 172.21.15.194:0/992696300 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:26.654 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 -- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b2415fca0 msgr2=0x7f4b240c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.655 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b2415fca0 0x7f4b240c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.655 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 -- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 msgr2=0x7f4b241547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.655 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 0x7f4b241547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.655 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 -- 172.21.15.194:0/992696300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140094a0 con 0x7f4b240b5c90 2023-07-06T01:08:26.656 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b237fe700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 0x7f4b241547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:26.656 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.645+0000 7f4b23fff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b240b5c90 0x7f4b240b8830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4b14016000 tx=0x7f4b14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.656 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1401a7e0 con 0x7f4b240b5c90 2023-07-06T01:08:26.656 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1401a960 con 0x7f4b240b5c90 2023-07-06T01:08:26.656 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1401ad10 con 0x7f4b240b5c90 2023-07-06T01:08:26.656 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b240c84a0 con 0x7f4b240b5c90 2023-07-06T01:08:26.657 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f56128e2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T01:08:26.657 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b240c7b40 con 0x7f4b240b5c90 2023-07-06T01:08:26.658 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b14022070 con 0x7f4b240b5c90 2023-07-06T01:08:26.658 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.646+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4b14024d10 con 0x7f4b240b5c90 2023-07-06T01:08:26.658 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.647+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b240008d0 con 0x7f4b240b5c90 2023-07-06T01:08:26.658 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.649+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4b14029070 con 0x7f4b240b5c90 2023-07-06T01:08:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.736+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "982e7e97-484b-49c7-8121-de950b464b8b", "id": 6} v 0) v1 -- 0x7f4b24157900 con 0x7f4b240b5c90 2023-07-06T01:08:26.741 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.740+0000 7f4b20ff9700 1 -- 172.21.15.194:0/992696300 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "982e7e97-484b-49c7-8121-de950b464b8b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b14015020 con 0x7f4b240b5c90 2023-07-06T01:08:26.742 INFO:teuthology.orchestra.run.smithi194.stdout:6 2023-07-06T01:08:26.743 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b240b5c90 msgr2=0x7f4b240b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.744 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b240b5c90 0x7f4b240b8830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4b14016000 tx=0x7f4b14004750 comp rx=0 tx=0).stop 2023-07-06T01:08:26.744 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 shutdown_connections 2023-07-06T01:08:26.745 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b2415fca0 0x7f4b240c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.745 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b240b5c90 0x7f4b240b8830 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.745 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 --2- 172.21.15.194:0/992696300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b240b6110 0x7f4b241547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.746 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 >> 172.21.15.194:0/992696300 conn(0x7f4b2406c150 msgr2=0x7f4b240d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.746 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 shutdown_connections 2023-07-06T01:08:26.746 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.741+0000 7f4b2a3ff700 1 -- 172.21.15.194:0/992696300 wait complete. 2023-07-06T01:08:26.746 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:26.742+0000 7f56128e2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T01:08:26.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 186dbc3c-5805-4845-9f0f-d06777576354 7 2023-07-06T01:08:26.877 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:26.874+0000 7f06576f7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T01:08:26.919 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:26.918+0000 7f56128e2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T01:08:26.950 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.949+0000 7fbaa4dff700 1 Processor -- start 2023-07-06T01:08:26.951 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.949+0000 7fbaa4dff700 1 -- start start 2023-07-06T01:08:26.952 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.950+0000 7fbaa4dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbaa015fca0 0x7fbaa00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.952 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.950+0000 7fbaa4dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.952 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.950+0000 7fbaa4dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00cf780 con 0x7fbaa00b60e0 2023-07-06T01:08:26.953 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.950+0000 7fbaa4dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00cd490 con 0x7fbaa015fca0 2023-07-06T01:08:26.953 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.950+0000 7fbaa4dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00cd770 con 0x7fbaa00b5c90 2023-07-06T01:08:26.953 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9dd9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.953 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9ed9d700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fbaa00b60e0 0x7fbaa00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33412/0 (socket says 172.21.15.194:33412) 2023-07-06T01:08:26.953 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9ed9d700 1 -- 172.21.15.194:0/1347592475 learned_addr learned my addr 172.21.15.194:0/1347592475 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-07-06T01:08:26.953 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9e59c700 1 --2- 172.21.15.194:0/1347592475 >> v2:172.21.15.71:3300/0 conn(0x7fbaa015fca0 0x7fbaa00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.954 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9e59c700 1 -- 172.21.15.194:0/1347592475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 msgr2=0x7fbaa00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:26.955 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9e59c700 1 --2- 172.21.15.194:0/1347592475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa00d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.955 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9d59a700 1 -- 172.21.15.194:0/1347592475 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869660850 0 0) 0x7fbaa00cf780 con 0x7fbaa00b60e0 2023-07-06T01:08:26.955 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9e59c700 1 -- 172.21.15.194:0/1347592475 >> v1:172.21.15.194:6789/0 conn(0x7fbaa00b60e0 legacy=0x7fbaa00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.955 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9e59c700 1 -- 172.21.15.194:0/1347592475 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00cda50 con 0x7fbaa015fca0 2023-07-06T01:08:26.955 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.951+0000 7fba9e59c700 1 --2- 172.21.15.194:0/1347592475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d1420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba90009840 tx=0x7fba90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba41d37d86674f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.955 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fba9d59a700 1 -- 172.21.15.194:0/1347592475 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011830 con 0x7fbaa015fca0 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fba9d59a700 1 -- 172.21.15.194:0/1347592475 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90011990 con 0x7fbaa015fca0 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fba9d59a700 1 -- 172.21.15.194:0/1347592475 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011d20 con 0x7fbaa015fca0 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 -- 172.21.15.194:0/1347592475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 msgr2=0x7fbaa00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/1347592475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d1420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba90009840 tx=0x7fba90009b50 comp rx=0 tx=0).stop 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 -- 172.21.15.194:0/1347592475 shutdown_connections 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/1347592475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d1420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/1347592475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 -- 172.21.15.194:0/1347592475 >> 172.21.15.194:0/1347592475 conn(0x7fbaa006c150 msgr2=0x7fbaa006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:26.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 -- 172.21.15.194:0/1347592475 shutdown_connections 2023-07-06T01:08:26.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.952+0000 7fbaa4dff700 1 -- 172.21.15.194:0/1347592475 wait complete. 2023-07-06T01:08:26.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.954+0000 7fbaa4dff700 1 Processor -- start 2023-07-06T01:08:26.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.954+0000 7fbaa4dff700 1 -- start start 2023-07-06T01:08:26.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.955+0000 7fbaa4dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.955+0000 7fbaa4dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b60e0 0x7fbaa00c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.959 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.955+0000 7fbaa4dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.955+0000 7fbaa4dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00cc1a0 con 0x7fbaa015fca0 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.955+0000 7fbaa4dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa014c470 con 0x7fbaa00b60e0 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.955+0000 7fbaa4dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00cb520 con 0x7fbaa00b5c90 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa014c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38892/0 (socket says 172.21.15.194:38892) 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 -- 172.21.15.194:0/2132797646 learned_addr learned my addr 172.21.15.194:0/2132797646 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-07-06T01:08:26.960 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9ed9d700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9dd9b700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b60e0 0x7fbaa00c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 -- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b60e0 msgr2=0x7fbaa00c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b60e0 0x7fbaa00c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 -- 172.21.15.194:0/2132797646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 msgr2=0x7fbaa00d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 -- 172.21.15.194:0/2132797646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900094a0 con 0x7fbaa00b5c90 2023-07-06T01:08:26.961 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.956+0000 7fba9e59c700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa014c6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fba90009b90 tx=0x7fba90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900036a0 con 0x7fbaa00b5c90 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9001e070 con 0x7fbaa00b5c90 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00cb800 con 0x7fbaa00b5c90 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90003a60 con 0x7fbaa00b5c90 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00cbdc0 con 0x7fbaa00b5c90 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba9002d450 con 0x7fbaa00b5c90 2023-07-06T01:08:26.962 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.957+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fba9001a420 con 0x7fbaa00b5c90 2023-07-06T01:08:26.963 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.958+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa00cf3f0 con 0x7fbaa00b5c90 2023-07-06T01:08:26.963 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:26.960+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbaa00cf3f0 con 0x7fbaa00b5c90 2023-07-06T01:08:26.969 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:26.967+0000 7f06576f7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T01:08:27.013 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.012+0000 7f56128e2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T01:08:27.049 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.047+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "186dbc3c-5805-4845-9f0f-d06777576354", "id": 7} v 0) v1 -- 0x7fbaa00008d0 con 0x7fbaa00b5c90 2023-07-06T01:08:27.055 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.054+0000 7fba8effd700 1 -- 172.21.15.194:0/2132797646 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "186dbc3c-5805-4845-9f0f-d06777576354", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba90020070 con 0x7fbaa00b5c90 2023-07-06T01:08:27.055 INFO:teuthology.orchestra.run.smithi194.stdout:7 2023-07-06T01:08:27.056 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 msgr2=0x7fbaa014c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa014c6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fba90009b90 tx=0x7fba90004750 comp rx=0 tx=0).stop 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 shutdown_connections 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbaa015fca0 0x7fbaa00d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa00b5c90 0x7fbaa014c6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 --2- 172.21.15.194:0/2132797646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b60e0 0x7fbaa00c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 >> 172.21.15.194:0/2132797646 conn(0x7fbaa006c150 msgr2=0x7fbaa00b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:27.057 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 shutdown_connections 2023-07-06T01:08:27.058 INFO:teuthology.orchestra.run.smithi194.stderr:2023-07-06T01:08:27.055+0000 7fbaa4dff700 1 -- 172.21.15.194:0/2132797646 wait complete. 2023-07-06T01:08:27.073 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-06T01:08:27.073 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-06T01:08:27.077 INFO:tasks.ceph.osd.0:Started 2023-07-06T01:08:27.078 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-06T01:08:27.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-06T01:08:27.082 INFO:tasks.ceph.osd.1:Started 2023-07-06T01:08:27.082 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-06T01:08:27.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-06T01:08:27.087 INFO:tasks.ceph.osd.2:Started 2023-07-06T01:08:27.087 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-06T01:08:27.088 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-06T01:08:27.093 INFO:tasks.ceph.osd.3:Started 2023-07-06T01:08:27.093 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-06T01:08:27.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-06T01:08:27.097 INFO:tasks.ceph.osd.4:Started 2023-07-06T01:08:27.098 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-06T01:08:27.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-06T01:08:27.102 INFO:tasks.ceph.osd.5:Started 2023-07-06T01:08:27.103 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-06T01:08:27.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-06T01:08:27.108 INFO:tasks.ceph.osd.6:Started 2023-07-06T01:08:27.109 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-06T01:08:27.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-06T01:08:27.114 INFO:tasks.ceph.osd.7:Started 2023-07-06T01:08:27.114 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:27.165 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:27.162+0000 7f06576f7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T01:08:27.262 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.260+0000 7f56128e2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T01:08:27.295 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:27.292+0000 7f06576f7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T01:08:27.370 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.368+0000 7f56128e2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T01:08:27.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.404+0000 7fdc63bff700 1 Processor -- start 2023-07-06T01:08:27.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.404+0000 7fdc63bff700 1 -- start start 2023-07-06T01:08:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.405+0000 7fdc63bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c15c790 0x7fdc5c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.405+0000 7fdc63bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdc5c0d0220 0x7fdc5c069f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.405+0000 7fdc63bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c06a8e0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.405+0000 7fdc63bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c0ca500 con 0x7fdc5c0d0220 2023-07-06T01:08:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.405+0000 7fdc63bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0d0690 con 0x7fdc5c15c790 2023-07-06T01:08:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6219c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdc5c06a4a0 0x7fdc5c160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47072/0 (socket says 172.21.15.71:47072) 2023-07-06T01:08:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6219c700 1 -- 172.21.15.71:0/4041805403 learned_addr learned my addr 172.21.15.71:0/4041805403 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6119a700 1 --2- 172.21.15.71:0/4041805403 >> v2:172.21.15.194:3300/0 conn(0x7fdc5c0d0220 0x7fdc5c069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:27.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6199b700 1 --2- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c15c790 0x7fdc5c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:27.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc60999700 1 -- 172.21.15.71:0/4041805403 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232136502 0 0) 0x7fdc5c06a8e0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc60999700 1 -- 172.21.15.71:0/4041805403 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc480035b0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc60999700 1 -- 172.21.15.71:0/4041805403 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1339504221 0 0) 0x7fdc480035b0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6119a700 1 -- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c15c790 msgr2=0x7fdc5c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6119a700 1 --2- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c15c790 0x7fdc5c0cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6119a700 1 -- 172.21.15.71:0/4041805403 >> v1:172.21.15.71:6789/0 conn(0x7fdc5c06a4a0 legacy=0x7fdc5c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.406+0000 7fdc6119a700 1 -- 172.21.15.71:0/4041805403 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0ce6f0 con 0x7fdc5c0d0220 2023-07-06T01:08:27.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.407+0000 7fdc6119a700 1 --2- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c0d0220 0x7fdc5c069f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009840 tx=0x7fdc4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688461f4746621a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.407+0000 7fdc60999700 1 -- 172.21.15.71:0/4041805403 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540019f0 con 0x7fdc5c0d0220 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.407+0000 7fdc60999700 1 -- 172.21.15.71:0/4041805403 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c004030 con 0x7fdc5c0d0220 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.407+0000 7fdc60999700 1 -- 172.21.15.71:0/4041805403 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0043c0 con 0x7fdc5c0d0220 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 -- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c0d0220 msgr2=0x7fdc5c069f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c0d0220 0x7fdc5c069f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009840 tx=0x7fdc4c009b50 comp rx=0 tx=0).stop 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 -- 172.21.15.71:0/4041805403 shutdown_connections 2023-07-06T01:08:27.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c15c790 0x7fdc5c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4041805403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c0d0220 0x7fdc5c069f60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 -- 172.21.15.71:0/4041805403 >> 172.21.15.71:0/4041805403 conn(0x7fdc5c0b22f0 msgr2=0x7fdc5c0cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 -- 172.21.15.71:0/4041805403 shutdown_connections 2023-07-06T01:08:27.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.408+0000 7fdc63bff700 1 -- 172.21.15.71:0/4041805403 wait complete. 2023-07-06T01:08:27.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.410+0000 7fdc63bff700 1 Processor -- start 2023-07-06T01:08:27.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.410+0000 7fdc63bff700 1 -- start start 2023-07-06T01:08:27.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc63bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06a4a0 0x7fdc5c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:27.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc63bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c0d0220 0x7fdc5c157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:27.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc63bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 0x7fdc5c1e6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc63bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c1577b0 con 0x7fdc5c15c790 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc63bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c156f10 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc63bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c1599b0 con 0x7fdc5c0d0220 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc6219c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 0x7fdc5c1e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc6119a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c0d0220 0x7fdc5c157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc6219c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 0x7fdc5c1e6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55140/0 (socket says 172.21.15.71:55140) 2023-07-06T01:08:27.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc6199b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06a4a0 0x7fdc5c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.411+0000 7fdc6219c700 1 -- 172.21.15.71:0/4261721324 learned_addr learned my addr 172.21.15.71:0/4261721324 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6199b700 1 -- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c0d0220 msgr2=0x7fdc5c157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6199b700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c0d0220 0x7fdc5c157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6199b700 1 -- 172.21.15.71:0/4261721324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 msgr2=0x7fdc5c1e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6199b700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 0x7fdc5c1e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6199b700 1 -- 172.21.15.71:0/4261721324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0094a0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6219c700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 0x7fdc5c1e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc6199b700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06a4a0 0x7fdc5c15a590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800e870 tx=0x7fdc5800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58013680 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580137e0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c157160 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58013b90 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.412+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c15aad0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.413+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdc58005a20 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.413+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fdc58005cd0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.413+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5c0008d0 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.419+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdc58021060 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.469 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.468+0000 7f56128e2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T01:08:27.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.491+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc5c0cf090 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.492+0000 7fdc527fc700 1 -- 172.21.15.71:0/4261721324 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdc58029020 con 0x7fdc5c06a4a0 2023-07-06T01:08:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:27.495 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:27.048735+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06a4a0 msgr2=0x7fdc5c15a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06a4a0 0x7fdc5c15a590 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800e870 tx=0x7fdc5800eb80 comp rx=0 tx=0).stop 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 shutdown_connections 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc5c15c790 0x7fdc5c1e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06a4a0 0x7fdc5c15a590 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 --2- 172.21.15.71:0/4261721324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc5c0d0220 0x7fdc5c157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:27.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 >> 172.21.15.71:0/4261721324 conn(0x7fdc5c0b22f0 msgr2=0x7fdc5c073060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 shutdown_connections 2023-07-06T01:08:27.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:27.493+0000 7fdc63bff700 1 -- 172.21.15.71:0/4261721324 wait complete. 2023-07-06T01:08:27.513 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-06T01:08:27.513 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-06T01:08:27.540 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:27.537+0000 7f06576f7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T01:08:27.574 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.573+0000 7f56128e2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T01:08:27.641 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:27.639+0000 7f06576f7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T01:08:27.738 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:27.736+0000 7f06576f7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T01:08:27.798 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-07-06T01:08:27.796+0000 7fd359d38640 -1 Falling back to public interface 2023-07-06T01:08:27.802 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-07-06T01:08:27.800+0000 7f6aaa966640 -1 Falling back to public interface 2023-07-06T01:08:27.803 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.801+0000 7f56128e2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T01:08:27.804 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-07-06T01:08:27.802+0000 7ff2dc864640 -1 Falling back to public interface 2023-07-06T01:08:27.805 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-07-06T01:08:27.804+0000 7fc152352640 -1 Falling back to public interface 2023-07-06T01:08:27.818 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-07-06T01:08:27.815+0000 7ff562e84640 -1 Falling back to public interface 2023-07-06T01:08:27.826 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-07-06T01:08:27.824+0000 7fd3689da640 -1 Falling back to public interface 2023-07-06T01:08:27.828 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-07-06T01:08:27.827+0000 7fe86d213640 -1 Falling back to public interface 2023-07-06T01:08:27.831 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-07-06T01:08:27.830+0000 7fc60a292640 -1 Falling back to public interface 2023-07-06T01:08:27.862 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:27.859+0000 7f06576f7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T01:08:27.915 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:27.913+0000 7f56128e2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T01:08:28.086 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:28.083+0000 7f06576f7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T01:08:28.189 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:28.187+0000 7f06576f7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T01:08:28.268 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:28.266+0000 7f56128e2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T01:08:28.319 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:28.357 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:28.356+0000 7f56128e2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T01:08:28.498 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.494+0000 7f933cdff700 1 Processor -- start 2023-07-06T01:08:28.498 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.494+0000 7f933cdff700 1 -- start start 2023-07-06T01:08:28.501 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f933cdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f933815fca0 0x7f93380d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:28.501 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f933cdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93380b6100 0x7f93380cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:28.501 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f933cdff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93380cf780 con 0x7f93380b5c90 2023-07-06T01:08:28.501 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f933cdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93380cd490 con 0x7f93380b6100 2023-07-06T01:08:28.501 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f933cdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93380cd770 con 0x7f933815fca0 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93380b6100 0x7f93380cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93380b6100 0x7f93380cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55148/0 (socket says 172.21.15.71:55148) 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 -- 172.21.15.71:0/2479976858 learned_addr learned my addr 172.21.15.71:0/2479976858 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f933659c700 1 --2- 172.21.15.71:0/2479976858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f933815fca0 0x7f93380d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 -- 172.21.15.71:0/2479976858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f933815fca0 msgr2=0x7f93380d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 --2- 172.21.15.71:0/2479976858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f933815fca0 0x7f93380d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.502 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 -- 172.21.15.71:0/2479976858 >> v1:172.21.15.194:6789/0 conn(0x7f93380b5c90 legacy=0x7f93380d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9335d9b700 1 -- 172.21.15.71:0/2479976858 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96845394 0 0) 0x7f93380cf780 con 0x7f93380b5c90 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.496+0000 7f9336d9d700 1 -- 172.21.15.71:0/2479976858 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380cda50 con 0x7f93380b6100 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.497+0000 7f9336d9d700 1 --2- 172.21.15.71:0/2479976858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93380b6100 0x7f93380cfc10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9330009e50 tx=0x7f933000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e357f251bbf396 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.497+0000 7f9335d9b700 1 -- 172.21.15.71:0/2479976858 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933000e070 con 0x7f93380b6100 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.497+0000 7f9335d9b700 1 -- 172.21.15.71:0/2479976858 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933000b910 con 0x7f93380b6100 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.497+0000 7f9335d9b700 1 -- 172.21.15.71:0/2479976858 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933000bcc0 con 0x7f93380b6100 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.497+0000 7f933cdff700 1 -- 172.21.15.71:0/2479976858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93380b6100 msgr2=0x7f93380cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:28.503 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.497+0000 7f933cdff700 1 --2- 172.21.15.71:0/2479976858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93380b6100 0x7f93380cfc10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9330009e50 tx=0x7f933000b330 comp rx=0 tx=0).stop 2023-07-06T01:08:28.504 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.498+0000 7f933cdff700 1 -- 172.21.15.71:0/2479976858 shutdown_connections 2023-07-06T01:08:28.504 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.498+0000 7f933cdff700 1 --2- 172.21.15.71:0/2479976858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93380b6100 0x7f93380cfc10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.504 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.498+0000 7f933cdff700 1 --2- 172.21.15.71:0/2479976858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f933815fca0 0x7f93380d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.504 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.498+0000 7f933cdff700 1 -- 172.21.15.71:0/2479976858 >> 172.21.15.71:0/2479976858 conn(0x7f933806c150 msgr2=0x7f933806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:28.504 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.498+0000 7f933cdff700 1 -- 172.21.15.71:0/2479976858 shutdown_connections 2023-07-06T01:08:28.504 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.498+0000 7f933cdff700 1 -- 172.21.15.71:0/2479976858 wait complete. 2023-07-06T01:08:28.507 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.500+0000 7f933cdff700 1 Processor -- start 2023-07-06T01:08:28.507 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.500+0000 7f933cdff700 1 -- start start 2023-07-06T01:08:28.507 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.501+0000 7f933cdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 0x7f93380cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:28.507 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.501+0000 7f933cdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93380b6100 0x7f9338158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:28.507 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933cdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f933815fca0 0x7f93381542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:28.507 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933cdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933815c400 con 0x7f933815fca0 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933cdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93380ca4b0 con 0x7f93380b6100 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933cdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93380ca790 con 0x7f93380b5c90 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f9336d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f933815fca0 0x7f93381542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 0x7f93380cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f932ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93380b6100 0x7f9338158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 0x7f93380cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:47198/0 (socket says 172.21.15.71:47198) 2023-07-06T01:08:28.508 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 -- 172.21.15.71:0/1199370059 learned_addr learned my addr 172.21.15.71:0/1199370059 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 -- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93380b6100 msgr2=0x7f9338158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93380b6100 0x7f9338158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 -- 172.21.15.71:0/1199370059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f933815fca0 msgr2=0x7f93381542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f933815fca0 0x7f93381542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f933659c700 1 -- 172.21.15.71:0/1199370059 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330009b30 con 0x7f93380b5c90 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.502+0000 7f9336d9d700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f933815fca0 0x7f93381542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f933659c700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 0x7f93380cc420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f932800e870 tx=0x7f932800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:28.509 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328009590 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328013680 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280139f0 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93380caa70 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93380b86a0 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f932801c450 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.503+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f932801cdd0 con 0x7f93380b5c90 2023-07-06T01:08:28.510 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.504+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933815c570 con 0x7f93380b5c90 2023-07-06T01:08:28.511 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.506+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9328021060 con 0x7f93380b5c90 2023-07-06T01:08:28.563 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:28.561+0000 7f06576f7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T01:08:28.582 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.578+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93380008d0 con 0x7f93380b5c90 2023-07-06T01:08:28.582 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.579+0000 7f932effd700 1 -- 172.21.15.71:0/1199370059 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f932802a090 con 0x7f93380b5c90 2023-07-06T01:08:28.582 INFO:teuthology.misc.health.smithi071.stdout: 2023-07-06T01:08:28.583 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:27.048735+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:28.583 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.580+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 msgr2=0x7f93380cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:28.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.580+0000 7f933cdff700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 0x7f93380cc420 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f932800e870 tx=0x7f932800eb80 comp rx=0 tx=0).stop 2023-07-06T01:08:28.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 shutdown_connections 2023-07-06T01:08:28.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f933815fca0 0x7f93381542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93380b5c90 0x7f93380cc420 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 --2- 172.21.15.71:0/1199370059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93380b6100 0x7f9338158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:28.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 >> 172.21.15.71:0/1199370059 conn(0x7f933806c150 msgr2=0x7f93380d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:28.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 shutdown_connections 2023-07-06T01:08:28.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:28.581+0000 7f933cdff700 1 -- 172.21.15.71:0/1199370059 wait complete. 2023-07-06T01:08:28.598 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-06T01:08:28.657 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:28.655+0000 7f06576f7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T01:08:28.980 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:28.978+0000 7f56128e2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T01:08:29.278 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:29.276+0000 7f06576f7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T01:08:29.363 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:29.362+0000 7f56128e2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T01:08:29.547 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:29.545+0000 7f56128e2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T01:08:29.657 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:29.655+0000 7f06576f7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T01:08:29.840 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:29.836+0000 7f06576f7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T01:08:29.987 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:29.985+0000 7f56128e2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T01:08:30.171 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:30.170+0000 7f56128e2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T01:08:30.300 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:30.298+0000 7f06576f7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T01:08:30.384 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:30.382+0000 7f56128e2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T01:08:30.495 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:30.492+0000 7f06576f7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T01:08:30.782 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:30.779+0000 7f06576f7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T01:08:30.804 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:30.802+0000 7f56128e2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T01:08:31.169 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-07-06T01:08:31.167+0000 7f06576f7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T01:08:31.331 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-07-06T01:08:31.329+0000 7fc152352640 -1 osd.5 0 log_to_monitors true 2023-07-06T01:08:31.348 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-07-06T01:08:31.346+0000 7fd359d38640 -1 osd.0 0 log_to_monitors true 2023-07-06T01:08:31.371 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-07-06T01:08:31.368+0000 7ff562e84640 -1 osd.1 0 log_to_monitors true 2023-07-06T01:08:31.372 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-07-06T01:08:31.370+0000 7ff2dc864640 -1 osd.2 0 log_to_monitors true 2023-07-06T01:08:31.407 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-07-06T01:08:31.405+0000 7fe86d213640 -1 osd.6 0 log_to_monitors true 2023-07-06T01:08:31.600 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-07-06T01:08:31.599+0000 7f6aaa966640 -1 osd.4 0 log_to_monitors true 2023-07-06T01:08:31.654 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-07-06T01:08:31.652+0000 7fc60a292640 -1 osd.7 0 log_to_monitors true 2023-07-06T01:08:31.675 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-07-06T01:08:31.673+0000 7fd3689da640 -1 osd.3 0 log_to_monitors true 2023-07-06T01:08:31.827 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:31.826+0000 7f55cc1fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-06T01:08:31.828 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-07-06T01:08:31.826+0000 7f55cc1fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-06T01:08:34.872 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-07-06T01:08:34.869+0000 7fd3483f6700 -1 osd.0 0 waiting for initial osdmap 2023-07-06T01:08:34.890 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-07-06T01:08:34.888+0000 7fd3403fb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:34.980 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-07-06T01:08:34.978+0000 7ff2caff6700 -1 osd.2 0 waiting for initial osdmap 2023-07-06T01:08:34.994 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-07-06T01:08:34.992+0000 7ff2c2ffb700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.029 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-07-06T01:08:35.027+0000 7f6a98ff6700 -1 osd.4 0 waiting for initial osdmap 2023-07-06T01:08:35.040 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-07-06T01:08:35.038+0000 7fd3587f9700 -1 osd.3 0 waiting for initial osdmap 2023-07-06T01:08:35.050 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-07-06T01:08:35.048+0000 7fd34effb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.052 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-07-06T01:08:35.049+0000 7fc5fa1f9700 -1 osd.7 0 waiting for initial osdmap 2023-07-06T01:08:35.056 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-07-06T01:08:35.053+0000 7f6a90ffb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.065 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-07-06T01:08:35.062+0000 7fc5f09fb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.065 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-07-06T01:08:35.059+0000 7ff5515f6700 -1 osd.1 0 waiting for initial osdmap 2023-07-06T01:08:35.075 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-07-06T01:08:35.072+0000 7fc1409f6700 -1 osd.5 0 waiting for initial osdmap 2023-07-06T01:08:35.076 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-07-06T01:08:35.074+0000 7ff5495fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.077 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-07-06T01:08:35.075+0000 7fe85b9f6700 -1 osd.6 0 waiting for initial osdmap 2023-07-06T01:08:35.087 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-07-06T01:08:35.085+0000 7fc1389fb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.095 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-07-06T01:08:35.093+0000 7fe8539fb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T01:08:35.404 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:35.575 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.572+0000 7fb3083ff700 1 Processor -- start 2023-07-06T01:08:35.576 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.573+0000 7fb3083ff700 1 -- start start 2023-07-06T01:08:35.577 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb3083ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb30015fca0 0x7fb3000d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:35.577 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb3083ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3000b5c90 0x7fb3000d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:35.577 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb3083ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000cf780 con 0x7fb3000b60e0 2023-07-06T01:08:35.577 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb3083ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3000cd490 con 0x7fb30015fca0 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb3083ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000cd770 con 0x7fb3000b5c90 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb30015fca0 0x7fb3000d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb30015fca0 0x7fb3000d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34564/0 (socket says 172.21.15.71:34564) 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 -- 172.21.15.71:0/2246312202 learned_addr learned my addr 172.21.15.71:0/2246312202 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30599a700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3000b5c90 0x7fb3000d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 -- 172.21.15.71:0/2246312202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3000b5c90 msgr2=0x7fb3000d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:35.578 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3000b5c90 0x7fb3000d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.579 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 -- 172.21.15.71:0/2246312202 >> v1:172.21.15.194:6789/0 conn(0x7fb3000b60e0 legacy=0x7fb3000cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:35.579 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30619b700 1 -- 172.21.15.71:0/2246312202 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000cda50 con 0x7fb30015fca0 2023-07-06T01:08:35.579 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.574+0000 7fb30599a700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3000b5c90 0x7fb3000d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:35.579 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.575+0000 7fb30619b700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb30015fca0 0x7fb3000d1420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0098f0 tx=0x7fb2fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befe126b38e1686 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:35.580 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.575+0000 7fb305199700 1 -- 172.21.15.71:0/2246312202 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00b8a0 con 0x7fb30015fca0 2023-07-06T01:08:35.580 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.575+0000 7fb305199700 1 -- 172.21.15.71:0/2246312202 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00ba00 con 0x7fb30015fca0 2023-07-06T01:08:35.580 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.575+0000 7fb305199700 1 -- 172.21.15.71:0/2246312202 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00bd90 con 0x7fb30015fca0 2023-07-06T01:08:35.581 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.575+0000 7fb3083ff700 1 -- 172.21.15.71:0/2246312202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb30015fca0 msgr2=0x7fb3000d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:35.581 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.575+0000 7fb3083ff700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb30015fca0 0x7fb3000d1420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0098f0 tx=0x7fb2fc009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:35.581 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.576+0000 7fb3083ff700 1 -- 172.21.15.71:0/2246312202 shutdown_connections 2023-07-06T01:08:35.581 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.576+0000 7fb3083ff700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb30015fca0 0x7fb3000d1420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.581 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.576+0000 7fb3083ff700 1 --2- 172.21.15.71:0/2246312202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3000b5c90 0x7fb3000d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.582 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.576+0000 7fb3083ff700 1 -- 172.21.15.71:0/2246312202 >> 172.21.15.71:0/2246312202 conn(0x7fb30006c150 msgr2=0x7fb30006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:35.582 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.576+0000 7fb3083ff700 1 -- 172.21.15.71:0/2246312202 shutdown_connections 2023-07-06T01:08:35.582 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.576+0000 7fb3083ff700 1 -- 172.21.15.71:0/2246312202 wait complete. 2023-07-06T01:08:35.582 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.578+0000 7fb3083ff700 1 Processor -- start 2023-07-06T01:08:35.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.578+0000 7fb3083ff700 1 -- start start 2023-07-06T01:08:35.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.579+0000 7fb3083ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3000b5c90 0x7fb3001e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:35.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.579+0000 7fb3083ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 0x7fb300156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:35.584 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.579+0000 7fb3083ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb30015fca0 0x7fb3001e7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.579+0000 7fb3083ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001e64c0 con 0x7fb3000b60e0 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.579+0000 7fb3083ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001e67a0 con 0x7fb3000b5c90 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.579+0000 7fb3083ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3001e6a80 con 0x7fb30015fca0 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 0x7fb300156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 0x7fb300156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34568/0 (socket says 172.21.15.71:34568) 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 -- 172.21.15.71:0/3455757820 learned_addr learned my addr 172.21.15.71:0/3455757820 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:35.585 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30619b700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3000b5c90 0x7fb3001e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30699c700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb30015fca0 0x7fb3001e7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 -- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb30015fca0 msgr2=0x7fb3001e7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb30015fca0 0x7fb3001e7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 -- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3000b5c90 msgr2=0x7fb3001e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3000b5c90 0x7fb3001e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 -- 172.21.15.71:0/3455757820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc009550 con 0x7fb3000b60e0 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb30599a700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 0x7fb300156cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000e810 tx=0x7fb2f000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:35.586 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.580+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0004230 con 0x7fb3000b60e0 2023-07-06T01:08:35.587 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.581+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0004390 con 0x7fb3000b60e0 2023-07-06T01:08:35.587 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.581+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3001e6d60 con 0x7fb3000b60e0 2023-07-06T01:08:35.587 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.581+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00036a0 con 0x7fb3000b60e0 2023-07-06T01:08:35.587 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.581+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3001574a0 con 0x7fb3000b60e0 2023-07-06T01:08:35.587 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.582+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3001e7280 con 0x7fb3000b60e0 2023-07-06T01:08:35.588 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.583+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fb2f0003800 con 0x7fb3000b60e0 2023-07-06T01:08:35.588 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.584+0000 7fb2f6ffd700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb2e406ac50 0x7fb2e406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:35.588 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.584+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fb2f00880a0 con 0x7fb3000b60e0 2023-07-06T01:08:35.588 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.584+0000 7fb30619b700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb2e406ac50 0x7fb2e406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:35.588 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.584+0000 7fb30619b700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb2e406ac50 0x7fb2e406d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc014040 tx=0x7fb2fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:35.591 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.589+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3001e7280 con 0x7fb3000b60e0 2023-07-06T01:08:35.787 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.784+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3001e7280 con 0x7fb3000b60e0 2023-07-06T01:08:35.787 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.785+0000 7fb2f6ffd700 1 -- 172.21.15.71:0/3455757820 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb3001e7280 con 0x7fb3000b60e0 2023-07-06T01:08:35.788 INFO:teuthology.misc.health.smithi071.stdout: 2023-07-06T01:08:35.788 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":12,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:32.872021+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:35.790 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb2e406ac50 msgr2=0x7fb2e406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:35.791 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb2e406ac50 0x7fb2e406d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc014040 tx=0x7fb2fc008030 comp rx=0 tx=0).stop 2023-07-06T01:08:35.791 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 msgr2=0x7fb300156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:35.791 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 0x7fb300156cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000e810 tx=0x7fb2f000ebd0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.792 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 shutdown_connections 2023-07-06T01:08:35.792 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb2e406ac50 0x7fb2e406d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.792 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb30015fca0 0x7fb3001e7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.792 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3000b5c90 0x7fb3001e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.792 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 --2- 172.21.15.71:0/3455757820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3000b60e0 0x7fb300156cc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:35.792 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 >> 172.21.15.71:0/3455757820 conn(0x7fb30006c150 msgr2=0x7fb30015a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:35.793 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 shutdown_connections 2023-07-06T01:08:35.793 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:35.787+0000 7fb3083ff700 1 -- 172.21.15.71:0/3455757820 wait complete. 2023-07-06T01:08:35.805 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-06T01:08:42.605 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:08:42.610 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:08:42.611 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:42.826 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.824+0000 7f6350dff700 1 Processor -- start 2023-07-06T01:08:42.827 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.824+0000 7f6350dff700 1 -- start start 2023-07-06T01:08:42.828 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.825+0000 7f6350dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f634c0b6110 0x7f634c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:42.828 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.825+0000 7f6350dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0cf780 con 0x7f634c15fca0 2023-07-06T01:08:42.828 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.825+0000 7f6350dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0cd490 con 0x7f634c0b5c90 2023-07-06T01:08:42.828 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.825+0000 7f6350dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0cd770 con 0x7f634c0b6110 2023-07-06T01:08:42.829 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f634a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f634c15fca0 0x7f634c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49728/0 (socket says 172.21.15.71:49728) 2023-07-06T01:08:42.829 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f634a59c700 1 -- 172.21.15.71:0/1069961776 learned_addr learned my addr 172.21.15.71:0/1069961776 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:42.829 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f634ad9d700 1 --2- 172.21.15.71:0/1069961776 >> v2:172.21.15.194:3300/0 conn(0x7f634c0b6110 0x7f634c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:42.830 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376716872 0 0) 0x7f634c0cf780 con 0x7f634c15fca0 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63380035b0 con 0x7f634c15fca0 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646732535 0 0) 0x7f634c0cd490 con 0x7f634c0b5c90 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f634c0cf780 con 0x7f634c0b5c90 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f634ad9d700 1 -- 172.21.15.71:0/1069961776 >> v1:172.21.15.194:6789/0 conn(0x7f634c0b5c90 legacy=0x7f634c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f634ad9d700 1 -- 172.21.15.71:0/1069961776 >> v1:172.21.15.71:6789/0 conn(0x7f634c15fca0 legacy=0x7f634c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835313051 0 0) 0x7f63380035b0 con 0x7f634c15fca0 2023-07-06T01:08:42.831 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.826+0000 7f634ad9d700 1 -- 172.21.15.71:0/1069961776 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0cda50 con 0x7f634c0b6110 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f634ad9d700 1 --2- 172.21.15.71:0/1069961776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cfc10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6344009d90 tx=0x7f634400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d528b902f4756f01 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400e070 con 0x7f634c0b6110 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634400bb20 con 0x7f634c0b6110 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6349d9b700 1 -- 172.21.15.71:0/1069961776 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400bed0 con 0x7f634c0b6110 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6350dff700 1 -- 172.21.15.71:0/1069961776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 msgr2=0x7f634c0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6350dff700 1 --2- 172.21.15.71:0/1069961776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cfc10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6344009d90 tx=0x7f634400b330 comp rx=0 tx=0).stop 2023-07-06T01:08:42.832 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6350dff700 1 -- 172.21.15.71:0/1069961776 shutdown_connections 2023-07-06T01:08:42.833 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6350dff700 1 --2- 172.21.15.71:0/1069961776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cfc10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:42.833 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6350dff700 1 -- 172.21.15.71:0/1069961776 >> 172.21.15.71:0/1069961776 conn(0x7f634c06c150 msgr2=0x7f634c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:42.833 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.827+0000 7f6350dff700 1 -- 172.21.15.71:0/1069961776 shutdown_connections 2023-07-06T01:08:42.833 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.828+0000 7f6350dff700 1 -- 172.21.15.71:0/1069961776 wait complete. 2023-07-06T01:08:42.835 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.829+0000 7f6350dff700 1 Processor -- start 2023-07-06T01:08:42.835 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.829+0000 7f6350dff700 1 -- start start 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f6350dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 0x7f634c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f6350dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f6350dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f634c15fca0 0x7f634c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f6350dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1550f0 con 0x7f634c0b5c90 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f6350dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1f1c70 con 0x7f634c0b6110 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f6350dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1f1f50 con 0x7f634c15fca0 2023-07-06T01:08:42.836 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f634a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 0x7f634c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f634a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 0x7f634c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:34572/0 (socket says 172.21.15.71:34572) 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.830+0000 7f634a59c700 1 -- 172.21.15.71:0/1434477816 learned_addr learned my addr 172.21.15.71:0/1434477816 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6343fff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634ad9d700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f634c15fca0 0x7f634c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634a59c700 1 -- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f634c15fca0 msgr2=0x7f634c15a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634a59c700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f634c15fca0 0x7f634c15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:42.837 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634a59c700 1 -- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 msgr2=0x7f634c0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634a59c700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634a59c700 1 -- 172.21.15.71:0/1434477816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009a70 con 0x7f634c0b5c90 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6343fff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f634a59c700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 0x7f634c151210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c4b0 tx=0x7f633c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c005d70 con 0x7f634c0b5c90 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0070d0 con 0x7f634c0b5c90 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c007460 con 0x7f634c0b5c90 2023-07-06T01:08:42.838 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c1f2230 con 0x7f634c0b5c90 2023-07-06T01:08:42.839 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.831+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c151750 con 0x7f634c0b5c90 2023-07-06T01:08:42.839 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.832+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c1f2840 con 0x7f634c0b5c90 2023-07-06T01:08:42.839 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.833+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f633c0075c0 con 0x7f634c0b5c90 2023-07-06T01:08:42.840 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.834+0000 7f6342ffd700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f632c06ace0 0x7f632c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:42.840 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.834+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f633c088590 con 0x7f634c0b5c90 2023-07-06T01:08:42.840 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.835+0000 7f6343fff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f632c06ace0 0x7f632c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:42.840 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.835+0000 7f6343fff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f632c06ace0 0x7f632c06d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f634c0c6810 tx=0x7f6334009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:42.841 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:42.839+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f633c053a50 con 0x7f634c0b5c90 2023-07-06T01:08:43.036 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.034+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f634c0008d0 con 0x7f634c0b5c90 2023-07-06T01:08:43.037 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.035+0000 7f6342ffd700 1 -- 172.21.15.71:0/1434477816 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f633c057070 con 0x7f634c0b5c90 2023-07-06T01:08:43.038 INFO:teuthology.misc.health.smithi071.stdout: 2023-07-06T01:08:43.038 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":16,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:39.138636+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:43.040 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f632c06ace0 msgr2=0x7f632c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.040 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f632c06ace0 0x7f632c06d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f634c0c6810 tx=0x7f6334009040 comp rx=0 tx=0).stop 2023-07-06T01:08:43.040 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 msgr2=0x7f634c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.040 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 0x7f634c151210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f633c00c4b0 tx=0x7f633c00c870 comp rx=0 tx=0).stop 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 shutdown_connections 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f632c06ace0 0x7f632c06d190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f634c15fca0 0x7f634c15a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f634c0b5c90 0x7f634c151210 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 --2- 172.21.15.71:0/1434477816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f634c0b6110 0x7f634c0cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 >> 172.21.15.71:0/1434477816 conn(0x7f634c06c150 msgr2=0x7f634c0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:43.041 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.037+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 shutdown_connections 2023-07-06T01:08:43.042 INFO:teuthology.misc.health.smithi071.stderr:2023-07-06T01:08:43.038+0000 7f6350dff700 1 -- 172.21.15.71:0/1434477816 wait complete. 2023-07-06T01:08:43.055 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-06T01:08:43.056 INFO:tasks.ceph:Creating RBD pool 2023-07-06T01:08:43.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-06T01:08:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.245+0000 7f7059fff700 1 Processor -- start 2023-07-06T01:08:43.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.245+0000 7f7059fff700 1 -- start start 2023-07-06T01:08:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.246+0000 7f7059fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70540b5c90 0x7f70540d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.246+0000 7f7059fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540cf780 con 0x7f70540b6110 2023-07-06T01:08:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7059fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540cd490 con 0x7f705415fca0 2023-07-06T01:08:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7059fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70540cd770 con 0x7f70540b5c90 2023-07-06T01:08:43.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7053fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f70540b6110 0x7f70540cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40270/0 (socket says 172.21.15.71:40270) 2023-07-06T01:08:43.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7053fff700 1 -- 172.21.15.71:0/2187928370 learned_addr learned my addr 172.21.15.71:0/2187928370 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7052ffd700 1 --2- 172.21.15.71:0/2187928370 >> v2:172.21.15.194:3300/0 conn(0x7f70540b5c90 0x7f70540d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f70527fc700 1 -- 172.21.15.71:0/2187928370 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700917366 0 0) 0x7f70540cf780 con 0x7f70540b6110 2023-07-06T01:08:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f70527fc700 1 -- 172.21.15.71:0/2187928370 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f703c0035b0 con 0x7f70540b6110 2023-07-06T01:08:43.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f70527fc700 1 -- 172.21.15.71:0/2187928370 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3160692319 0 0) 0x7f703c0035b0 con 0x7f70540b6110 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7052ffd700 1 -- 172.21.15.71:0/2187928370 >> v1:172.21.15.194:6789/0 conn(0x7f705415fca0 legacy=0x7f70540d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7052ffd700 1 -- 172.21.15.71:0/2187928370 >> v1:172.21.15.71:6789/0 conn(0x7f70540b6110 legacy=0x7f70540cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.247+0000 7f7052ffd700 1 -- 172.21.15.71:0/2187928370 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540cda50 con 0x7f70540b5c90 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.248+0000 7f7052ffd700 1 --2- 172.21.15.71:0/2187928370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540d2d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7048009840 tx=0x7f7048009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42133e5f727beed5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.248+0000 7f70527fc700 1 -- 172.21.15.71:0/2187928370 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c0019f0 con 0x7f70540b5c90 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.248+0000 7f70527fc700 1 -- 172.21.15.71:0/2187928370 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048004030 con 0x7f70540b5c90 2023-07-06T01:08:43.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.248+0000 7f70527fc700 1 -- 172.21.15.71:0/2187928370 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480043c0 con 0x7f70540b5c90 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.248+0000 7f7059fff700 1 -- 172.21.15.71:0/2187928370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 msgr2=0x7f70540d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.248+0000 7f7059fff700 1 --2- 172.21.15.71:0/2187928370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540d2d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7048009840 tx=0x7f7048009b50 comp rx=0 tx=0).stop 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.249+0000 7f7059fff700 1 -- 172.21.15.71:0/2187928370 shutdown_connections 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.249+0000 7f7059fff700 1 --2- 172.21.15.71:0/2187928370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540d2d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.249+0000 7f7059fff700 1 -- 172.21.15.71:0/2187928370 >> 172.21.15.71:0/2187928370 conn(0x7f705406c150 msgr2=0x7f705406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.249+0000 7f7059fff700 1 -- 172.21.15.71:0/2187928370 shutdown_connections 2023-07-06T01:08:43.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.249+0000 7f7059fff700 1 -- 172.21.15.71:0/2187928370 wait complete. 2023-07-06T01:08:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.250+0000 7f7059fff700 1 Processor -- start 2023-07-06T01:08:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.250+0000 7f7059fff700 1 -- start start 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.251+0000 7f7059fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.251+0000 7f7059fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 0x7f7054157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.251+0000 7f7059fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f705415fca0 0x7f70540cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.251+0000 7f7059fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540ccb50 con 0x7f70540b6110 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.251+0000 7f7059fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70541f1f70 con 0x7f70540b5c90 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.251+0000 7f7059fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70541f2ab0 con 0x7f705415fca0 2023-07-06T01:08:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 0x7f7054157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 0x7f7054157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35918/0 (socket says 172.21.15.71:35918) 2023-07-06T01:08:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 -- 172.21.15.71:0/1426501696 learned_addr learned my addr 172.21.15.71:0/1426501696 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f70537fe700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7053fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f705415fca0 0x7f70540cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 -- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f705415fca0 msgr2=0x7f70540cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f705415fca0 0x7f70540cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 -- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 msgr2=0x7f70540cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 -- 172.21.15.71:0/1426501696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480094a0 con 0x7f70540b6110 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f7052ffd700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 0x7f7054157480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f70480090b0 tx=0x7f7048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.252+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048011830 con 0x7f70540b6110 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.253+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704801f070 con 0x7f70540b6110 2023-07-06T01:08:43.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.253+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70541f2f40 con 0x7f70540b6110 2023-07-06T01:08:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.253+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048011bd0 con 0x7f70540b6110 2023-07-06T01:08:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.253+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70541f2460 con 0x7f70540b6110 2023-07-06T01:08:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.254+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70540008d0 con 0x7f70540b6110 2023-07-06T01:08:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.255+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7048011d30 con 0x7f70540b6110 2023-07-06T01:08:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.256+0000 7f703bfff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f704006ace0 0x7f704006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.256+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7048021070 con 0x7f70540b6110 2023-07-06T01:08:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.256+0000 7f70537fe700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f704006ace0 0x7f704006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.256+0000 7f70537fe700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f704006ace0 0x7f704006d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f70540c8b20 tx=0x7f7044009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:43.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.260+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7048055fd0 con 0x7f70540b6110 2023-07-06T01:08:43.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:43.457+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f70541f2bf0 con 0x7f70540b6110 2023-07-06T01:08:44.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.163+0000 7f703bfff700 1 -- 172.21.15.71:0/1426501696 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f70480595f0 con 0x7f70540b6110 2023-07-06T01:08:44.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f704006ace0 msgr2=0x7f704006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:44.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f704006ace0 0x7f704006d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f70540c8b20 tx=0x7f7044009040 comp rx=0 tx=0).stop 2023-07-06T01:08:44.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 msgr2=0x7f7054157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:44.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 0x7f7054157480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f70480090b0 tx=0x7f7048004750 comp rx=0 tx=0).stop 2023-07-06T01:08:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 shutdown_connections 2023-07-06T01:08:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f704006ace0 0x7f704006d190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f705415fca0 0x7f70540cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70540b5c90 0x7f70540cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 --2- 172.21.15.71:0/1426501696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70540b6110 0x7f7054157480 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 >> 172.21.15.71:0/1426501696 conn(0x7f705406c150 msgr2=0x7f705415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 shutdown_connections 2023-07-06T01:08:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.166+0000 7f7059fff700 1 -- 172.21.15.71:0/1426501696 wait complete. 2023-07-06T01:08:44.171 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2023-07-06T01:08:44.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-06T01:08:44.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.378+0000 7fc8499ff700 1 Processor -- start 2023-07-06T01:08:44.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.378+0000 7fc8499ff700 1 -- start start 2023-07-06T01:08:44.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.379+0000 7fc8499ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:44.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.379+0000 7fc8499ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8440b2180 0x7fc8440d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:44.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.379+0000 7fc8499ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc844160cc0 con 0x7fc8440b8440 2023-07-06T01:08:44.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.379+0000 7fc8499ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc844160ae0 con 0x7fc8440b2180 2023-07-06T01:08:44.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.379+0000 7fc8499ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc844160f80 con 0x7fc8440cfe40 2023-07-06T01:08:44.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8440b2180 0x7fc8440d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:44.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8440b2180 0x7fc8440d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:38708/0 (socket says 172.21.15.71:38708) 2023-07-06T01:08:44.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8427fc700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:44.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 -- 172.21.15.71:0/3738706540 learned_addr learned my addr 172.21.15.71:0/3738706540 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc842ffd700 1 --1- 172.21.15.71:0/3738706540 >> v1:172.21.15.194:6789/0 conn(0x7fc8440b8440 0x7fc8440cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:55600/0 (socket says 172.21.15.71:55600) 2023-07-06T01:08:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 -- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 msgr2=0x7fc8440cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 --2- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 -- 172.21.15.71:0/3738706540 >> v1:172.21.15.194:6789/0 conn(0x7fc8440b8440 legacy=0x7fc8440cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 -- 172.21.15.71:0/3738706540 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440cf0e0 con 0x7fc8440b2180 2023-07-06T01:08:44.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8427fc700 1 --2- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.380+0000 7fc8437fe700 1 --2- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b2180 0x7fc8440d0960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e50 tx=0x7fc83c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e475fe4e6b499f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc841ffb700 1 -- 172.21.15.71:0/3738706540 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00e070 con 0x7fc8440b2180 2023-07-06T01:08:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc841ffb700 1 -- 172.21.15.71:0/3738706540 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c00b910 con 0x7fc8440b2180 2023-07-06T01:08:44.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc841ffb700 1 -- 172.21.15.71:0/3738706540 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00bcc0 con 0x7fc8440b2180 2023-07-06T01:08:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 -- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b2180 msgr2=0x7fc8440d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b2180 0x7fc8440d0960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009e50 tx=0x7fc83c00b330 comp rx=0 tx=0).stop 2023-07-06T01:08:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 -- 172.21.15.71:0/3738706540 shutdown_connections 2023-07-06T01:08:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b2180 0x7fc8440d0960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3738706540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 -- 172.21.15.71:0/3738706540 >> 172.21.15.71:0/3738706540 conn(0x7fc84406be10 msgr2=0x7fc844071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:44.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 -- 172.21.15.71:0/3738706540 shutdown_connections 2023-07-06T01:08:44.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.381+0000 7fc8499ff700 1 -- 172.21.15.71:0/3738706540 wait complete. 2023-07-06T01:08:44.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.383+0000 7fc8499ff700 1 Processor -- start 2023-07-06T01:08:44.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.383+0000 7fc8499ff700 1 -- start start 2023-07-06T01:08:44.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc8499ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 0x7fc8440cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:44.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc8499ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b8440 0x7fc8441e7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc8499ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc8499ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c9f90 con 0x7fc8440b2180 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc8499ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ca270 con 0x7fc8440b8440 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc8499ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ca550 con 0x7fc8440cfe40 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 0x7fc8440cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc842ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 0x7fc8440cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35924/0 (socket says 172.21.15.71:35924) 2023-07-06T01:08:44.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.384+0000 7fc842ffd700 1 -- 172.21.15.71:0/3708611051 learned_addr learned my addr 172.21.15.71:0/3708611051 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc8437fe700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc8427fc700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b8440 0x7fc8441e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc842ffd700 1 -- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 msgr2=0x7fc8440b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc842ffd700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440b2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc842ffd700 1 -- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b8440 msgr2=0x7fc8441e7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc842ffd700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b8440 0x7fc8441e7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc842ffd700 1 -- 172.21.15.71:0/3708611051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380094a0 con 0x7fc8440b2180 2023-07-06T01:08:44.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc842ffd700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 0x7fc8440cb030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c520 tx=0x7fc83400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:44.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834005cb0 con 0x7fc8440b2180 2023-07-06T01:08:44.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc834005e10 con 0x7fc8440b2180 2023-07-06T01:08:44.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340072d0 con 0x7fc8440b2180 2023-07-06T01:08:44.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c009b30 con 0x7fc8440b2180 2023-07-06T01:08:44.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.385+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440cab10 con 0x7fc8440b2180 2023-07-06T01:08:44.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.386+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8440008d0 con 0x7fc8440b2180 2023-07-06T01:08:44.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.388+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc834007430 con 0x7fc8440b2180 2023-07-06T01:08:44.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.388+0000 7fc82bfff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc83006ace0 0x7fc83006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:44.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.388+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fc8340889c0 con 0x7fc8440b2180 2023-07-06T01:08:44.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.389+0000 7fc8427fc700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc83006ace0 0x7fc83006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:44.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.389+0000 7fc8427fc700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc83006ace0 0x7fc83006d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc8440b36b0 tx=0x7fc838008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:44.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.392+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc834053ef0 con 0x7fc8440b2180 2023-07-06T01:08:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:44.587+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc8440caca0 con 0x7fc8440b2180 2023-07-06T01:08:45.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.175+0000 7fc82bfff700 1 -- 172.21.15.71:0/3708611051 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc8340210c0 con 0x7fc8440b2180 2023-07-06T01:08:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc83006ace0 msgr2=0x7fc83006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc83006ace0 0x7fc83006d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc8440b36b0 tx=0x7fc838008040 comp rx=0 tx=0).stop 2023-07-06T01:08:45.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 msgr2=0x7fc8440cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 0x7fc8440cb030 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c520 tx=0x7fc83400c8e0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 shutdown_connections 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc83006ace0 0x7fc83006d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8440cfe40 0x7fc8440b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc8440b2180 0x7fc8440cb030 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 --2- 172.21.15.71:0/3708611051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8440b8440 0x7fc8441e7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.178+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 >> 172.21.15.71:0/3708611051 conn(0x7fc84406be10 msgr2=0x7fc84415ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:45.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.179+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 shutdown_connections 2023-07-06T01:08:45.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.179+0000 7fc8499ff700 1 -- 172.21.15.71:0/3708611051 wait complete. 2023-07-06T01:08:45.183 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-06T01:08:45.202 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-06T01:08:45.203 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T01:08:45.203 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T01:08:45.208 INFO:tasks.ceph.mds.a:Started 2023-07-06T01:08:45.208 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T01:08:45.208 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T01:08:45.212 INFO:tasks.ceph.mds.c:Started 2023-07-06T01:08:45.212 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T01:08:45.213 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T01:08:45.217 INFO:tasks.ceph.mds.b:Started 2023-07-06T01:08:45.218 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T01:08:45.218 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T01:08:45.222 INFO:tasks.ceph.mds.d:Started 2023-07-06T01:08:45.222 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-06T01:08:45.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:45.354 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-07-06T01:08:45.359 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-07-06T01:08:45.372 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2023-07-06T01:08:45.372 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2023-07-06T01:08:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.427+0000 7f4df13ff700 1 Processor -- start 2023-07-06T01:08:45.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.428+0000 7f4df13ff700 1 -- start start 2023-07-06T01:08:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4df13ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4dec0b5c90 0x7f4dec0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4df13ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4dec0b6110 0x7f4dec0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4df13ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec0cf780 con 0x7f4dec15fca0 2023-07-06T01:08:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4df13ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0cd490 con 0x7f4dec0b6110 2023-07-06T01:08:45.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4df13ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0cd770 con 0x7f4dec0b5c90 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4dec0b6110 0x7f4dec0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4dec0b6110 0x7f4dec0d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35992/0 (socket says 172.21.15.71:35992) 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1827955773 learned_addr learned my addr 172.21.15.71:0/1827955773 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1827955773 >> v2:172.21.15.194:3300/0 conn(0x7f4dec0b5c90 msgr2=0x7f4dec0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 --2- 172.21.15.71:0/1827955773 >> v2:172.21.15.194:3300/0 conn(0x7f4dec0b5c90 0x7f4dec0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1827955773 >> v1:172.21.15.194:6789/0 conn(0x7f4dec15fca0 legacy=0x7f4dec0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:45.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.429+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1827955773 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0cda50 con 0x7f4dec0b6110 2023-07-06T01:08:45.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4deb7fe700 1 --2- 172.21.15.71:0/1827955773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec0b6110 0x7f4dec0d3280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dec06b6f0 tx=0x7f4de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fc6d3134d8484c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4dea7fc700 1 -- 172.21.15.71:0/1827955773 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400e070 con 0x7f4dec0b6110 2023-07-06T01:08:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4dea7fc700 1 -- 172.21.15.71:0/1827955773 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4003a20 con 0x7f4dec0b6110 2023-07-06T01:08:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4dea7fc700 1 -- 172.21.15.71:0/1827955773 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4003dd0 con 0x7f4dec0b6110 2023-07-06T01:08:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4df13ff700 1 -- 172.21.15.71:0/1827955773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec0b6110 msgr2=0x7f4dec0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1827955773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec0b6110 0x7f4dec0d3280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dec06b6f0 tx=0x7f4de400b330 comp rx=0 tx=0).stop 2023-07-06T01:08:45.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4df13ff700 1 -- 172.21.15.71:0/1827955773 shutdown_connections 2023-07-06T01:08:45.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1827955773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec0b6110 0x7f4dec0d3280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1827955773 >> v2:172.21.15.194:3300/0 conn(0x7f4dec0b5c90 0x7f4dec0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.430+0000 7f4df13ff700 1 -- 172.21.15.71:0/1827955773 >> 172.21.15.71:0/1827955773 conn(0x7f4dec06c150 msgr2=0x7f4dec06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:45.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.431+0000 7f4df13ff700 1 -- 172.21.15.71:0/1827955773 shutdown_connections 2023-07-06T01:08:45.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.431+0000 7f4df13ff700 1 -- 172.21.15.71:0/1827955773 wait complete. 2023-07-06T01:08:45.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.432+0000 7f4df13ff700 1 Processor -- start 2023-07-06T01:08:45.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.432+0000 7f4df13ff700 1 -- start start 2023-07-06T01:08:45.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.433+0000 7f4df13ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dec0b5c90 0x7f4dec1e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.433+0000 7f4df13ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0b6110 0x7f4dec0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.433+0000 7f4df13ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 0x7f4dec156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.433+0000 7f4df13ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0cae60 con 0x7f4dec15fca0 2023-07-06T01:08:45.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.433+0000 7f4df13ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec156fc0 con 0x7f4dec0b6110 2023-07-06T01:08:45.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.433+0000 7f4df13ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0cb100 con 0x7f4dec0b5c90 2023-07-06T01:08:45.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 0x7f4dec156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 0x7f4dec156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35996/0 (socket says 172.21.15.71:35996) 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1034778291 learned_addr learned my addr 172.21.15.71:0/1034778291 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4de3fff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0b6110 0x7f4dec0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deaffd700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dec0b5c90 0x7f4dec1e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dec0b5c90 msgr2=0x7f4dec1e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dec0b5c90 0x7f4dec1e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0b6110 msgr2=0x7f4dec0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0b6110 0x7f4dec0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 -- 172.21.15.71:0/1034778291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009b30 con 0x7f4dec15fca0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4deb7fe700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 0x7f4dec156a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4de4015040 tx=0x7f4de4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4004240 con 0x7f4dec15fca0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40043a0 con 0x7f4dec15fca0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4004750 con 0x7f4dec15fca0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.434+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec0cb3e0 con 0x7f4dec15fca0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.435+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec0cb9a0 con 0x7f4dec15fca0 2023-07-06T01:08:45.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.436+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec0008d0 con 0x7f4dec15fca0 2023-07-06T01:08:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.437+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4de4019070 con 0x7f4dec15fca0 2023-07-06T01:08:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.438+0000 7f4de37fe700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4dcc06ace0 0x7f4dcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.438+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4de408a160 con 0x7f4dec15fca0 2023-07-06T01:08:45.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.438+0000 7f4deaffd700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4dcc06ace0 0x7f4dcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.438+0000 7f4deaffd700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4dcc06ace0 0x7f4dcc06d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009870 tx=0x7f4ddc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:45.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.442+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4de4055570 con 0x7f4dec15fca0 2023-07-06T01:08:45.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.635+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dec066010 con 0x7f4dec15fca0 2023-07-06T01:08:45.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.636+0000 7f4de37fe700 1 -- 172.21.15.71:0/1034778291 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14625 (secure 0 0 0) 0x7f4de4007310 con 0x7f4dec15fca0 2023-07-06T01:08:45.639 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:45.639 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:45.167767+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4dcc06ace0 msgr2=0x7f4dcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4dcc06ace0 0x7f4dcc06d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009870 tx=0x7f4ddc008040 comp rx=0 tx=0).stop 2023-07-06T01:08:45.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 msgr2=0x7f4dec156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 0x7f4dec156a80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4de4015040 tx=0x7f4de4004ad0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 shutdown_connections 2023-07-06T01:08:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4dcc06ace0 0x7f4dcc06d190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4dec15fca0 0x7f4dec156a80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dec0b5c90 0x7f4dec1e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 --2- 172.21.15.71:0/1034778291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dec0b6110 0x7f4dec0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 >> 172.21.15.71:0/1034778291 conn(0x7f4dec06c150 msgr2=0x7f4dec0b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.638+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 shutdown_connections 2023-07-06T01:08:45.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.639+0000 7f4df13ff700 1 -- 172.21.15.71:0/1034778291 wait complete. 2023-07-06T01:08:45.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:08:45.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:08:45.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.856+0000 7fac027ff700 1 Processor -- start 2023-07-06T01:08:45.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.856+0000 7fac027ff700 1 -- start start 2023-07-06T01:08:45.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.857+0000 7fac027ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc15fca0 0x7fabfc0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.857+0000 7fac027ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fabfc0b5c90 0x7fabfc0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.857+0000 7fac027ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fabfc0b6100 0x7fabfc0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.857+0000 7fac027ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0cf780 con 0x7fabfc0b6100 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.857+0000 7fac027ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0cd490 con 0x7fabfc0b5c90 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.857+0000 7fac027ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0cd770 con 0x7fabfc15fca0 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fabfc0b6100 0x7fabfc0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fabfb7fe700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fabfc0b5c90 0x7fabfc0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fabfc0b6100 0x7fabfc0d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36012/0 (socket says 172.21.15.71:36012) 2023-07-06T01:08:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 -- 172.21.15.71:0/3568960143 learned_addr learned my addr 172.21.15.71:0/3568960143 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fabfbfff700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc15fca0 0x7fabfc0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 -- 172.21.15.71:0/3568960143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc15fca0 msgr2=0x7fabfc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc15fca0 0x7fabfc0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 -- 172.21.15.71:0/3568960143 >> v2:172.21.15.194:3300/0 conn(0x7fabfc0b5c90 msgr2=0x7fabfc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:45.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 --2- 172.21.15.71:0/3568960143 >> v2:172.21.15.194:3300/0 conn(0x7fabfc0b5c90 0x7fabfc0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 -- 172.21.15.71:0/3568960143 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0cda50 con 0x7fabfc0b6100 2023-07-06T01:08:45.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fabfbfff700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc15fca0 0x7fabfc0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:45.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.858+0000 7fac00d9c700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b6100 0x7fabfc0d3280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fabfc06cda0 tx=0x7fabf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c018dde840c13298 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:45.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fabfaffd700 1 -- 172.21.15.71:0/3568960143 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400e070 con 0x7fabfc0b6100 2023-07-06T01:08:45.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fabfaffd700 1 -- 172.21.15.71:0/3568960143 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400b910 con 0x7fabfc0b6100 2023-07-06T01:08:45.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fabfaffd700 1 -- 172.21.15.71:0/3568960143 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400bcc0 con 0x7fabfc0b6100 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 -- 172.21.15.71:0/3568960143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b6100 msgr2=0x7fabfc0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b6100 0x7fabfc0d3280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fabfc06cda0 tx=0x7fabf400b330 comp rx=0 tx=0).stop 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 -- 172.21.15.71:0/3568960143 shutdown_connections 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc15fca0 0x7fabfc0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 --2- 172.21.15.71:0/3568960143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b6100 0x7fabfc0d3280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 --2- 172.21.15.71:0/3568960143 >> v2:172.21.15.194:3300/0 conn(0x7fabfc0b5c90 0x7fabfc0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 -- 172.21.15.71:0/3568960143 >> 172.21.15.71:0/3568960143 conn(0x7fabfc06c150 msgr2=0x7fabfc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:45.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 -- 172.21.15.71:0/3568960143 shutdown_connections 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.859+0000 7fac027ff700 1 -- 172.21.15.71:0/3568960143 wait complete. 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.861+0000 7fac027ff700 1 Processor -- start 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.861+0000 7fac027ff700 1 -- start start 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac027ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 0x7fabfc1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac027ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc0b6100 0x7fabfc15d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac027ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc15fca0 0x7fabfc15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac027ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc157b60 con 0x7fabfc0b5c90 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac027ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc15a3c0 con 0x7fabfc15fca0 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac027ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc1f2c10 con 0x7fabfc0b6100 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fabfbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 0x7fabfc1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fabfbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 0x7fabfc1533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36024/0 (socket says 172.21.15.71:36024) 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fabfbfff700 1 -- 172.21.15.71:0/3667696521 learned_addr learned my addr 172.21.15.71:0/3667696521 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fac00d9c700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc15fca0 0x7fabfc15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.862+0000 7fabfb7fe700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc0b6100 0x7fabfc15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabfbfff700 1 -- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc0b6100 msgr2=0x7fabfc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabfbfff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc0b6100 0x7fabfc15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabfbfff700 1 -- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc15fca0 msgr2=0x7fabfc15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabfbfff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc15fca0 0x7fabfc15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabfbfff700 1 -- 172.21.15.71:0/3667696521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4009b30 con 0x7fabfc0b5c90 2023-07-06T01:08:45.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabfbfff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 0x7fabfc1533e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e810 tx=0x7fabec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00c020 con 0x7fabfc0b5c90 2023-07-06T01:08:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec004250 con 0x7fabfc0b5c90 2023-07-06T01:08:45.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc1f2ef0 con 0x7fabfc0b5c90 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0036a0 con 0x7fabfc0b5c90 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.863+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc159f50 con 0x7fabfc0b5c90 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.864+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc15b7f0 con 0x7fabfc0b5c90 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.865+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabec003800 con 0x7fabfc0b5c90 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.866+0000 7fabf8ff9700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fabe806ace0 0x7fabe806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.866+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fabec088ad0 con 0x7fabfc0b5c90 2023-07-06T01:08:45.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.867+0000 7fabfb7fe700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fabe806ace0 0x7fabe806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:45.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.867+0000 7fabfb7fe700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fabe806ace0 0x7fabe806d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabfc157380 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:45.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:45.870+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabec053f60 con 0x7fabfc0b5c90 2023-07-06T01:08:46.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.063+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabfc1f2a70 con 0x7fabfc0b5c90 2023-07-06T01:08:46.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.064+0000 7fabf8ff9700 1 -- 172.21.15.71:0/3667696521 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabfc1f2a70 con 0x7fabfc0b5c90 2023-07-06T01:08:46.067 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:08:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fabe806ace0 msgr2=0x7fabe806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fabe806ace0 0x7fabe806d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fabfc157380 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2023-07-06T01:08:46.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 msgr2=0x7fabfc1533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 0x7fabfc1533e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e810 tx=0x7fabec00eb20 comp rx=0 tx=0).stop 2023-07-06T01:08:46.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 shutdown_connections 2023-07-06T01:08:46.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fabe806ace0 0x7fabe806d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc15fca0 0x7fabfc15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fabfc0b5c90 0x7fabfc1533e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 --2- 172.21.15.71:0/3667696521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabfc0b6100 0x7fabfc15d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 >> 172.21.15.71:0/3667696521 conn(0x7fabfc06c150 msgr2=0x7fabfc0b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:46.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 shutdown_connections 2023-07-06T01:08:46.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.066+0000 7fac027ff700 1 -- 172.21.15.71:0/3667696521 wait complete. 2023-07-06T01:08:46.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:08:46.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.281+0000 7f668cbff700 1 Processor -- start 2023-07-06T01:08:46.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.281+0000 7f668cbff700 1 -- start start 2023-07-06T01:08:46.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.282+0000 7f668cbff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f668815fca0 0x7f66880d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.282+0000 7f668cbff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f66880b5c90 0x7f66880d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.282+0000 7f668cbff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66880b6100 0x7f66880d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.282+0000 7f668cbff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880cf780 con 0x7f66880b6100 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.282+0000 7f668cbff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880cd490 con 0x7f66880b5c90 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.282+0000 7f668cbff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880cd770 con 0x7f668815fca0 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66880b6100 0x7f66880d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66880b6100 0x7f66880d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36028/0 (socket says 172.21.15.71:36028) 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 -- 172.21.15.71:0/2357001738 learned_addr learned my addr 172.21.15.71:0/2357001738 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f667ffff700 1 --2- 172.21.15.71:0/2357001738 >> v2:172.21.15.194:3300/0 conn(0x7f66880b5c90 0x7f66880d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f668659c700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f668815fca0 0x7f66880d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 -- 172.21.15.71:0/2357001738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f668815fca0 msgr2=0x7f66880d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f668815fca0 0x7f66880d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 -- 172.21.15.71:0/2357001738 >> v2:172.21.15.194:3300/0 conn(0x7f66880b5c90 msgr2=0x7f66880d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 --2- 172.21.15.71:0/2357001738 >> v2:172.21.15.194:3300/0 conn(0x7f66880b5c90 0x7f66880d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 -- 172.21.15.71:0/2357001738 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880cda50 con 0x7f66880b6100 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f668659c700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f668815fca0 0x7f66880d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:46.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.283+0000 7f6686d9d700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66880b6100 0x7f66880d3280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f668806cda0 tx=0x7f668000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2ea402816963eb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:46.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f6685d9b700 1 -- 172.21.15.71:0/2357001738 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000e070 con 0x7f66880b6100 2023-07-06T01:08:46.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f6685d9b700 1 -- 172.21.15.71:0/2357001738 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668000b9c0 con 0x7f66880b6100 2023-07-06T01:08:46.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f6685d9b700 1 -- 172.21.15.71:0/2357001738 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000bd70 con 0x7f66880b6100 2023-07-06T01:08:46.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 -- 172.21.15.71:0/2357001738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66880b6100 msgr2=0x7f66880d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66880b6100 0x7f66880d3280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f668806cda0 tx=0x7f668000b330 comp rx=0 tx=0).stop 2023-07-06T01:08:46.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 -- 172.21.15.71:0/2357001738 shutdown_connections 2023-07-06T01:08:46.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f668815fca0 0x7f66880d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 --2- 172.21.15.71:0/2357001738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66880b6100 0x7f66880d3280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 --2- 172.21.15.71:0/2357001738 >> v2:172.21.15.194:3300/0 conn(0x7f66880b5c90 0x7f66880d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 -- 172.21.15.71:0/2357001738 >> 172.21.15.71:0/2357001738 conn(0x7f668806c150 msgr2=0x7f668806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 -- 172.21.15.71:0/2357001738 shutdown_connections 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.284+0000 7f668cbff700 1 -- 172.21.15.71:0/2357001738 wait complete. 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.287+0000 7f668cbff700 1 Processor -- start 2023-07-06T01:08:46.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.287+0000 7f668cbff700 1 -- start start 2023-07-06T01:08:46.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f668cbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66880b5c90 0x7f668814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f668cbff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66880b6100 0x7f66881f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f668cbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 0x7f668815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f668cbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b3820 con 0x7f668815fca0 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f668cbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b2ca0 con 0x7f66880b5c90 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f668cbff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b2f80 con 0x7f66880b6100 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f6686d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 0x7f668815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f6686d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 0x7f668815ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36034/0 (socket says 172.21.15.71:36034) 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.288+0000 7f6686d9d700 1 -- 172.21.15.71:0/1156275888 learned_addr learned my addr 172.21.15.71:0/1156275888 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f667ffff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66880b6100 0x7f66881f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f668659c700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66880b5c90 0x7f668814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f6686d9d700 1 -- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66880b6100 msgr2=0x7f66881f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f6686d9d700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66880b6100 0x7f66881f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f6686d9d700 1 -- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66880b5c90 msgr2=0x7f668814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f6686d9d700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66880b5c90 0x7f668814d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f6686d9d700 1 -- 172.21.15.71:0/1156275888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680009b30 con 0x7f668815fca0 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f668659c700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66880b5c90 0x7f668814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f6686d9d700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 0x7f668815ce40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6680012000 tx=0x7f6680004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800099b0 con 0x7f668815fca0 2023-07-06T01:08:46.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680004250 con 0x7f668815fca0 2023-07-06T01:08:46.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880b3260 con 0x7f668815fca0 2023-07-06T01:08:46.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680004600 con 0x7f668815fca0 2023-07-06T01:08:46.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.289+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668814d750 con 0x7f668815fca0 2023-07-06T01:08:46.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.291+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66880008d0 con 0x7f668815fca0 2023-07-06T01:08:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.292+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6680004760 con 0x7f668815fca0 2023-07-06T01:08:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.292+0000 7f667effd700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f666806ace0 0x7f666806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.293+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f668008a2c0 con 0x7f668815fca0 2023-07-06T01:08:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.293+0000 7f668659c700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f666806ace0 0x7f666806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.293+0000 7f668659c700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f666806ace0 0x7f666806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6678006fd0 tx=0x7f6678008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:46.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.297+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f66800556b0 con 0x7f668815fca0 2023-07-06T01:08:46.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.492+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66880b6dc0 con 0x7f668815fca0 2023-07-06T01:08:46.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.492+0000 7f667effd700 1 -- 172.21.15.71:0/1156275888 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6680058cd0 con 0x7f668815fca0 2023-07-06T01:08:46.495 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:08:46.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.494+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f666806ace0 msgr2=0x7f666806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.494+0000 7f668cbff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f666806ace0 0x7f666806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6678006fd0 tx=0x7f6678008040 comp rx=0 tx=0).stop 2023-07-06T01:08:46.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.494+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 msgr2=0x7f668815ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.494+0000 7f668cbff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 0x7f668815ce40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6680012000 tx=0x7f6680004ad0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.494+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 shutdown_connections 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f666806ace0 0x7f666806d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f668815fca0 0x7f668815ce40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66880b5c90 0x7f668814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 --2- 172.21.15.71:0/1156275888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66880b6100 0x7f66881f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 >> 172.21.15.71:0/1156275888 conn(0x7f668806c150 msgr2=0x7f66880d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:46.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 shutdown_connections 2023-07-06T01:08:46.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.495+0000 7f668cbff700 1 -- 172.21.15.71:0/1156275888 wait complete. 2023-07-06T01:08:46.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:08:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.705+0000 7f6b4ebff700 1 Processor -- start 2023-07-06T01:08:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.705+0000 7f6b4ebff700 1 -- start start 2023-07-06T01:08:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b4ebff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b4815fca0 0x7f6b480d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b4ebff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6b480b5c90 0x7f6b480d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b4ebff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b480b6110 0x7f6b480d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b4ebff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b480cf780 con 0x7f6b480b5c90 2023-07-06T01:08:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b4ebff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b480cd490 con 0x7f6b4815fca0 2023-07-06T01:08:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b4ebff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480cd770 con 0x7f6b480b6110 2023-07-06T01:08:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.706+0000 7f6b47fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6b480b5c90 0x7f6b480d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6b480b5c90 0x7f6b480d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36038/0 (socket says 172.21.15.71:36038) 2023-07-06T01:08:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 -- 172.21.15.71:0/4097239289 learned_addr learned my addr 172.21.15.71:0/4097239289 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:46.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b4d19c700 1 --2- 172.21.15.71:0/4097239289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b480b6110 0x7f6b480d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b4c99b700 1 --2- 172.21.15.71:0/4097239289 >> v2:172.21.15.194:3300/0 conn(0x7f6b4815fca0 0x7f6b480d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 -- 172.21.15.71:0/4097239289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b480b6110 msgr2=0x7f6b480d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 --2- 172.21.15.71:0/4097239289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b480b6110 0x7f6b480d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 -- 172.21.15.71:0/4097239289 >> v2:172.21.15.194:3300/0 conn(0x7f6b4815fca0 msgr2=0x7f6b480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 --2- 172.21.15.71:0/4097239289 >> v2:172.21.15.194:3300/0 conn(0x7f6b4815fca0 0x7f6b480d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 -- 172.21.15.71:0/4097239289 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480cda50 con 0x7f6b480b5c90 2023-07-06T01:08:46.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b4c99b700 1 --2- 172.21.15.71:0/4097239289 >> v2:172.21.15.194:3300/0 conn(0x7f6b4815fca0 0x7f6b480d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:46.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b47fff700 1 --2- 172.21.15.71:0/4097239289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b480d2d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6b480d0930 tx=0x7f6b34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa146d2bbdc8e560 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:46.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b477fe700 1 -- 172.21.15.71:0/4097239289 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400b870 con 0x7f6b480b5c90 2023-07-06T01:08:46.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b477fe700 1 -- 172.21.15.71:0/4097239289 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400b9d0 con 0x7f6b480b5c90 2023-07-06T01:08:46.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.707+0000 7f6b477fe700 1 -- 172.21.15.71:0/4097239289 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400bd60 con 0x7f6b480b5c90 2023-07-06T01:08:46.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 -- 172.21.15.71:0/4097239289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 msgr2=0x7f6b480d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/4097239289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b480d2d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6b480d0930 tx=0x7f6b34009bd0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 -- 172.21.15.71:0/4097239289 shutdown_connections 2023-07-06T01:08:46.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/4097239289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b480b6110 0x7f6b480d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/4097239289 >> v2:172.21.15.194:3300/0 conn(0x7f6b4815fca0 0x7f6b480d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/4097239289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b480d2d40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 -- 172.21.15.71:0/4097239289 >> 172.21.15.71:0/4097239289 conn(0x7f6b4806c150 msgr2=0x7f6b4806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:46.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 -- 172.21.15.71:0/4097239289 shutdown_connections 2023-07-06T01:08:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.708+0000 7f6b4ebff700 1 -- 172.21.15.71:0/4097239289 wait complete. 2023-07-06T01:08:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.711+0000 7f6b4ebff700 1 Processor -- start 2023-07-06T01:08:46.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.711+0000 7f6b4ebff700 1 -- start start 2023-07-06T01:08:46.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4ebff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b481f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4ebff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b480b6110 0x7f6b4815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4ebff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b4815fca0 0x7f6b4815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4ebff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4815ca00 con 0x7f6b480b5c90 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4ebff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4815bdf0 con 0x7f6b480b6110 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4ebff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4815c0d0 con 0x7f6b4815fca0 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b481f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4c99b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b481f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36054/0 (socket says 172.21.15.71:36054) 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.712+0000 7f6b4c99b700 1 -- 172.21.15.71:0/3261900189 learned_addr learned my addr 172.21.15.71:0/3261900189 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:46.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4c99b700 1 -- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b4815fca0 msgr2=0x7f6b4815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4c99b700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b4815fca0 0x7f6b4815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4c99b700 1 -- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b480b6110 msgr2=0x7f6b4815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4c99b700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b480b6110 0x7f6b4815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4c99b700 1 -- 172.21.15.71:0/3261900189 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009550 con 0x7f6b480b5c90 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4c99b700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b481f1610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00e810 tx=0x7f6b3c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c004230 con 0x7f6b480b5c90 2023-07-06T01:08:46.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c004390 con 0x7f6b480b5c90 2023-07-06T01:08:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0036a0 con 0x7f6b480b5c90 2023-07-06T01:08:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4815c3b0 con 0x7f6b480b5c90 2023-07-06T01:08:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.713+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b481579d0 con 0x7f6b480b5c90 2023-07-06T01:08:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.714+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4815cd90 con 0x7f6b480b5c90 2023-07-06T01:08:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.715+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b3c003800 con 0x7f6b480b5c90 2023-07-06T01:08:46.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.716+0000 7f6b457fa700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6b2c06ace0 0x7f6b2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:46.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.716+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b3c088ce0 con 0x7f6b480b5c90 2023-07-06T01:08:46.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.717+0000 7f6b47fff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6b2c06ace0 0x7f6b2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:46.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.717+0000 7f6b47fff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6b2c06ace0 0x7f6b2c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b4815dd00 tx=0x7f6b34010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:46.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.720+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b3c054040 con 0x7f6b480b5c90 2023-07-06T01:08:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.960+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b480008d0 con 0x7f6b480b5c90 2023-07-06T01:08:46.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.960+0000 7f6b457fa700 1 -- 172.21.15.71:0/3261900189 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f6b3c020de0 con 0x7f6b480b5c90 2023-07-06T01:08:46.963 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:46.963 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-06T01:08:46.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6b2c06ace0 msgr2=0x7f6b2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6b2c06ace0 0x7f6b2c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b4815dd00 tx=0x7f6b34010000 comp rx=0 tx=0).stop 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 msgr2=0x7f6b481f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b481f1610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00e810 tx=0x7f6b3c00ebd0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 shutdown_connections 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6b2c06ace0 0x7f6b2c06d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b4815fca0 0x7f6b4815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b480b5c90 0x7f6b481f1610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 --2- 172.21.15.71:0/3261900189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b480b6110 0x7f6b4815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:46.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 >> 172.21.15.71:0/3261900189 conn(0x7f6b4806c150 msgr2=0x7f6b480d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:46.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 shutdown_connections 2023-07-06T01:08:46.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:46.963+0000 7f6b4ebff700 1 -- 172.21.15.71:0/3261900189 wait complete. 2023-07-06T01:08:46.967 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 3 2023-07-06T01:08:46.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:47.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.174+0000 7f0c53fff700 1 Processor -- start 2023-07-06T01:08:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.174+0000 7f0c53fff700 1 -- start start 2023-07-06T01:08:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.175+0000 7f0c53fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0c4c0b5c90 0x7f0c4c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.175+0000 7f0c53fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0cf780 con 0x7f0c4c15fca0 2023-07-06T01:08:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.175+0000 7f0c53fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0cd490 con 0x7f0c4c0b6110 2023-07-06T01:08:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.175+0000 7f0c53fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c0cd770 con 0x7f0c4c0b5c90 2023-07-06T01:08:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c51d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0c4c15fca0 0x7f0c4c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40300/0 (socket says 172.21.15.71:40300) 2023-07-06T01:08:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c51d9b700 1 -- 172.21.15.71:0/1348489015 learned_addr learned my addr 172.21.15.71:0/1348489015 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:47.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618500430 0 0) 0x7f0c4c0cf780 con 0x7f0c4c15fca0 2023-07-06T01:08:47.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c380035b0 con 0x7f0c4c15fca0 2023-07-06T01:08:47.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1348489015 >> v2:172.21.15.194:3300/0 conn(0x7f0c4c0b5c90 0x7f0c4c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21640585 0 0) 0x7f0c380035b0 con 0x7f0c4c15fca0 2023-07-06T01:08:47.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 >> v2:172.21.15.194:3300/0 conn(0x7f0c4c0b5c90 msgr2=0x7f0c4c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:47.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 --2- 172.21.15.71:0/1348489015 >> v2:172.21.15.194:3300/0 conn(0x7f0c4c0b5c90 0x7f0c4c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 >> v1:172.21.15.194:6789/0 conn(0x7f0c4c0b6110 legacy=0x7f0c4c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0cda50 con 0x7f0c4c15fca0 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f0c48001670 con 0x7f0c4c15fca0 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1348489015 >> v2:172.21.15.194:3300/0 conn(0x7f0c4c0b5c90 0x7f0c4c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 >> v1:172.21.15.71:6789/0 conn(0x7f0c4c15fca0 legacy=0x7f0c4c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c38003a00 0x7f0c38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c38004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c38005200 0x7f0c3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.176+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0cd770 con 0x7f0c38004850 2023-07-06T01:08:47.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3800c190 con 0x7f0c38003a00 2023-07-06T01:08:47.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3800c350 con 0x7f0c38005200 2023-07-06T01:08:47.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c38004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c51d9b700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c38003a00 0x7f0c38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5259c700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c38005200 0x7f0c3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 -- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c38005200 msgr2=0x7f0c3800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:47.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c38005200 0x7f0c3800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 -- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c38003a00 msgr2=0x7f0c38003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:47.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c38003a00 0x7f0c38003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 -- 172.21.15.71:0/1348489015 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380035b0 con 0x7f0c38004850 2023-07-06T01:08:47.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5259c700 1 -- 172.21.15.71:0/1348489015 reap_dead start 2023-07-06T01:08:47.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.177+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c38004cc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009920 tx=0x7f0c38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1b2f2b1d025964 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:47.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00c070 con 0x7f0c38004850 2023-07-06T01:08:47.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c013610 con 0x7f0c38004850 2023-07-06T01:08:47.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c50d99700 1 -- 172.21.15.71:0/1348489015 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c009560 con 0x7f0c38004850 2023-07-06T01:08:47.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c53fff700 1 -- 172.21.15.71:0/1348489015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 msgr2=0x7f0c38004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c38004cc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009920 tx=0x7f0c38005880 comp rx=0 tx=0).stop 2023-07-06T01:08:47.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c53fff700 1 -- 172.21.15.71:0/1348489015 shutdown_connections 2023-07-06T01:08:47.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1348489015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c38004cc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c53fff700 1 -- 172.21.15.71:0/1348489015 >> 172.21.15.71:0/1348489015 conn(0x7f0c4c06c150 msgr2=0x7f0c4c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:47.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.178+0000 7f0c53fff700 1 -- 172.21.15.71:0/1348489015 shutdown_connections 2023-07-06T01:08:47.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.179+0000 7f0c53fff700 1 -- 172.21.15.71:0/1348489015 wait complete. 2023-07-06T01:08:47.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.180+0000 7f0c53fff700 1 Processor -- start 2023-07-06T01:08:47.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.181+0000 7f0c53fff700 1 -- start start 2023-07-06T01:08:47.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.181+0000 7f0c53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c4c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.181+0000 7f0c53fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c4c0ca920 0x7f0c4c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.181+0000 7f0c53fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c4c14fef0 0x7f0c4c150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c53fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c150890 con 0x7f0c38004850 2023-07-06T01:08:47.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c53fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0cb580 con 0x7f0c4c0ca920 2023-07-06T01:08:47.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c53fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0cb860 con 0x7f0c4c14fef0 2023-07-06T01:08:47.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c4c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c4c0cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36078/0 (socket says 172.21.15.71:36078) 2023-07-06T01:08:47.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 -- 172.21.15.71:0/1836292009 learned_addr learned my addr 172.21.15.71:0/1836292009 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:47.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c4c0ca920 0x7f0c4c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c5259c700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c4c14fef0 0x7f0c4c150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 -- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c4c14fef0 msgr2=0x7f0c4c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c4c14fef0 0x7f0c4c150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 -- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c4c0ca920 msgr2=0x7f0c4c15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c4c0ca920 0x7f0c4c15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.182+0000 7f0c51d9b700 1 -- 172.21.15.71:0/1836292009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0cbb40 con 0x7f0c38004850 2023-07-06T01:08:47.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.183+0000 7f0c51d9b700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c4c0cc900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007290 tx=0x7f0c480075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.183+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011580 con 0x7f0c38004850 2023-07-06T01:08:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.183+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480116e0 con 0x7f0c38004850 2023-07-06T01:08:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.183+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0cbe20 con 0x7f0c38004850 2023-07-06T01:08:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.183+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011a90 con 0x7f0c38004850 2023-07-06T01:08:47.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.183+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c0cc3e0 con 0x7f0c38004850 2023-07-06T01:08:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.184+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c0008d0 con 0x7f0c38004850 2023-07-06T01:08:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.185+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c48011bf0 con 0x7f0c38004850 2023-07-06T01:08:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.186+0000 7f0c427fc700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0c3006ace0 0x7f0c3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.186+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0c480891d0 con 0x7f0c38004850 2023-07-06T01:08:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.186+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0c3006ace0 0x7f0c3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.187+0000 7f0c5159a700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0c3006ace0 0x7f0c3006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000c00 tx=0x7f0c3c01f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:47.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.190+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c480545e0 con 0x7f0c38004850 2023-07-06T01:08:47.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.390+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c4c0d3a50 con 0x7f0c38004850 2023-07-06T01:08:47.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.391+0000 7f0c427fc700 1 -- 172.21.15.71:0/1836292009 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f0c48057c00 con 0x7f0c38004850 2023-07-06T01:08:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:47.394 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:46.174192+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:47.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0c3006ace0 msgr2=0x7f0c3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0c3006ace0 0x7f0c3006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000c00 tx=0x7f0c3c01f040 comp rx=0 tx=0).stop 2023-07-06T01:08:47.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 msgr2=0x7f0c4c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c4c0cc900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007290 tx=0x7f0c480075a0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 shutdown_connections 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0c3006ace0 0x7f0c3006d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c4c14fef0 0x7f0c4c150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c38004850 0x7f0c4c0cc900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 --2- 172.21.15.71:0/1836292009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c4c0ca920 0x7f0c4c15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.393+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 >> 172.21.15.71:0/1836292009 conn(0x7f0c4c06c150 msgr2=0x7f0c4c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.394+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 shutdown_connections 2023-07-06T01:08:47.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.394+0000 7f0c53fff700 1 -- 172.21.15.71:0/1836292009 wait complete. 2023-07-06T01:08:47.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:08:47.415 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:08:47.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.610+0000 7f654e5ff700 1 Processor -- start 2023-07-06T01:08:47.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.610+0000 7f654e5ff700 1 -- start start 2023-07-06T01:08:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f654e5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f654e5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65480b60e0 0x7f65480d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f654e5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65480cf780 con 0x7f654815fca0 2023-07-06T01:08:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f654e5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65480cd490 con 0x7f65480b60e0 2023-07-06T01:08:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f654e5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480cd770 con 0x7f65480b5c90 2023-07-06T01:08:47.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f6547fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f654815fca0 0x7f65480d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40308/0 (socket says 172.21.15.71:40308) 2023-07-06T01:08:47.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.611+0000 7f6547fff700 1 -- 172.21.15.71:0/2138503155 learned_addr learned my addr 172.21.15.71:0/2138503155 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:47.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f654cb9c700 1 --2- 172.21.15.71:0/2138503155 >> v2:172.21.15.71:3300/0 conn(0x7f65480b60e0 0x7f65480d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f65477fe700 1 --2- 172.21.15.71:0/2138503155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f6546ffd700 1 -- 172.21.15.71:0/2138503155 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960311246 0 0) 0x7f65480cf780 con 0x7f654815fca0 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f6546ffd700 1 -- 172.21.15.71:0/2138503155 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65300035b0 con 0x7f654815fca0 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f654cb9c700 1 -- 172.21.15.71:0/2138503155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 msgr2=0x7f65480d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f654cb9c700 1 --2- 172.21.15.71:0/2138503155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f654cb9c700 1 -- 172.21.15.71:0/2138503155 >> v1:172.21.15.71:6789/0 conn(0x7f654815fca0 legacy=0x7f65480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f654cb9c700 1 -- 172.21.15.71:0/2138503155 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480cda50 con 0x7f65480b60e0 2023-07-06T01:08:47.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f654cb9c700 1 --2- 172.21.15.71:0/2138503155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480d3280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723cda962c395 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f6546ffd700 1 -- 172.21.15.71:0/2138503155 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000e070 con 0x7f65480b60e0 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f6546ffd700 1 -- 172.21.15.71:0/2138503155 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654000bb20 con 0x7f65480b60e0 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.612+0000 7f6546ffd700 1 -- 172.21.15.71:0/2138503155 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540012430 con 0x7f65480b60e0 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 -- 172.21.15.71:0/2138503155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 msgr2=0x7f65480d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2138503155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480d3280 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654000b330 comp rx=0 tx=0).stop 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 -- 172.21.15.71:0/2138503155 shutdown_connections 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2138503155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480d3280 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2138503155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 -- 172.21.15.71:0/2138503155 >> 172.21.15.71:0/2138503155 conn(0x7f654806c150 msgr2=0x7f654806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:47.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 -- 172.21.15.71:0/2138503155 shutdown_connections 2023-07-06T01:08:47.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.613+0000 7f654e5ff700 1 -- 172.21.15.71:0/2138503155 wait complete. 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.615+0000 7f654e5ff700 1 Processor -- start 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.616+0000 7f654e5ff700 1 -- start start 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654e5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654e5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654e5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f654815fca0 0x7f65480b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654e5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480c9f10 con 0x7f65480b60e0 2023-07-06T01:08:47.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654e5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480cad70 con 0x7f654815fca0 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654e5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480ca160 con 0x7f65480b5c90 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f65477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f65477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36104/0 (socket says 172.21.15.71:36104) 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f65477fe700 1 -- 172.21.15.71:0/2013608318 learned_addr learned my addr 172.21.15.71:0/2013608318 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f6547fff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.617+0000 7f654cb9c700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f654815fca0 0x7f65480b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f65477fe700 1 -- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 msgr2=0x7f65480c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f65477fe700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f65477fe700 1 -- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f654815fca0 msgr2=0x7f65480b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f65477fe700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f654815fca0 0x7f65480b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f65477fe700 1 -- 172.21.15.71:0/2013608318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540009a70 con 0x7f65480b60e0 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f654cb9c700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f654815fca0 0x7f65480b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f6547fff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f65477fe700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480b3500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f653c00e810 tx=0x7f653c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c013610 con 0x7f65480b60e0 2023-07-06T01:08:47.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c013770 con 0x7f65480b60e0 2023-07-06T01:08:47.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c013b20 con 0x7f65480b60e0 2023-07-06T01:08:47.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480ca440 con 0x7f65480b60e0 2023-07-06T01:08:47.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.618+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65480caa00 con 0x7f65480b60e0 2023-07-06T01:08:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.619+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65480008d0 con 0x7f65480b60e0 2023-07-06T01:08:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.620+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f653c013c80 con 0x7f65480b60e0 2023-07-06T01:08:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.621+0000 7f6544ff9700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.621+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f653c088ea0 con 0x7f65480b60e0 2023-07-06T01:08:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.621+0000 7f6547fff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:47.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.622+0000 7f6547fff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f65380011e0 tx=0x7f6538009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:47.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.625+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f653c054210 con 0x7f65480b60e0 2023-07-06T01:08:47.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.819+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65480b2cd0 con 0x7f65480b60e0 2023-07-06T01:08:47.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.819+0000 7f6544ff9700 1 -- 172.21.15.71:0/2013608318 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f653c057830 con 0x7f65480b60e0 2023-07-06T01:08:47.822 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:08:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.821+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 msgr2=0x7f653406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.821+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f65380011e0 tx=0x7f6538009040 comp rx=0 tx=0).stop 2023-07-06T01:08:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.821+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 msgr2=0x7f65480b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.821+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480b3500 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f653c00e810 tx=0x7f653c00ebd0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 shutdown_connections 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f654815fca0 0x7f65480b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65480c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 --2- 172.21.15.71:0/2013608318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65480b60e0 0x7f65480b3500 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 >> 172.21.15.71:0/2013608318 conn(0x7f654806c150 msgr2=0x7f65480d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:47.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 shutdown_connections 2023-07-06T01:08:47.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:47.822+0000 7f654e5ff700 1 -- 172.21.15.71:0/2013608318 wait complete. 2023-07-06T01:08:47.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:08:48.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.035+0000 7f7a14dff700 1 Processor -- start 2023-07-06T01:08:48.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.035+0000 7f7a14dff700 1 -- start start 2023-07-06T01:08:48.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a14dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a1015fca0 0x7f7a100d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a14dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7a100b5c90 0x7f7a100d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a14dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a100b6100 0x7f7a100d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a14dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a100cf780 con 0x7f7a100b6100 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a14dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a100cd490 con 0x7f7a100b5c90 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a14dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100cd770 con 0x7f7a1015fca0 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a1015fca0 0x7f7a100d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a0ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a100b6100 0x7f7a100d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a07fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7a100b5c90 0x7f7a100d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a0e59c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a1015fca0 0x7f7a100d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:45204/0 (socket says 172.21.15.71:45204) 2023-07-06T01:08:48.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a0ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7a100b6100 0x7f7a100d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36108/0 (socket says 172.21.15.71:36108) 2023-07-06T01:08:48.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.036+0000 7f7a0e59c700 1 -- 172.21.15.71:0/3171696411 learned_addr learned my addr 172.21.15.71:0/3171696411 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:48.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/3171696411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a1015fca0 msgr2=0x7f7a100d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:48.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0ed9d700 1 --2- 172.21.15.71:0/3171696411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a1015fca0 0x7f7a100d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/3171696411 >> v2:172.21.15.194:3300/0 conn(0x7f7a100b5c90 msgr2=0x7f7a100d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0ed9d700 1 --2- 172.21.15.71:0/3171696411 >> v2:172.21.15.194:3300/0 conn(0x7f7a100b5c90 0x7f7a100d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/3171696411 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100cda50 con 0x7f7a100b6100 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0ed9d700 1 --2- 172.21.15.71:0/3171696411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a100b6100 0x7f7a100d3280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a1006cda0 tx=0x7f7a0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5f3e585c6fabc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0dd9b700 1 -- 172.21.15.71:0/3171696411 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800e070 con 0x7f7a100b6100 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0dd9b700 1 -- 172.21.15.71:0/3171696411 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800bb20 con 0x7f7a100b6100 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.037+0000 7f7a0dd9b700 1 -- 172.21.15.71:0/3171696411 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08012430 con 0x7f7a100b6100 2023-07-06T01:08:48.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 -- 172.21.15.71:0/3171696411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a100b6100 msgr2=0x7f7a100d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 --2- 172.21.15.71:0/3171696411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a100b6100 0x7f7a100d3280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a1006cda0 tx=0x7f7a0800b330 comp rx=0 tx=0).stop 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 -- 172.21.15.71:0/3171696411 shutdown_connections 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 --2- 172.21.15.71:0/3171696411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a1015fca0 0x7f7a100d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 --2- 172.21.15.71:0/3171696411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a100b6100 0x7f7a100d3280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 --2- 172.21.15.71:0/3171696411 >> v2:172.21.15.194:3300/0 conn(0x7f7a100b5c90 0x7f7a100d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 -- 172.21.15.71:0/3171696411 >> 172.21.15.71:0/3171696411 conn(0x7f7a1006c150 msgr2=0x7f7a1006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 -- 172.21.15.71:0/3171696411 shutdown_connections 2023-07-06T01:08:48.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.038+0000 7f7a14dff700 1 -- 172.21.15.71:0/3171696411 wait complete. 2023-07-06T01:08:48.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.040+0000 7f7a14dff700 1 Processor -- start 2023-07-06T01:08:48.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.040+0000 7f7a14dff700 1 -- start start 2023-07-06T01:08:48.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a14dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a100b5c90 0x7f7a10150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a14dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a100b6100 0x7f7a10157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a14dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 0x7f7a100b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a14dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b2960 con 0x7f7a1015fca0 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a14dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b2c40 con 0x7f7a100b6100 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a14dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100b2f20 con 0x7f7a100b5c90 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 0x7f7a100b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 0x7f7a100b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36120/0 (socket says 172.21.15.71:36120) 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/4257240968 learned_addr learned my addr 172.21.15.71:0/4257240968 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0e59c700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a100b5c90 0x7f7a10150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a07fff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a100b6100 0x7f7a10157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a100b5c90 msgr2=0x7f7a10150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a100b5c90 0x7f7a10150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a100b6100 msgr2=0x7f7a10157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a100b6100 0x7f7a10157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.042+0000 7f7a0ed9d700 1 -- 172.21.15.71:0/4257240968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009a70 con 0x7f7a1015fca0 2023-07-06T01:08:48.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.043+0000 7f7a0ed9d700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 0x7f7a100b3a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a08014040 tx=0x7f7a08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.043+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08004800 con 0x7f7a1015fca0 2023-07-06T01:08:48.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.043+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a08020070 con 0x7f7a1015fca0 2023-07-06T01:08:48.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.043+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a100b3200 con 0x7f7a1015fca0 2023-07-06T01:08:48.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.043+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080276c0 con 0x7f7a1015fca0 2023-07-06T01:08:48.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.043+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10151660 con 0x7f7a1015fca0 2023-07-06T01:08:48.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.044+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a100b3720 con 0x7f7a1015fca0 2023-07-06T01:08:48.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.045+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a08012430 con 0x7f7a1015fca0 2023-07-06T01:08:48.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.046+0000 7f7a06ffd700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f79f006ace0 0x7f79f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.046+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7a08022070 con 0x7f7a1015fca0 2023-07-06T01:08:48.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.047+0000 7f7a0e59c700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f79f006ace0 0x7f79f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.048+0000 7f7a0e59c700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f79f006ace0 0x7f79f006d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009bd0 tx=0x7f7a000092c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.051+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a100b3720 con 0x7f7a1015fca0 2023-07-06T01:08:48.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.244+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7a100b3720 con 0x7f7a1015fca0 2023-07-06T01:08:48.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.244+0000 7f7a06ffd700 1 -- 172.21.15.71:0/4257240968 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7a100b3720 con 0x7f7a1015fca0 2023-07-06T01:08:48.247 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:08:48.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.246+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f79f006ace0 msgr2=0x7f79f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.246+0000 7f7a14dff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f79f006ace0 0x7f79f006d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009bd0 tx=0x7f7a000092c0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 msgr2=0x7f7a100b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 0x7f7a100b3a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a08014040 tx=0x7f7a08004ad0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 shutdown_connections 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f79f006ace0 0x7f79f006d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a1015fca0 0x7f7a100b3a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a100b5c90 0x7f7a10150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 --2- 172.21.15.71:0/4257240968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a100b6100 0x7f7a10157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 >> 172.21.15.71:0/4257240968 conn(0x7f7a1006c150 msgr2=0x7f7a100cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:48.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 shutdown_connections 2023-07-06T01:08:48.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.247+0000 7f7a14dff700 1 -- 172.21.15.71:0/4257240968 wait complete. 2023-07-06T01:08:48.267 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T01:08:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.460+0000 7f11b85ff700 1 Processor -- start 2023-07-06T01:08:48.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.461+0000 7f11b85ff700 1 -- start start 2023-07-06T01:08:48.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b85ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f11b015fca0 0x7f11b00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b85ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f11b00b6110 0x7f11b00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b85ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b00cf780 con 0x7f11b00b5c90 2023-07-06T01:08:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b85ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00cd490 con 0x7f11b015fca0 2023-07-06T01:08:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b85ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00cd770 con 0x7f11b00b6110 2023-07-06T01:08:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f11b015fca0 0x7f11b00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f11b015fca0 0x7f11b00d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36122/0 (socket says 172.21.15.71:36122) 2023-07-06T01:08:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 -- 172.21.15.71:0/2019026468 learned_addr learned my addr 172.21.15.71:0/2019026468 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:48.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b6b9c700 1 --2- 172.21.15.71:0/2019026468 >> v2:172.21.15.194:3300/0 conn(0x7f11b00b6110 0x7f11b00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 -- 172.21.15.71:0/2019026468 >> v2:172.21.15.194:3300/0 conn(0x7f11b00b6110 msgr2=0x7f11b00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 --2- 172.21.15.71:0/2019026468 >> v2:172.21.15.194:3300/0 conn(0x7f11b00b6110 0x7f11b00cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 -- 172.21.15.71:0/2019026468 >> v1:172.21.15.71:6789/0 conn(0x7f11b00b5c90 legacy=0x7f11b00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b639b700 1 -- 172.21.15.71:0/2019026468 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00cda50 con 0x7f11b015fca0 2023-07-06T01:08:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.462+0000 7f11b5399700 1 -- 172.21.15.71:0/2019026468 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844752996 0 0) 0x7f11b00cf780 con 0x7f11b00b5c90 2023-07-06T01:08:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b639b700 1 --2- 172.21.15.71:0/2019026468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00d1420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11b00cd410 tx=0x7f11ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65d8ea6170dfcd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b5399700 1 -- 172.21.15.71:0/2019026468 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00b870 con 0x7f11b015fca0 2023-07-06T01:08:48.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b5399700 1 -- 172.21.15.71:0/2019026468 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00b9d0 con 0x7f11b015fca0 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b5399700 1 -- 172.21.15.71:0/2019026468 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00bd60 con 0x7f11b015fca0 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b85ff700 1 -- 172.21.15.71:0/2019026468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 msgr2=0x7f11b00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b85ff700 1 --2- 172.21.15.71:0/2019026468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00d1420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f11b00cd410 tx=0x7f11ac009bd0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b85ff700 1 -- 172.21.15.71:0/2019026468 shutdown_connections 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b85ff700 1 --2- 172.21.15.71:0/2019026468 >> v2:172.21.15.194:3300/0 conn(0x7f11b00b6110 0x7f11b00cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b85ff700 1 --2- 172.21.15.71:0/2019026468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00d1420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.463+0000 7f11b85ff700 1 -- 172.21.15.71:0/2019026468 >> 172.21.15.71:0/2019026468 conn(0x7f11b006c150 msgr2=0x7f11b006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:48.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.464+0000 7f11b85ff700 1 -- 172.21.15.71:0/2019026468 shutdown_connections 2023-07-06T01:08:48.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.464+0000 7f11b85ff700 1 -- 172.21.15.71:0/2019026468 wait complete. 2023-07-06T01:08:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.465+0000 7f11b85ff700 1 Processor -- start 2023-07-06T01:08:48.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.465+0000 7f11b85ff700 1 -- start start 2023-07-06T01:08:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.466+0000 7f11b85ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b00b5c90 0x7f11b01f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.466+0000 7f11b85ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00b6110 0x7f11b00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.466+0000 7f11b85ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.466+0000 7f11b85ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00cc1c0 con 0x7f11b015fca0 2023-07-06T01:08:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.466+0000 7f11b85ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c69b0 con 0x7f11b00b5c90 2023-07-06T01:08:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.466+0000 7f11b85ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c6c90 con 0x7f11b00b6110 2023-07-06T01:08:48.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36126/0 (socket says 172.21.15.71:36126) 2023-07-06T01:08:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 -- 172.21.15.71:0/1187290050 learned_addr learned my addr 172.21.15.71:0/1187290050 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:48.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b639b700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b00b5c90 0x7f11b01f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b5b9a700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00b6110 0x7f11b00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 -- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00b6110 msgr2=0x7f11b00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00b6110 0x7f11b00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 -- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b00b5c90 msgr2=0x7f11b01f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b00b5c90 0x7f11b01f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 -- 172.21.15.71:0/1187290050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac009550 con 0x7f11b015fca0 2023-07-06T01:08:48.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11b6b9c700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00b33e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f11a8007e40 tx=0x7f11a800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.467+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800ed30 con 0x7f11b015fca0 2023-07-06T01:08:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.468+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a8014420 con 0x7f11b015fca0 2023-07-06T01:08:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.468+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b00c6f70 con 0x7f11b015fca0 2023-07-06T01:08:48.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.468+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80147d0 con 0x7f11b015fca0 2023-07-06T01:08:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.468+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b00cbeb0 con 0x7f11b015fca0 2023-07-06T01:08:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.469+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b00c7490 con 0x7f11b015fca0 2023-07-06T01:08:48.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.470+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11a8014930 con 0x7f11b015fca0 2023-07-06T01:08:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.471+0000 7f11a6ffd700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f119406ace0 0x7f119406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.471+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11a8089860 con 0x7f11b015fca0 2023-07-06T01:08:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.471+0000 7f11b639b700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f119406ace0 0x7f119406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.472+0000 7f11b639b700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f119406ace0 0x7f119406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11ac014040 tx=0x7f11ac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.475+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f11a8054bd0 con 0x7f11b015fca0 2023-07-06T01:08:48.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.671+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11b00008d0 con 0x7f11b015fca0 2023-07-06T01:08:48.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.672+0000 7f11a6ffd700 1 -- 172.21.15.71:0/1187290050 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f11a80581f0 con 0x7f11b015fca0 2023-07-06T01:08:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:48.675 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-07-06T01:08:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:08:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-07-06T01:08:48.675 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-07-06T01:08:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:08:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:08:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 2, 2023-07-06T01:08:48.676 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": "rbd" 2023-07-06T01:08:48.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:08:48.677 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f119406ace0 msgr2=0x7f119406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f119406ace0 0x7f119406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f11ac014040 tx=0x7f11ac008030 comp rx=0 tx=0).stop 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 msgr2=0x7f11b00b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00b33e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f11a8007e40 tx=0x7f11a800e3c0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 shutdown_connections 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f119406ace0 0x7f119406d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11b015fca0 0x7f11b00b33e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11b00b5c90 0x7f11b01f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 --2- 172.21.15.71:0/1187290050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11b00b6110 0x7f11b00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 >> 172.21.15.71:0/1187290050 conn(0x7f11b006c150 msgr2=0x7f11b00d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:48.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 shutdown_connections 2023-07-06T01:08:48.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.674+0000 7f11b85ff700 1 -- 172.21.15.71:0/1187290050 wait complete. 2023-07-06T01:08:48.694 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T01:08:48.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T01:08:48.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.891+0000 7fc6237ff700 1 Processor -- start 2023-07-06T01:08:48.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.891+0000 7fc6237ff700 1 -- start start 2023-07-06T01:08:48.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.892+0000 7fc6237ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc61c0b8440 0x7fc61c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.892+0000 7fc6237ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0cfe40 0x7fc61c0d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.892+0000 7fc6237ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c160cc0 con 0x7fc61c0b2180 2023-07-06T01:08:48.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.892+0000 7fc6237ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c160ae0 con 0x7fc61c0b8440 2023-07-06T01:08:48.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.892+0000 7fc6237ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c160f80 con 0x7fc61c0cfe40 2023-07-06T01:08:48.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc61c0b8440 0x7fc61c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc61c0b8440 0x7fc61c0cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36136/0 (socket says 172.21.15.71:36136) 2023-07-06T01:08:48.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 -- 172.21.15.71:0/566005206 learned_addr learned my addr 172.21.15.71:0/566005206 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:48.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 -- 172.21.15.71:0/566005206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0cfe40 msgr2=0x7fc61c0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:48.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 --2- 172.21.15.71:0/566005206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0cfe40 0x7fc61c0d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 -- 172.21.15.71:0/566005206 >> v1:172.21.15.194:6789/0 conn(0x7fc61c0b2180 legacy=0x7fc61c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:48.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 -- 172.21.15.71:0/566005206 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0cf0e0 con 0x7fc61c0b8440 2023-07-06T01:08:48.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc62159b700 1 --2- 172.21.15.71:0/566005206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b8440 0x7fc61c0cd530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6180098f0 tx=0x7fc618009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e32e462c5971b6f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.893+0000 7fc613fff700 1 -- 172.21.15.71:0/566005206 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618004230 con 0x7fc61c0b8440 2023-07-06T01:08:48.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc613fff700 1 -- 172.21.15.71:0/566005206 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc618004390 con 0x7fc61c0b8440 2023-07-06T01:08:48.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc613fff700 1 -- 172.21.15.71:0/566005206 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6180036a0 con 0x7fc61c0b8440 2023-07-06T01:08:48.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 -- 172.21.15.71:0/566005206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b8440 msgr2=0x7fc61c0cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 --2- 172.21.15.71:0/566005206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b8440 0x7fc61c0cd530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6180098f0 tx=0x7fc618009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 -- 172.21.15.71:0/566005206 shutdown_connections 2023-07-06T01:08:48.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 --2- 172.21.15.71:0/566005206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0cfe40 0x7fc61c0d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 --2- 172.21.15.71:0/566005206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b8440 0x7fc61c0cd530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 -- 172.21.15.71:0/566005206 >> 172.21.15.71:0/566005206 conn(0x7fc61c06be10 msgr2=0x7fc61c071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:48.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 -- 172.21.15.71:0/566005206 shutdown_connections 2023-07-06T01:08:48.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.894+0000 7fc6237ff700 1 -- 172.21.15.71:0/566005206 wait complete. 2023-07-06T01:08:48.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.896+0000 7fc6237ff700 1 Processor -- start 2023-07-06T01:08:48.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.896+0000 7fc6237ff700 1 -- start start 2023-07-06T01:08:48.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc6237ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 0x7fc61c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc6237ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0b8440 0x7fc61c1e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc6237ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c0cfe40 0x7fc61c1f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc6237ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1569e0 con 0x7fc61c0b2180 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc6237ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c15faf0 con 0x7fc61c0cfe40 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc6237ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c15fdd0 con 0x7fc61c0b8440 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc62159b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 0x7fc61c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc62159b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 0x7fc61c153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36152/0 (socket says 172.21.15.71:36152) 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc62159b700 1 -- 172.21.15.71:0/1143503939 learned_addr learned my addr 172.21.15.71:0/1143503939 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:48.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc62159b700 1 -- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0b8440 msgr2=0x7fc61c1e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc620d9a700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0b8440 0x7fc61c1e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc621d9c700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c0cfe40 0x7fc61c1f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc62159b700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0b8440 0x7fc61c1e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.897+0000 7fc62159b700 1 -- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c0cfe40 msgr2=0x7fc61c1f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc62159b700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c0cfe40 0x7fc61c1f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:48.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc62159b700 1 -- 172.21.15.71:0/1143503939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618009550 con 0x7fc61c0b2180 2023-07-06T01:08:48.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc620d9a700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0b8440 0x7fc61c1e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:48.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc621d9c700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c0cfe40 0x7fc61c1f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:48.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc62159b700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 0x7fc61c153bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc618009130 tx=0x7fc618004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc618003e70 con 0x7fc61c0b2180 2023-07-06T01:08:48.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61801f070 con 0x7fc61c0b2180 2023-07-06T01:08:48.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800b8a0 con 0x7fc61c0b2180 2023-07-06T01:08:48.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c154150 con 0x7fc61c0b2180 2023-07-06T01:08:48.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.898+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c154710 con 0x7fc61c0b2180 2023-07-06T01:08:48.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.899+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c154a80 con 0x7fc61c0b2180 2023-07-06T01:08:48.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.900+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc618021030 con 0x7fc61c0b2180 2023-07-06T01:08:48.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.901+0000 7fc611ffb700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc60006ace0 0x7fc60006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:48.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.901+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc61808a8f0 con 0x7fc61c0b2180 2023-07-06T01:08:48.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.901+0000 7fc620d9a700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc60006ace0 0x7fc60006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:48.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.902+0000 7fc620d9a700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc60006ace0 0x7fc60006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc61c154100 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:48.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:48.906+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc618055ce0 con 0x7fc61c0b2180 2023-07-06T01:08:49.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.098+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc61c0b2ea0 con 0x7fc61c0b2180 2023-07-06T01:08:49.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.513+0000 7fc611ffb700 1 -- 172.21.15.71:0/1143503939 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc618059300 con 0x7fc61c0b2180 2023-07-06T01:08:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc60006ace0 msgr2=0x7fc60006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc60006ace0 0x7fc60006d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc61c154100 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2023-07-06T01:08:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 msgr2=0x7fc61c153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 0x7fc61c153bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc618009130 tx=0x7fc618004750 comp rx=0 tx=0).stop 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 shutdown_connections 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc60006ace0 0x7fc60006d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c0cfe40 0x7fc61c1f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc61c0b2180 0x7fc61c153bc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 --2- 172.21.15.71:0/1143503939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c0b8440 0x7fc61c1e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 >> 172.21.15.71:0/1143503939 conn(0x7fc61c06be10 msgr2=0x7fc61c1602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:49.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.516+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 shutdown_connections 2023-07-06T01:08:49.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.517+0000 7fc6237ff700 1 -- 172.21.15.71:0/1143503939 wait complete. 2023-07-06T01:08:49.523 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-07-06T01:08:49.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T01:08:49.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.739+0000 7f035f9ff700 1 Processor -- start 2023-07-06T01:08:49.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.739+0000 7f035f9ff700 1 -- start start 2023-07-06T01:08:49.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035f9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f03580b5c90 0x7f03580d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035f9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580cf780 con 0x7f03580b6110 2023-07-06T01:08:49.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035f9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580cd490 con 0x7f035815fca0 2023-07-06T01:08:49.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035f9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03580cd770 con 0x7f03580b5c90 2023-07-06T01:08:49.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035df9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f03580b6110 0x7f03580cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40322/0 (socket says 172.21.15.71:40322) 2023-07-06T01:08:49.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035df9c700 1 -- 172.21.15.71:0/2123130666 learned_addr learned my addr 172.21.15.71:0/2123130666 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:49.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.740+0000 7f035cf9a700 1 --2- 172.21.15.71:0/2123130666 >> v2:172.21.15.194:3300/0 conn(0x7f03580b5c90 0x7f03580d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848157768 0 0) 0x7f03580cf780 con 0x7f03580b6110 2023-07-06T01:08:49.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03440035b0 con 0x7f03580b6110 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990584693 0 0) 0x7f03440035b0 con 0x7f03580b6110 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 >> v2:172.21.15.194:3300/0 conn(0x7f03580b5c90 msgr2=0x7f03580d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 --2- 172.21.15.71:0/2123130666 >> v2:172.21.15.194:3300/0 conn(0x7f03580b5c90 0x7f03580d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 >> v1:172.21.15.194:6789/0 conn(0x7f035815fca0 legacy=0x7f03580d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580cda50 con 0x7f03580b6110 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f03500019f0 con 0x7f03580b6110 2023-07-06T01:08:49.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 >> v1:172.21.15.71:6789/0 conn(0x7f03580b6110 legacy=0x7f03580cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0344003a00 0x7f0344003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03440043f0 0x7f03440048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440050b0 0x7f034400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580cd770 con 0x7f03440043f0 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034400c000 con 0x7f03440050b0 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034400c1c0 con 0x7f0344003a00 2023-07-06T01:08:49.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f035d79b700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0344003a00 0x7f0344003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f035df9c700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440050b0 0x7f034400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.741+0000 7f035cf9a700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03440043f0 0x7f03440048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035d79b700 1 -- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440050b0 msgr2=0x7f034400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035d79b700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440050b0 0x7f034400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035d79b700 1 -- 172.21.15.71:0/2123130666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03440043f0 msgr2=0x7f03440048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035d79b700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03440043f0 0x7f03440048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035d79b700 1 -- 172.21.15.71:0/2123130666 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440035b0 con 0x7f0344003a00 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035df9c700 1 -- 172.21.15.71:0/2123130666 reap_dead start 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035cf9a700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03440043f0 0x7f03440048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f035d79b700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0344003a00 0x7f0344003dd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0354001980 tx=0x7f0344005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c588c85a182a678 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354001420 con 0x7f0344003a00 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03540052d0 con 0x7f0344003a00 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.742+0000 7f034ffff700 1 -- 172.21.15.71:0/2123130666 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354003680 con 0x7f0344003a00 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 -- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0344003a00 msgr2=0x7f0344003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0344003a00 0x7f0344003dd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0354001980 tx=0x7f0344005880 comp rx=0 tx=0).stop 2023-07-06T01:08:49.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 -- 172.21.15.71:0/2123130666 shutdown_connections 2023-07-06T01:08:49.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 --2- 172.21.15.71:0/2123130666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0344003a00 0x7f0344003dd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 -- 172.21.15.71:0/2123130666 >> 172.21.15.71:0/2123130666 conn(0x7f035806c150 msgr2=0x7f035806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:49.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 -- 172.21.15.71:0/2123130666 shutdown_connections 2023-07-06T01:08:49.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.743+0000 7f035f9ff700 1 -- 172.21.15.71:0/2123130666 wait complete. 2023-07-06T01:08:49.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.745+0000 7f035f9ff700 1 Processor -- start 2023-07-06T01:08:49.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.745+0000 7f035f9ff700 1 -- start start 2023-07-06T01:08:49.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035f9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0344003a00 0x7f03580c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035f9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 0x7f03581f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035f9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03581f3200 0x7f03581f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035f9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358156380 con 0x7f03580c9f10 2023-07-06T01:08:49.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035f9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03581f3040 con 0x7f0344003a00 2023-07-06T01:08:49.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035f9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03580cb020 con 0x7f03581f3200 2023-07-06T01:08:49.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 0x7f03581f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 0x7f03581f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36170/0 (socket says 172.21.15.71:36170) 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 -- 172.21.15.71:0/3459608284 learned_addr learned my addr 172.21.15.71:0/3459608284 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035d79b700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0344003a00 0x7f03580c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035df9c700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03581f3200 0x7f03581f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 -- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03581f3200 msgr2=0x7f03581f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03581f3200 0x7f03581f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 -- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0344003a00 msgr2=0x7f03580c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:49.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0344003a00 0x7f03580c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.746+0000 7f035cf9a700 1 -- 172.21.15.71:0/3459608284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580ca410 con 0x7f03580c9f10 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.747+0000 7f035cf9a700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 0x7f03581f2b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0348011bd0 tx=0x7f0348011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.747+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348004020 con 0x7f03580c9f10 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.747+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348004180 con 0x7f03580c9f10 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.747+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348004510 con 0x7f03580c9f10 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.747+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03580ca6f0 con 0x7f03580c9f10 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.747+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03580cacb0 con 0x7f03580c9f10 2023-07-06T01:08:49.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.748+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03580008d0 con 0x7f03580c9f10 2023-07-06T01:08:49.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.749+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f034800f8e0 con 0x7f03580c9f10 2023-07-06T01:08:49.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.750+0000 7f034dffb700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:49.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.750+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f0348089410 con 0x7f03580c9f10 2023-07-06T01:08:49.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.751+0000 7f035d79b700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:49.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.751+0000 7f035d79b700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f033c06ace0 0x7f033c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0354015040 tx=0x7f035400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:49.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.755+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0348054600 con 0x7f03580c9f10 2023-07-06T01:08:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:49.947+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0358159bc0 con 0x7f03580c9f10 2023-07-06T01:08:50.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.516+0000 7f034dffb700 1 -- 172.21.15.71:0/3459608284 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0348057c20 con 0x7f03580c9f10 2023-07-06T01:08:50.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.529+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f033c06ace0 msgr2=0x7f033c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.529+0000 7f035f9ff700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f033c06ace0 0x7f033c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0354015040 tx=0x7f035400a000 comp rx=0 tx=0).stop 2023-07-06T01:08:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.529+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 msgr2=0x7f03581f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.529+0000 7f035f9ff700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 0x7f03581f2b00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0348011bd0 tx=0x7f0348011ee0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 shutdown_connections 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03581f3200 0x7f03581f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0344003a00 0x7f03580c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 --2- 172.21.15.71:0/3459608284 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03580c9f10 0x7f03581f2b00 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0348011bd0 tx=0x7f0348011ee0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 >> 172.21.15.71:0/3459608284 conn(0x7f035806c150 msgr2=0x7f03580b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:50.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.530+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 shutdown_connections 2023-07-06T01:08:50.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.534+0000 7f035f9ff700 1 -- 172.21.15.71:0/3459608284 wait complete. 2023-07-06T01:08:50.541 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-07-06T01:08:50.561 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T01:08:50.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6667fff700 1 Processor -- start 2023-07-06T01:08:50.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6667fff700 1 -- start start 2023-07-06T01:08:50.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6667fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66600b0440 0x7f6660143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:50.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6667fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66601441f0 con 0x7f666015df60 2023-07-06T01:08:50.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6667fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666015e3e0 con 0x7f666015b0e0 2023-07-06T01:08:50.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6667fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666015a930 con 0x7f66600b0440 2023-07-06T01:08:50.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6665d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66600b0440 0x7f6660143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:50.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6665d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66600b0440 0x7f6660143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36184/0 (socket says 172.21.15.71:36184) 2023-07-06T01:08:50.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f6665d9b700 1 -- 172.21.15.71:0/4053090316 learned_addr learned my addr 172.21.15.71:0/4053090316 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:50.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.758+0000 7f666559a700 1 --1- 172.21.15.71:0/4053090316 >> v1:172.21.15.71:6789/0 conn(0x7f666015df60 0x7f66600b0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40328/0 (socket says 172.21.15.71:40328) 2023-07-06T01:08:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6665d9b700 1 -- 172.21.15.71:0/4053090316 >> v1:172.21.15.194:6789/0 conn(0x7f666015b0e0 legacy=0x7f6660070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6665d9b700 1 -- 172.21.15.71:0/4053090316 >> v1:172.21.15.71:6789/0 conn(0x7f666015df60 legacy=0x7f66600b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6665d9b700 1 -- 172.21.15.71:0/4053090316 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666015e660 con 0x7f66600b0440 2023-07-06T01:08:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6665d9b700 1 --2- 172.21.15.71:0/4053090316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66600b0440 0x7f6660143900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098f0 tx=0x7f665c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4c76c55ae42177 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6664d99700 1 -- 172.21.15.71:0/4053090316 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00b8a0 con 0x7f66600b0440 2023-07-06T01:08:50.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6664d99700 1 -- 172.21.15.71:0/4053090316 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c00ba00 con 0x7f66600b0440 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.760+0000 7f6664d99700 1 -- 172.21.15.71:0/4053090316 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00bd90 con 0x7f66600b0440 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 -- 172.21.15.71:0/4053090316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66600b0440 msgr2=0x7f6660143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 --2- 172.21.15.71:0/4053090316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66600b0440 0x7f6660143900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098f0 tx=0x7f665c009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 -- 172.21.15.71:0/4053090316 shutdown_connections 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 --2- 172.21.15.71:0/4053090316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66600b0440 0x7f6660143900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 -- 172.21.15.71:0/4053090316 >> 172.21.15.71:0/4053090316 conn(0x7f66600cb440 msgr2=0x7f66600cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:50.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 -- 172.21.15.71:0/4053090316 shutdown_connections 2023-07-06T01:08:50.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.761+0000 7f6667fff700 1 -- 172.21.15.71:0/4053090316 wait complete. 2023-07-06T01:08:50.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.763+0000 7f6667fff700 1 Processor -- start 2023-07-06T01:08:50.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.763+0000 7f6667fff700 1 -- start start 2023-07-06T01:08:50.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6667fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600b0440 0x7f6660155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:50.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6667fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 0x7f66600cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:50.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6667fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f666015df60 0x7f66600ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6667fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66600c5ba0 con 0x7f666015b0e0 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6667fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66600cd920 con 0x7f66600b0440 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6667fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6660156190 con 0x7f666015df60 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 0x7f66600cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 0x7f66600cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36186/0 (socket says 172.21.15.71:36186) 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 -- 172.21.15.71:0/4097324299 learned_addr learned my addr 172.21.15.71:0/4097324299 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:50.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f6665d9b700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600b0440 0x7f6660155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666659c700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f666015df60 0x7f66600ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 -- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f666015df60 msgr2=0x7f66600ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f666015df60 0x7f66600ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 -- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600b0440 msgr2=0x7f6660155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600b0440 0x7f6660155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.764+0000 7f666559a700 1 -- 172.21.15.71:0/4097324299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c009550 con 0x7f666015b0e0 2023-07-06T01:08:50.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.765+0000 7f666559a700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 0x7f66600cdfe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f665000c500 tx=0x7f665000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.765+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650005cb0 con 0x7f666015b0e0 2023-07-06T01:08:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.765+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6650005e10 con 0x7f666015b0e0 2023-07-06T01:08:50.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.765+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66600cd360 con 0x7f666015b0e0 2023-07-06T01:08:50.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.765+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66500072d0 con 0x7f666015b0e0 2023-07-06T01:08:50.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.765+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66600b1990 con 0x7f666015b0e0 2023-07-06T01:08:50.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.766+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666006fa50 con 0x7f666015b0e0 2023-07-06T01:08:50.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.768+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6650007430 con 0x7f666015b0e0 2023-07-06T01:08:50.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.768+0000 7f66567fc700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f664406ace0 0x7f664406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:50.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.769+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f6650088c40 con 0x7f666015b0e0 2023-07-06T01:08:50.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.769+0000 7f6665d9b700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f664406ace0 0x7f664406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:50.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.769+0000 7f6665d9b700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f664406ace0 0x7f664406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f665c014040 tx=0x7f665c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:50.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:50.772+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6650053de0 con 0x7f666015b0e0 2023-07-06T01:08:51.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.009+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66600b17f0 con 0x7f666015b0e0 2023-07-06T01:08:51.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.531+0000 7f66567fc700 1 -- 172.21.15.71:0/4097324299 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f66600b17f0 con 0x7f666015b0e0 2023-07-06T01:08:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.540+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f664406ace0 msgr2=0x7f664406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.540+0000 7f6667fff700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f664406ace0 0x7f664406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f665c014040 tx=0x7f665c008030 comp rx=0 tx=0).stop 2023-07-06T01:08:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.540+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 msgr2=0x7f66600cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.540+0000 7f6667fff700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 0x7f66600cdfe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f665000c500 tx=0x7f665000c810 comp rx=0 tx=0).stop 2023-07-06T01:08:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.543+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 shutdown_connections 2023-07-06T01:08:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.543+0000 7f6667fff700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f664406ace0 0x7f664406d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.543+0000 7f6667fff700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f666015df60 0x7f66600ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.543+0000 7f6667fff700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66600b0440 0x7f6660155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.543+0000 7f6667fff700 1 --2- 172.21.15.71:0/4097324299 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f666015b0e0 0x7f66600cdfe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.543+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 >> 172.21.15.71:0/4097324299 conn(0x7f66600cb440 msgr2=0x7f66600c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.547+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 shutdown_connections 2023-07-06T01:08:51.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.555+0000 7f6667fff700 1 -- 172.21.15.71:0/4097324299 wait complete. 2023-07-06T01:08:51.560 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 3 and data pool 4 2023-07-06T01:08:51.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.774+0000 7fec69bff700 1 Processor -- start 2023-07-06T01:08:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.774+0000 7fec69bff700 1 -- start start 2023-07-06T01:08:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.775+0000 7fec69bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec6415fca0 0x7fec640d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.775+0000 7fec69bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec640cf780 con 0x7fec640b5c90 2023-07-06T01:08:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.775+0000 7fec69bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec640cd490 con 0x7fec640b6110 2023-07-06T01:08:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.775+0000 7fec69bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec640cd770 con 0x7fec6415fca0 2023-07-06T01:08:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.775+0000 7fec5bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fec640b5c90 0x7fec640d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40334/0 (socket says 172.21.15.71:40334) 2023-07-06T01:08:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.775+0000 7fec5bfff700 1 -- 172.21.15.71:0/3688097913 learned_addr learned my addr 172.21.15.71:0/3688097913 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec637fe700 1 --2- 172.21.15.71:0/3688097913 >> v2:172.21.15.194:3300/0 conn(0x7fec6415fca0 0x7fec640d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022992945 0 0) 0x7fec640cf780 con 0x7fec640b5c90 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec500035b0 con 0x7fec640b5c90 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 102721099 0 0) 0x7fec500035b0 con 0x7fec640b5c90 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 >> v2:172.21.15.194:3300/0 conn(0x7fec6415fca0 msgr2=0x7fec640d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 --2- 172.21.15.71:0/3688097913 >> v2:172.21.15.194:3300/0 conn(0x7fec6415fca0 0x7fec640d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 >> v1:172.21.15.194:6789/0 conn(0x7fec640b6110 legacy=0x7fec640cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640cda50 con 0x7fec640b5c90 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fec4c001670 con 0x7fec640b5c90 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 >> v1:172.21.15.71:6789/0 conn(0x7fec640b5c90 legacy=0x7fec640d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec50003a50 0x7fec50003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50004850 0x7fec50004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec50005200 0x7fec5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640cd770 con 0x7fec50005200 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5000c0e0 con 0x7fec50003a50 2023-07-06T01:08:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5000c2a0 con 0x7fec50004850 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec63fff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec50005200 0x7fec5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec637fe700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec50003a50 0x7fec50003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.776+0000 7fec5bfff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50004850 0x7fec50004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 -- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50004850 msgr2=0x7fec50004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50004850 0x7fec50004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 -- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec50003a50 msgr2=0x7fec50003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec50003a50 0x7fec50003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 -- 172.21.15.71:0/3688097913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec500035b0 con 0x7fec50005200 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 -- 172.21.15.71:0/3688097913 reap_dead start 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec63fff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec50005200 0x7fec5000ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c160 tx=0x7fec50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24197b36796b2995 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c001db0 con 0x7fec50005200 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00cca0 con 0x7fec50005200 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.777+0000 7fec62ffd700 1 -- 172.21.15.71:0/3688097913 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c003c20 con 0x7fec50005200 2023-07-06T01:08:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 -- 172.21.15.71:0/3688097913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec50005200 msgr2=0x7fec5000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec50005200 0x7fec5000ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c160 tx=0x7fec50005880 comp rx=0 tx=0).stop 2023-07-06T01:08:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 -- 172.21.15.71:0/3688097913 shutdown_connections 2023-07-06T01:08:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 --2- 172.21.15.71:0/3688097913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec50005200 0x7fec5000ba10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 -- 172.21.15.71:0/3688097913 >> 172.21.15.71:0/3688097913 conn(0x7fec6406c150 msgr2=0x7fec6406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 -- 172.21.15.71:0/3688097913 shutdown_connections 2023-07-06T01:08:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.778+0000 7fec69bff700 1 -- 172.21.15.71:0/3688097913 wait complete. 2023-07-06T01:08:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.780+0000 7fec69bff700 1 Processor -- start 2023-07-06T01:08:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.780+0000 7fec69bff700 1 -- start start 2023-07-06T01:08:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec69bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50005200 0x7fec64150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec69bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec640c9f10 0x7fec640c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec69bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 0x7fec640cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec69bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec64152ac0 con 0x7fec6414f5c0 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec69bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640c87e0 con 0x7fec640c9f10 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec69bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec640c8a80 con 0x7fec50005200 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 0x7fec640cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 0x7fec640cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36202/0 (socket says 172.21.15.71:36202) 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 -- 172.21.15.71:0/3376657460 learned_addr learned my addr 172.21.15.71:0/3376657460 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec5bfff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec640c9f10 0x7fec640c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec637fe700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50005200 0x7fec64150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 -- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50005200 msgr2=0x7fec64150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50005200 0x7fec64150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 -- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec640c9f10 msgr2=0x7fec640c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec640c9f10 0x7fec640c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.781+0000 7fec63fff700 1 -- 172.21.15.71:0/3376657460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64152470 con 0x7fec6414f5c0 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.782+0000 7fec63fff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 0x7fec640cc3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c160 tx=0x7fec5c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.782+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c003d10 con 0x7fec6414f5c0 2023-07-06T01:08:51.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.782+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c003e70 con 0x7fec6414f5c0 2023-07-06T01:08:51.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.782+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0052f0 con 0x7fec6414f5c0 2023-07-06T01:08:51.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.782+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec64152750 con 0x7fec6414f5c0 2023-07-06T01:08:51.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.782+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec640c8d60 con 0x7fec6414f5c0 2023-07-06T01:08:51.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.783+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec640ce120 con 0x7fec6414f5c0 2023-07-06T01:08:51.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.784+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec5c005450 con 0x7fec6414f5c0 2023-07-06T01:08:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.785+0000 7fec60ff9700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fec4406ace0 0x7fec4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.785+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec5c08a3a0 con 0x7fec6414f5c0 2023-07-06T01:08:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.786+0000 7fec637fe700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fec4406ace0 0x7fec4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:51.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.786+0000 7fec637fe700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fec4406ace0 0x7fec4406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec54009be0 tx=0x7fec54009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:51.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.790+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fec5c055500 con 0x7fec6414f5c0 2023-07-06T01:08:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.986+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec640008d0 con 0x7fec6414f5c0 2023-07-06T01:08:51.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.987+0000 7fec60ff9700 1 -- 172.21.15.71:0/3376657460 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18268 (secure 0 0 0) 0x7fec5c058b20 con 0x7fec6414f5c0 2023-07-06T01:08:51.989 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:51.989 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:51.009600+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.989+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fec4406ace0 msgr2=0x7fec4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.989+0000 7fec69bff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fec4406ace0 0x7fec4406d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec54009be0 tx=0x7fec54009210 comp rx=0 tx=0).stop 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.989+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 msgr2=0x7fec640cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.989+0000 7fec69bff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 0x7fec640cc3b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c160 tx=0x7fec5c0014a0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 shutdown_connections 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fec4406ace0 0x7fec4406d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec6414f5c0 0x7fec640cc3b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec50005200 0x7fec64150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 --2- 172.21.15.71:0/3376657460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec640c9f10 0x7fec640c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:51.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 >> 172.21.15.71:0/3376657460 conn(0x7fec6406c150 msgr2=0x7fec640d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 shutdown_connections 2023-07-06T01:08:51.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:51.990+0000 7fec69bff700 1 -- 172.21.15.71:0/3376657460 wait complete. 2023-07-06T01:08:52.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.200+0000 7f2d685ff700 1 Processor -- start 2023-07-06T01:08:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.200+0000 7f2d685ff700 1 -- start start 2023-07-06T01:08:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.201+0000 7f2d685ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2d600b5c90 0x7f2d600d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.201+0000 7f2d685ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d600b6110 0x7f2d600d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.201+0000 7f2d685ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d600cf780 con 0x7f2d6015fca0 2023-07-06T01:08:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.201+0000 7f2d685ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600cd490 con 0x7f2d600b5c90 2023-07-06T01:08:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.201+0000 7f2d685ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600cd770 con 0x7f2d600b6110 2023-07-06T01:08:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2d600b5c90 0x7f2d600d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d6639b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2d6015fca0 0x7f2d600d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40350/0 (socket says 172.21.15.71:40350) 2023-07-06T01:08:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d6639b700 1 -- 172.21.15.71:0/1562451946 learned_addr learned my addr 172.21.15.71:0/1562451946 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d66b9c700 1 --2- 172.21.15.71:0/1562451946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d600b6110 0x7f2d600d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65b9a700 1 -- 172.21.15.71:0/1562451946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d600b6110 msgr2=0x7f2d600d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65b9a700 1 --2- 172.21.15.71:0/1562451946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d600b6110 0x7f2d600d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65b9a700 1 -- 172.21.15.71:0/1562451946 >> v1:172.21.15.71:6789/0 conn(0x7f2d6015fca0 legacy=0x7f2d600d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65b9a700 1 -- 172.21.15.71:0/1562451946 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d600cda50 con 0x7f2d600b5c90 2023-07-06T01:08:52.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65399700 1 -- 172.21.15.71:0/1562451946 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678015158 0 0) 0x7f2d600cf780 con 0x7f2d6015fca0 2023-07-06T01:08:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.202+0000 7f2d65b9a700 1 --2- 172.21.15.71:0/1562451946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b5c90 0x7f2d600d2d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009840 tx=0x7f2d50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae1c97eef60eaff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d65399700 1 -- 172.21.15.71:0/1562451946 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50011830 con 0x7f2d600b5c90 2023-07-06T01:08:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d65399700 1 -- 172.21.15.71:0/1562451946 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50011990 con 0x7f2d600b5c90 2023-07-06T01:08:52.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d65399700 1 -- 172.21.15.71:0/1562451946 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50011d20 con 0x7f2d600b5c90 2023-07-06T01:08:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 -- 172.21.15.71:0/1562451946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b5c90 msgr2=0x7f2d600d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 --2- 172.21.15.71:0/1562451946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b5c90 0x7f2d600d2d40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009840 tx=0x7f2d50009b50 comp rx=0 tx=0).stop 2023-07-06T01:08:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 -- 172.21.15.71:0/1562451946 shutdown_connections 2023-07-06T01:08:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 --2- 172.21.15.71:0/1562451946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d600b6110 0x7f2d600d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 --2- 172.21.15.71:0/1562451946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b5c90 0x7f2d600d2d40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 -- 172.21.15.71:0/1562451946 >> 172.21.15.71:0/1562451946 conn(0x7f2d6006c150 msgr2=0x7f2d6006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 -- 172.21.15.71:0/1562451946 shutdown_connections 2023-07-06T01:08:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.203+0000 7f2d685ff700 1 -- 172.21.15.71:0/1562451946 wait complete. 2023-07-06T01:08:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.205+0000 7f2d685ff700 1 Processor -- start 2023-07-06T01:08:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.205+0000 7f2d685ff700 1 -- start start 2023-07-06T01:08:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d685ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d600b5c90 0x7f2d601f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d685ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 0x7f2d600b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d685ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d6015fca0 0x7f2d600b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d685ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601551f0 con 0x7f2d600b6110 2023-07-06T01:08:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d685ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601f60f0 con 0x7f2d600b5c90 2023-07-06T01:08:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d685ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60155440 con 0x7f2d6015fca0 2023-07-06T01:08:52.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d65b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 0x7f2d600b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d65b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 0x7f2d600b76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36222/0 (socket says 172.21.15.71:36222) 2023-07-06T01:08:52.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d65b9a700 1 -- 172.21.15.71:0/3302732635 learned_addr learned my addr 172.21.15.71:0/3302732635 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:52.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d6639b700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d600b5c90 0x7f2d601f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.206+0000 7f2d66b9c700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d6015fca0 0x7f2d600b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d65b9a700 1 -- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d6015fca0 msgr2=0x7f2d600b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d65b9a700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d6015fca0 0x7f2d600b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d65b9a700 1 -- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d600b5c90 msgr2=0x7f2d601f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d65b9a700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d600b5c90 0x7f2d601f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d65b9a700 1 -- 172.21.15.71:0/3302732635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500094a0 con 0x7f2d600b6110 2023-07-06T01:08:52.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d6639b700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d600b5c90 0x7f2d601f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:08:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d65b9a700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 0x7f2d600b76a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d500090b0 tx=0x7f2d50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d500038a0 con 0x7f2d600b6110 2023-07-06T01:08:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5001f070 con 0x7f2d600b6110 2023-07-06T01:08:52.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d60155720 con 0x7f2d600b6110 2023-07-06T01:08:52.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50003c20 con 0x7f2d600b6110 2023-07-06T01:08:52.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.207+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d601f1a90 con 0x7f2d600b6110 2023-07-06T01:08:52.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.208+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d60155c40 con 0x7f2d600b6110 2023-07-06T01:08:52.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.209+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d5001a430 con 0x7f2d600b6110 2023-07-06T01:08:52.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.210+0000 7f2d56ffd700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2d4406ace0 0x7f2d4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.210+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d50021070 con 0x7f2d600b6110 2023-07-06T01:08:52.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.211+0000 7f2d6639b700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2d4406ace0 0x7f2d4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.211+0000 7f2d6639b700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2d4406ace0 0x7f2d4406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c000f60 tx=0x7f2d5c007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:52.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.214+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d60155c40 con 0x7f2d600b6110 2023-07-06T01:08:52.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.410+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d60155c40 con 0x7f2d600b6110 2023-07-06T01:08:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.411+0000 7f2d56ffd700 1 -- 172.21.15.71:0/3302732635 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f2d60155c40 con 0x7f2d600b6110 2023-07-06T01:08:52.413 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:52.413 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:51.009600+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:52.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2d4406ace0 msgr2=0x7f2d4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2d4406ace0 0x7f2d4406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c000f60 tx=0x7f2d5c007d30 comp rx=0 tx=0).stop 2023-07-06T01:08:52.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 msgr2=0x7f2d600b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 0x7f2d600b76a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d500090b0 tx=0x7f2d50004750 comp rx=0 tx=0).stop 2023-07-06T01:08:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 shutdown_connections 2023-07-06T01:08:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2d4406ace0 0x7f2d4406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d6015fca0 0x7f2d600b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d600b5c90 0x7f2d601f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 --2- 172.21.15.71:0/3302732635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d600b6110 0x7f2d600b76a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 >> 172.21.15.71:0/3302732635 conn(0x7f2d6006c150 msgr2=0x7f2d600b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:52.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 shutdown_connections 2023-07-06T01:08:52.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.414+0000 7f2d685ff700 1 -- 172.21.15.71:0/3302732635 wait complete. 2023-07-06T01:08:52.433 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T01:08:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.634+0000 7f9dd59ff700 1 Processor -- start 2023-07-06T01:08:52.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.634+0000 7f9dd59ff700 1 -- start start 2023-07-06T01:08:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.635+0000 7f9dd59ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9dd00b5c90 0x7f9dd00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dd59ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9dd00b6110 0x7f9dd00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dd59ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd00cf780 con 0x7f9dd015fca0 2023-07-06T01:08:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dd59ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd00cd490 con 0x7f9dd00b5c90 2023-07-06T01:08:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dd59ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd00cd770 con 0x7f9dd00b6110 2023-07-06T01:08:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9dd00b5c90 0x7f9dd00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dceffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9dd015fca0 0x7f9dd00d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:40352/0 (socket says 172.21.15.71:40352) 2023-07-06T01:08:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9dd00b5c90 0x7f9dd00d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36236/0 (socket says 172.21.15.71:36236) 2023-07-06T01:08:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dceffd700 1 -- 172.21.15.71:0/716601052 learned_addr learned my addr 172.21.15.71:0/716601052 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dcf7fe700 1 --2- 172.21.15.71:0/716601052 >> v2:172.21.15.194:3300/0 conn(0x7f9dd00b6110 0x7f9dd00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 -- 172.21.15.71:0/716601052 >> v2:172.21.15.194:3300/0 conn(0x7f9dd00b6110 msgr2=0x7f9dd00d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 --2- 172.21.15.71:0/716601052 >> v2:172.21.15.194:3300/0 conn(0x7f9dd00b6110 0x7f9dd00d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 -- 172.21.15.71:0/716601052 >> v1:172.21.15.71:6789/0 conn(0x7f9dd015fca0 legacy=0x7f9dd00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 -- 172.21.15.71:0/716601052 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00cda50 con 0x7f9dd00b5c90 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dcf7fe700 1 --2- 172.21.15.71:0/716601052 >> v2:172.21.15.194:3300/0 conn(0x7f9dd00b6110 0x7f9dd00d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dcdffb700 1 -- 172.21.15.71:0/716601052 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593752487 0 0) 0x7f9dd00cf780 con 0x7f9dd015fca0 2023-07-06T01:08:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.636+0000 7f9dce7fc700 1 --2- 172.21.15.71:0/716601052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd00b5c90 0x7f9dd00d2d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00cd410 tx=0x7f9dc4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418928fc21a11d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dcdffb700 1 -- 172.21.15.71:0/716601052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4011830 con 0x7f9dd00b5c90 2023-07-06T01:08:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dcdffb700 1 -- 172.21.15.71:0/716601052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc4011990 con 0x7f9dd00b5c90 2023-07-06T01:08:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dcdffb700 1 -- 172.21.15.71:0/716601052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4011d20 con 0x7f9dd00b5c90 2023-07-06T01:08:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 -- 172.21.15.71:0/716601052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd00b5c90 msgr2=0x7f9dd00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/716601052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd00b5c90 0x7f9dd00d2d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00cd410 tx=0x7f9dc4009b20 comp rx=0 tx=0).stop 2023-07-06T01:08:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 -- 172.21.15.71:0/716601052 shutdown_connections 2023-07-06T01:08:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/716601052 >> v2:172.21.15.194:3300/0 conn(0x7f9dd00b6110 0x7f9dd00d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/716601052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd00b5c90 0x7f9dd00d2d40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 -- 172.21.15.71:0/716601052 >> 172.21.15.71:0/716601052 conn(0x7f9dd006c150 msgr2=0x7f9dd006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 -- 172.21.15.71:0/716601052 shutdown_connections 2023-07-06T01:08:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.637+0000 7f9dd59ff700 1 -- 172.21.15.71:0/716601052 wait complete. 2023-07-06T01:08:52.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.639+0000 7f9dd59ff700 1 Processor -- start 2023-07-06T01:08:52.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.639+0000 7f9dd59ff700 1 -- start start 2023-07-06T01:08:52.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dd59ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd00b5c90 0x7f9dd01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dd59ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd00b6110 0x7f9dd01f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dd59ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 0x7f9dd00d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dd59ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd01f69a0 con 0x7f9dd015fca0 2023-07-06T01:08:52.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dd59ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd00ccb40 con 0x7f9dd00b6110 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dd59ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd0157410 con 0x7f9dd00b5c90 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dcf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 0x7f9dd00d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dcf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 0x7f9dd00d2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36250/0 (socket says 172.21.15.71:36250) 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.640+0000 7f9dcf7fe700 1 -- 172.21.15.71:0/3253317024 learned_addr learned my addr 172.21.15.71:0/3253317024 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dce7fc700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd00b6110 0x7f9dd01f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dceffd700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd00b5c90 0x7f9dd01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dcf7fe700 1 -- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd00b5c90 msgr2=0x7f9dd01565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dcf7fe700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd00b5c90 0x7f9dd01565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dcf7fe700 1 -- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd00b6110 msgr2=0x7f9dd01f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dcf7fe700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd00b6110 0x7f9dd01f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dcf7fe700 1 -- 172.21.15.71:0/3253317024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40094a0 con 0x7f9dd015fca0 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dcf7fe700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 0x7f9dd00d2a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800cef0 tx=0x7f9dc800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc800ad00 con 0x7f9dd015fca0 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc800ae60 con 0x7f9dd015fca0 2023-07-06T01:08:52.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8015680 con 0x7f9dd015fca0 2023-07-06T01:08:52.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.641+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd00cc080 con 0x7f9dd015fca0 2023-07-06T01:08:52.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.642+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd00cc860 con 0x7f9dd015fca0 2023-07-06T01:08:52.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.643+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd00008d0 con 0x7f9dd015fca0 2023-07-06T01:08:52.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.643+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dc800d430 con 0x7f9dd015fca0 2023-07-06T01:08:52.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.644+0000 7f9db7fff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dbc06ace0 0x7f9dbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:52.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.644+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dc8089930 con 0x7f9dd015fca0 2023-07-06T01:08:52.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.645+0000 7f9dceffd700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dbc06ace0 0x7f9dbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:52.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.645+0000 7f9dceffd700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dbc06ace0 0x7f9dbc06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0000f60 tx=0x7f9dc0007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:52.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.648+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9dc80549e0 con 0x7f9dd015fca0 2023-07-06T01:08:52.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:52.887+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9dd00cc360 con 0x7f9dd015fca0 2023-07-06T01:08:53.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.555+0000 7f9db7fff700 1 -- 172.21.15.71:0/3253317024 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9dc801a0b0 con 0x7f9dd015fca0 2023-07-06T01:08:53.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.557+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dbc06ace0 msgr2=0x7f9dbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:53.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.557+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dbc06ace0 0x7f9dbc06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0000f60 tx=0x7f9dc0007e70 comp rx=0 tx=0).stop 2023-07-06T01:08:53.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.557+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 msgr2=0x7f9dd00d2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.557+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 0x7f9dd00d2a40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800cef0 tx=0x7f9dc800cf20 comp rx=0 tx=0).stop 2023-07-06T01:08:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 shutdown_connections 2023-07-06T01:08:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dbc06ace0 0x7f9dbc06d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dd015fca0 0x7f9dd00d2a40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd00b5c90 0x7f9dd01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 --2- 172.21.15.71:0/3253317024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd00b6110 0x7f9dd01f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 >> 172.21.15.71:0/3253317024 conn(0x7f9dd006c150 msgr2=0x7f9dd00b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 shutdown_connections 2023-07-06T01:08:53.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.558+0000 7f9dd59ff700 1 -- 172.21.15.71:0/3253317024 wait complete. 2023-07-06T01:08:53.578 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T01:08:53.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T01:08:53.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.774+0000 7f27355ff700 1 Processor -- start 2023-07-06T01:08:53.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.774+0000 7f27355ff700 1 -- start start 2023-07-06T01:08:53.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.775+0000 7f27355ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27300b8920 0x7f27300af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:53.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.775+0000 7f27355ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27300b3660 0x7f27300d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:53.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f27355ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300b23b0 con 0x7f27300d0f10 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f27355ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273015cea0 con 0x7f27300b3660 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f27355ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27300b8cf0 con 0x7f27300b8920 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272e7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27300b3660 0x7f27300d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f27300d0f10 0x7f27300b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57616/0 (socket says 172.21.15.71:57616) 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272e7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f27300b3660 0x7f27300d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45130/0 (socket says 172.21.15.71:45130) 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272f7fe700 1 -- 172.21.15.71:0/3587630182 learned_addr learned my addr 172.21.15.71:0/3587630182 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:53.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272effd700 1 --2- 172.21.15.71:0/3587630182 >> v2:172.21.15.194:3300/0 conn(0x7f27300b8920 0x7f27300af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:53.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272e7fc700 1 -- 172.21.15.71:0/3587630182 >> v2:172.21.15.194:3300/0 conn(0x7f27300b8920 msgr2=0x7f27300af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:53.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272e7fc700 1 --2- 172.21.15.71:0/3587630182 >> v2:172.21.15.194:3300/0 conn(0x7f27300b8920 0x7f27300af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272e7fc700 1 -- 172.21.15.71:0/3587630182 >> v1:172.21.15.71:6789/0 conn(0x7f27300d0f10 legacy=0x7f27300b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:53.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.776+0000 7f272e7fc700 1 -- 172.21.15.71:0/3587630182 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300d1310 con 0x7f27300b3660 2023-07-06T01:08:53.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f272e7fc700 1 --2- 172.21.15.71:0/3587630182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b3660 0x7f27300d09d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f273008d310 tx=0x7f2724009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbceec83ccdb0a0e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:53.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f272dffb700 1 -- 172.21.15.71:0/3587630182 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724011830 con 0x7f27300b3660 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f272dffb700 1 -- 172.21.15.71:0/3587630182 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724011990 con 0x7f27300b3660 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f272dffb700 1 -- 172.21.15.71:0/3587630182 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724011d20 con 0x7f27300b3660 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 -- 172.21.15.71:0/3587630182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b3660 msgr2=0x7f27300d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 --2- 172.21.15.71:0/3587630182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b3660 0x7f27300d09d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f273008d310 tx=0x7f2724009b20 comp rx=0 tx=0).stop 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 -- 172.21.15.71:0/3587630182 shutdown_connections 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 --2- 172.21.15.71:0/3587630182 >> v2:172.21.15.194:3300/0 conn(0x7f27300b8920 0x7f27300af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 --2- 172.21.15.71:0/3587630182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300b3660 0x7f27300d09d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 -- 172.21.15.71:0/3587630182 >> 172.21.15.71:0/3587630182 conn(0x7f273009c130 msgr2=0x7f27300d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:53.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 -- 172.21.15.71:0/3587630182 shutdown_connections 2023-07-06T01:08:53.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.777+0000 7f27355ff700 1 -- 172.21.15.71:0/3587630182 wait complete. 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.779+0000 7f27355ff700 1 Processor -- start 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.779+0000 7f27355ff700 1 -- start start 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f27355ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300b3660 0x7f27301f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f27355ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27300b8920 0x7f27300b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f27355ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 0x7f27300b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f27355ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27301f5780 con 0x7f27300d0f10 2023-07-06T01:08:53.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f27355ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27301f59d0 con 0x7f27300b8920 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f27355ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27301f5cb0 con 0x7f27300b3660 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f272f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 0x7f27300b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f272f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 0x7f27300b72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45132/0 (socket says 172.21.15.71:45132) 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.780+0000 7f272f7fe700 1 -- 172.21.15.71:0/2786356691 learned_addr learned my addr 172.21.15.71:0/2786356691 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272effd700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300b3660 0x7f27301f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272e7fc700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27300b8920 0x7f27300b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:53.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272f7fe700 1 -- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300b3660 msgr2=0x7f27301f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272f7fe700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300b3660 0x7f27301f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272f7fe700 1 -- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27300b8920 msgr2=0x7f27300b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272f7fe700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27300b8920 0x7f27300b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272f7fe700 1 -- 172.21.15.71:0/2786356691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240094a0 con 0x7f27300d0f10 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f272f7fe700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 0x7f27300b72f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f272800cbc0 tx=0x7f272800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800ab50 con 0x7f27300d0f10 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800acb0 con 0x7f27300d0f10 2023-07-06T01:08:53.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728012600 con 0x7f27300d0f10 2023-07-06T01:08:53.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.781+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27301f5f90 con 0x7f27300d0f10 2023-07-06T01:08:53.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.782+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27301f1fd0 con 0x7f27300d0f10 2023-07-06T01:08:53.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.783+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27301f64b0 con 0x7f27300d0f10 2023-07-06T01:08:53.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.783+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f272801b3b0 con 0x7f27300d0f10 2023-07-06T01:08:53.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.784+0000 7f27177fe700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f271c06ace0 0x7f271c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:53.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.784+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2728089080 con 0x7f27300d0f10 2023-07-06T01:08:53.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.785+0000 7f272effd700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f271c06ace0 0x7f271c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:53.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.785+0000 7f272effd700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f271c06ace0 0x7f271c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f27300c8040 tx=0x7f2720008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:53.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:53.789+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27301f64b0 con 0x7f27300d0f10 2023-07-06T01:08:54.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.025+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f27301f64b0 con 0x7f27300d0f10 2023-07-06T01:08:54.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.561+0000 7f27177fe700 1 -- 172.21.15.71:0/2786356691 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27301f64b0 con 0x7f27300d0f10 2023-07-06T01:08:54.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.563+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f271c06ace0 msgr2=0x7f271c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:54.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.563+0000 7f27355ff700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f271c06ace0 0x7f271c06d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f27300c8040 tx=0x7f2720008040 comp rx=0 tx=0).stop 2023-07-06T01:08:54.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.563+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 msgr2=0x7f27300b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:54.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.563+0000 7f27355ff700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 0x7f27300b72f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f272800cbc0 tx=0x7f272800cf80 comp rx=0 tx=0).stop 2023-07-06T01:08:54.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 shutdown_connections 2023-07-06T01:08:54.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f271c06ace0 0x7f271c06d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27300d0f10 0x7f27300b72f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300b3660 0x7f27301f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 --2- 172.21.15.71:0/2786356691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27300b8920 0x7f27300b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 >> 172.21.15.71:0/2786356691 conn(0x7f273009c130 msgr2=0x7f27300b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:54.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 shutdown_connections 2023-07-06T01:08:54.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.564+0000 7f27355ff700 1 -- 172.21.15.71:0/2786356691 wait complete. 2023-07-06T01:08:54.584 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T01:08:54.584 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:08:54.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.778+0000 7f717c9ff700 1 Processor -- start 2023-07-06T01:08:54.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.779+0000 7f717c9ff700 1 -- start start 2023-07-06T01:08:54.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f717c9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f71780b5c90 0x7f71780d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:54.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f717c9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b6110 0x7f71780d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:54.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f717c9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780cf780 con 0x7f717815fca0 2023-07-06T01:08:54.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f717c9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780cd490 con 0x7f71780b5c90 2023-07-06T01:08:54.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f717c9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780cd770 con 0x7f71780b6110 2023-07-06T01:08:54.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f71780b5c90 0x7f71780d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:54.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f71780b5c90 0x7f71780d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45144/0 (socket says 172.21.15.71:45144) 2023-07-06T01:08:54.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 -- 172.21.15.71:0/337537006 learned_addr learned my addr 172.21.15.71:0/337537006 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:54.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f7176d9d700 1 --2- 172.21.15.71:0/337537006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b6110 0x7f71780d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:54.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 -- 172.21.15.71:0/337537006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b6110 msgr2=0x7f71780d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:54.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 --2- 172.21.15.71:0/337537006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b6110 0x7f71780d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 -- 172.21.15.71:0/337537006 >> v1:172.21.15.194:6789/0 conn(0x7f717815fca0 legacy=0x7f71780d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:54.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.780+0000 7f716ffff700 1 -- 172.21.15.71:0/337537006 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780cda50 con 0x7f71780b5c90 2023-07-06T01:08:54.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f716ffff700 1 --2- 172.21.15.71:0/337537006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b5c90 0x7f71780d2d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71600098f0 tx=0x7f7160009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e641a21524ed5764 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:54.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f7175d9b700 1 -- 172.21.15.71:0/337537006 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000b8a0 con 0x7f71780b5c90 2023-07-06T01:08:54.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f7175d9b700 1 -- 172.21.15.71:0/337537006 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716000ba00 con 0x7f71780b5c90 2023-07-06T01:08:54.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f7175d9b700 1 -- 172.21.15.71:0/337537006 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000bd90 con 0x7f71780b5c90 2023-07-06T01:08:54.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f717c9ff700 1 -- 172.21.15.71:0/337537006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b5c90 msgr2=0x7f71780d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:54.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f717c9ff700 1 --2- 172.21.15.71:0/337537006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b5c90 0x7f71780d2d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71600098f0 tx=0x7f7160009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:54.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.781+0000 7f717c9ff700 1 -- 172.21.15.71:0/337537006 shutdown_connections 2023-07-06T01:08:54.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.782+0000 7f717c9ff700 1 --2- 172.21.15.71:0/337537006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b6110 0x7f71780d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.782+0000 7f717c9ff700 1 --2- 172.21.15.71:0/337537006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b5c90 0x7f71780d2d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.782+0000 7f717c9ff700 1 -- 172.21.15.71:0/337537006 >> 172.21.15.71:0/337537006 conn(0x7f717806c150 msgr2=0x7f717806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:54.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.782+0000 7f717c9ff700 1 -- 172.21.15.71:0/337537006 shutdown_connections 2023-07-06T01:08:54.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.782+0000 7f717c9ff700 1 -- 172.21.15.71:0/337537006 wait complete. 2023-07-06T01:08:54.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.784+0000 7f717c9ff700 1 Processor -- start 2023-07-06T01:08:54.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.784+0000 7f717c9ff700 1 -- start start 2023-07-06T01:08:54.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.785+0000 7f717c9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b5c90 0x7f71780c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:54.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.785+0000 7f717c9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 0x7f7178156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:54.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.785+0000 7f717c9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f717815fca0 0x7f71780cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:54.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.785+0000 7f717c9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c7180 con 0x7f71780b6110 2023-07-06T01:08:54.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.785+0000 7f717c9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c7460 con 0x7f717815fca0 2023-07-06T01:08:54.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.785+0000 7f717c9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c7740 con 0x7f71780b5c90 2023-07-06T01:08:54.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 0x7f7178156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:54.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 0x7f7178156bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45152/0 (socket says 172.21.15.71:45152) 2023-07-06T01:08:54.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 -- 172.21.15.71:0/748414538 learned_addr learned my addr 172.21.15.71:0/748414538 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:54.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f7176d9d700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f717815fca0 0x7f71780cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:54.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f717659c700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b5c90 0x7f71780c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:54.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 -- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b5c90 msgr2=0x7f71780c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:54.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b5c90 0x7f71780c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 -- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f717815fca0 msgr2=0x7f71780cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:54.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f717815fca0 0x7f71780cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:54.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 -- 172.21.15.71:0/748414538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160009550 con 0x7f71780b6110 2023-07-06T01:08:54.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716ffff700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 0x7f7178156bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7160000c00 tx=0x7f7160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:54.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.786+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7160004480 con 0x7f71780b6110 2023-07-06T01:08:54.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.787+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716001f070 con 0x7f71780b6110 2023-07-06T01:08:54.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.787+0000 7f717c9ff700 1 -- 172.21.15.71:0/748414538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71780c7a20 con 0x7f71780b6110 2023-07-06T01:08:54.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.787+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71600038c0 con 0x7f71780b6110 2023-07-06T01:08:54.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.787+0000 7f717c9ff700 1 -- 172.21.15.71:0/748414538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780c6e70 con 0x7f71780b6110 2023-07-06T01:08:54.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.788+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500052f0 con 0x7f71780b6110 2023-07-06T01:08:54.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.788+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7160021030 con 0x7f71780b6110 2023-07-06T01:08:54.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.789+0000 7f716effd700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f715806ace0 0x7f715806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:54.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.789+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f716008a9a0 con 0x7f71780b6110 2023-07-06T01:08:54.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.790+0000 7f717659c700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f715806ace0 0x7f715806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:54.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.790+0000 7f717659c700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f715806ace0 0x7f715806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7168000f60 tx=0x7f7168009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:54.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:54.794+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7160055c00 con 0x7f71780b6110 2023-07-06T01:08:55.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.032+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71500055a0 con 0x7f71780b6110 2023-07-06T01:08:55.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.033+0000 7f716effd700 1 -- 172.21.15.71:0/748414538 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f7160059220 con 0x7f71780b6110 2023-07-06T01:08:55.036 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:55.036 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:08:55.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f715806ace0 msgr2=0x7f715806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f715806ace0 0x7f715806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7168000f60 tx=0x7f7168009040 comp rx=0 tx=0).stop 2023-07-06T01:08:55.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 msgr2=0x7f7178156bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 0x7f7178156bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7160000c00 tx=0x7f7160004750 comp rx=0 tx=0).stop 2023-07-06T01:08:55.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 shutdown_connections 2023-07-06T01:08:55.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f715806ace0 0x7f715806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f717815fca0 0x7f71780cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71780b5c90 0x7f71780c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 --2- 172.21.15.71:0/748414538 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71780b6110 0x7f7178156bd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 >> 172.21.15.71:0/748414538 conn(0x7f717806c150 msgr2=0x7f717815a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:55.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 shutdown_connections 2023-07-06T01:08:55.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.035+0000 7f716cff9700 1 -- 172.21.15.71:0/748414538 wait complete. 2023-07-06T01:08:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:08:55.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:08:55.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.248+0000 7fcc513ff700 1 Processor -- start 2023-07-06T01:08:55.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.249+0000 7fcc513ff700 1 -- start start 2023-07-06T01:08:55.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc513ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc513ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc4c0b5c90 0x7fcc4c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc513ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc4c0b6100 0x7fcc4c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc513ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c0cf780 con 0x7fcc4c0b5c90 2023-07-06T01:08:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc513ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c0cd490 con 0x7fcc4c0b6100 2023-07-06T01:08:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc513ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0cd770 con 0x7fcc4c15fca0 2023-07-06T01:08:55.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc43fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc4c0b5c90 0x7fcc4c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc43fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc4c0b5c90 0x7fcc4c0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45156/0 (socket says 172.21.15.71:45156) 2023-07-06T01:08:55.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc43fff700 1 -- 172.21.15.71:0/18341872 learned_addr learned my addr 172.21.15.71:0/18341872 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:55.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc43fff700 1 -- 172.21.15.71:0/18341872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 msgr2=0x7fcc4c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:55.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc4affd700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.250+0000 7fcc4b7fe700 1 --2- 172.21.15.71:0/18341872 >> v2:172.21.15.194:3300/0 conn(0x7fcc4c0b6100 0x7fcc4c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc43fff700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc43fff700 1 -- 172.21.15.71:0/18341872 >> v2:172.21.15.194:3300/0 conn(0x7fcc4c0b6100 msgr2=0x7fcc4c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc43fff700 1 --2- 172.21.15.71:0/18341872 >> v2:172.21.15.194:3300/0 conn(0x7fcc4c0b6100 0x7fcc4c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc43fff700 1 -- 172.21.15.71:0/18341872 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0cda50 con 0x7fcc4c0b5c90 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc4b7fe700 1 --2- 172.21.15.71:0/18341872 >> v2:172.21.15.194:3300/0 conn(0x7fcc4c0b6100 0x7fcc4c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc4affd700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:55.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc43fff700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c0d2d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0b8f80 tx=0x7fcc34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1491095029dbcb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc4a7fc700 1 -- 172.21.15.71:0/18341872 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400b870 con 0x7fcc4c0b5c90 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc4a7fc700 1 -- 172.21.15.71:0/18341872 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3400b9d0 con 0x7fcc4c0b5c90 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.251+0000 7fcc4a7fc700 1 -- 172.21.15.71:0/18341872 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400bd60 con 0x7fcc4c0b5c90 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 -- 172.21.15.71:0/18341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b5c90 msgr2=0x7fcc4c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c0d2d40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0b8f80 tx=0x7fcc34009bd0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 -- 172.21.15.71:0/18341872 shutdown_connections 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 --2- 172.21.15.71:0/18341872 >> v2:172.21.15.194:3300/0 conn(0x7fcc4c0b6100 0x7fcc4c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 --2- 172.21.15.71:0/18341872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c0d2d40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 -- 172.21.15.71:0/18341872 >> 172.21.15.71:0/18341872 conn(0x7fcc4c06c150 msgr2=0x7fcc4c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 -- 172.21.15.71:0/18341872 shutdown_connections 2023-07-06T01:08:55.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.252+0000 7fcc513ff700 1 -- 172.21.15.71:0/18341872 wait complete. 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.254+0000 7fcc513ff700 1 Processor -- start 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.254+0000 7fcc513ff700 1 -- start start 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.255+0000 7fcc513ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc513ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 0x7fcc4c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc513ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc513ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c14d7a0 con 0x7fcc4c0b6100 2023-07-06T01:08:55.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc513ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c1f2010 con 0x7fcc4c0b5c90 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc513ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c1f22d0 con 0x7fcc4c15fca0 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 0x7fcc4c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 0x7fcc4c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45166/0 (socket says 172.21.15.71:45166) 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 -- 172.21.15.71:0/2891833140 learned_addr learned my addr 172.21.15.71:0/2891833140 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc4b7fe700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc4affd700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 -- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 msgr2=0x7fcc4c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 -- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc4c0b5c90 msgr2=0x7fcc4c14d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c14d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 -- 172.21.15.71:0/2891833140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34009550 con 0x7fcc4c0b6100 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc4b7fe700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc4affd700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c14d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:55.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.256+0000 7fcc43fff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 0x7fcc4c159390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc34014040 tx=0x7fcc34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.257+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34004520 con 0x7fcc4c0b6100 2023-07-06T01:08:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.257+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3401e070 con 0x7fcc4c0b6100 2023-07-06T01:08:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.257+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c1f25b0 con 0x7fcc4c0b6100 2023-07-06T01:08:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.257+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc340038e0 con 0x7fcc4c0b6100 2023-07-06T01:08:55.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.257+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c1f2b70 con 0x7fcc4c0b6100 2023-07-06T01:08:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.258+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c1f2ea0 con 0x7fcc4c0b6100 2023-07-06T01:08:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.259+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc34003a40 con 0x7fcc4c0b6100 2023-07-06T01:08:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.260+0000 7fcc437fe700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcc2c06ace0 0x7fcc2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.260+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc34020070 con 0x7fcc4c0b6100 2023-07-06T01:08:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.260+0000 7fcc4affd700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcc2c06ace0 0x7fcc2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.261+0000 7fcc4affd700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcc2c06ace0 0x7fcc2c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0089b0 tx=0x7fcc3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:55.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.264+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc34055c10 con 0x7fcc4c0b6100 2023-07-06T01:08:55.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.461+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc4c0008d0 con 0x7fcc4c0b6100 2023-07-06T01:08:55.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.462+0000 7fcc437fe700 1 -- 172.21.15.71:0/2891833140 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fcc34015090 con 0x7fcc4c0b6100 2023-07-06T01:08:55.464 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:55.464 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:08:55.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcc2c06ace0 msgr2=0x7fcc2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcc2c06ace0 0x7fcc2c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0089b0 tx=0x7fcc3c008040 comp rx=0 tx=0).stop 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 msgr2=0x7fcc4c159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 0x7fcc4c159390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc34014040 tx=0x7fcc34004750 comp rx=0 tx=0).stop 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 shutdown_connections 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcc2c06ace0 0x7fcc2c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc4c15fca0 0x7fcc4c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc4c0b5c90 0x7fcc4c14d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 --2- 172.21.15.71:0/2891833140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc4c0b6100 0x7fcc4c159390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 >> 172.21.15.71:0/2891833140 conn(0x7fcc4c06c150 msgr2=0x7fcc4c0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:55.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 shutdown_connections 2023-07-06T01:08:55.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.465+0000 7fcc513ff700 1 -- 172.21.15.71:0/2891833140 wait complete. 2023-07-06T01:08:55.485 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T01:08:55.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:08:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.678+0000 7f2f873ff700 1 Processor -- start 2023-07-06T01:08:55.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.678+0000 7f2f873ff700 1 -- start start 2023-07-06T01:08:55.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f873ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f8015fca0 0x7f2f800d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f873ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f800b6110 0x7f2f800cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f873ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800cf780 con 0x7f2f800b5c90 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f873ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800cd490 con 0x7f2f8015fca0 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f873ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800cd770 con 0x7f2f800b6110 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f8519b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f8015fca0 0x7f2f800d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f8519b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f8015fca0 0x7f2f800d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45174/0 (socket says 172.21.15.71:45174) 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f8519b700 1 -- 172.21.15.71:0/1343364254 learned_addr learned my addr 172.21.15.71:0/1343364254 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.679+0000 7f2f8499a700 1 --1- 172.21.15.71:0/1343364254 >> v1:172.21.15.71:6789/0 conn(0x7f2f800b5c90 0x7f2f800d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57620/0 (socket says 172.21.15.71:57620) 2023-07-06T01:08:55.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f8599c700 1 --2- 172.21.15.71:0/1343364254 >> v2:172.21.15.194:3300/0 conn(0x7f2f800b6110 0x7f2f800cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f8519b700 1 -- 172.21.15.71:0/1343364254 >> v2:172.21.15.194:3300/0 conn(0x7f2f800b6110 msgr2=0x7f2f800cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f8519b700 1 --2- 172.21.15.71:0/1343364254 >> v2:172.21.15.194:3300/0 conn(0x7f2f800b6110 0x7f2f800cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f8519b700 1 -- 172.21.15.71:0/1343364254 >> v1:172.21.15.71:6789/0 conn(0x7f2f800b5c90 legacy=0x7f2f800d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f8519b700 1 -- 172.21.15.71:0/1343364254 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800cda50 con 0x7f2f8015fca0 2023-07-06T01:08:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f77fff700 1 -- 172.21.15.71:0/1343364254 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420644899 0 0) 0x7f2f800cf780 con 0x7f2f800b5c90 2023-07-06T01:08:55.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f8519b700 1 --2- 172.21.15.71:0/1343364254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f8015fca0 0x7f2f800d1420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f800cd410 tx=0x7f2f7c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b8a9c76e449364 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:55.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f77fff700 1 -- 172.21.15.71:0/1343364254 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00b870 con 0x7f2f8015fca0 2023-07-06T01:08:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f77fff700 1 -- 172.21.15.71:0/1343364254 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00b9d0 con 0x7f2f8015fca0 2023-07-06T01:08:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.680+0000 7f2f77fff700 1 -- 172.21.15.71:0/1343364254 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00bd60 con 0x7f2f8015fca0 2023-07-06T01:08:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 -- 172.21.15.71:0/1343364254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f8015fca0 msgr2=0x7f2f800d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 --2- 172.21.15.71:0/1343364254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f8015fca0 0x7f2f800d1420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f800cd410 tx=0x7f2f7c009bd0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 -- 172.21.15.71:0/1343364254 shutdown_connections 2023-07-06T01:08:55.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 --2- 172.21.15.71:0/1343364254 >> v2:172.21.15.194:3300/0 conn(0x7f2f800b6110 0x7f2f800cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 --2- 172.21.15.71:0/1343364254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f8015fca0 0x7f2f800d1420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 -- 172.21.15.71:0/1343364254 >> 172.21.15.71:0/1343364254 conn(0x7f2f8006c150 msgr2=0x7f2f8006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 -- 172.21.15.71:0/1343364254 shutdown_connections 2023-07-06T01:08:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.681+0000 7f2f873ff700 1 -- 172.21.15.71:0/1343364254 wait complete. 2023-07-06T01:08:55.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.683+0000 7f2f873ff700 1 Processor -- start 2023-07-06T01:08:55.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.684+0000 7f2f873ff700 1 -- start start 2023-07-06T01:08:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f873ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 0x7f2f801f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f873ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f800b6110 0x7f2f800c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f873ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f8015fca0 0x7f2f800cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f873ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800ca450 con 0x7f2f800b5c90 2023-07-06T01:08:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f873ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800ca6d0 con 0x7f2f800b6110 2023-07-06T01:08:55.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f873ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800ca9b0 con 0x7f2f8015fca0 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 0x7f2f801f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 0x7f2f801f2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45182/0 (socket says 172.21.15.71:45182) 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 -- 172.21.15.71:0/3130493888 learned_addr learned my addr 172.21.15.71:0/3130493888 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 -- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f8015fca0 msgr2=0x7f2f800cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f8015fca0 0x7f2f800cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 -- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f800b6110 msgr2=0x7f2f800c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f800b6110 0x7f2f800c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 -- 172.21.15.71:0/3130493888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c009550 con 0x7f2f800b5c90 2023-07-06T01:08:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.685+0000 7f2f8519b700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 0x7f2f801f2a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c000c00 tx=0x7f2f7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.686+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c004520 con 0x7f2f800b5c90 2023-07-06T01:08:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.686+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c01e070 con 0x7f2f800b5c90 2023-07-06T01:08:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.686+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800cac90 con 0x7f2f800b5c90 2023-07-06T01:08:55.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.686+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0038a0 con 0x7f2f800b5c90 2023-07-06T01:08:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.686+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f800cb250 con 0x7f2f800b5c90 2023-07-06T01:08:55.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.687+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f80067000 con 0x7f2f800b5c90 2023-07-06T01:08:55.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.688+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f7c003a00 con 0x7f2f800b5c90 2023-07-06T01:08:55.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.689+0000 7f2f75ffb700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f6406ace0 0x7f2f6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:55.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.689+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f7c020070 con 0x7f2f800b5c90 2023-07-06T01:08:55.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.689+0000 7f2f8499a700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f6406ace0 0x7f2f6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:55.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.690+0000 7f2f8499a700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f6406ace0 0x7f2f6406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f700011e0 tx=0x7f2f700079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:55.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.693+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f7c055b20 con 0x7f2f800b5c90 2023-07-06T01:08:55.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.882+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f8006ae40 con 0x7f2f6406ace0 2023-07-06T01:08:55.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.893+0000 7f2f75ffb700 1 -- 172.21.15.71:0/3130493888 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282789 (secure 0 0 0) 0x7f2f700070d0 con 0x7f2f6406ace0 2023-07-06T01:08:55.898 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:55.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f6406ace0 msgr2=0x7f2f6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f6406ace0 0x7f2f6406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f700011e0 tx=0x7f2f700079b0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 msgr2=0x7f2f801f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:55.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 0x7f2f801f2a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c000c00 tx=0x7f2f7c004750 comp rx=0 tx=0).stop 2023-07-06T01:08:55.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 shutdown_connections 2023-07-06T01:08:55.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f6406ace0 0x7f2f6406d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f8015fca0 0x7f2f800cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f800b5c90 0x7f2f801f2a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 --2- 172.21.15.71:0/3130493888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f800b6110 0x7f2f800c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:55.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 >> 172.21.15.71:0/3130493888 conn(0x7f2f8006c150 msgr2=0x7f2f800d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:55.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 shutdown_connections 2023-07-06T01:08:55.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:55.897+0000 7f2f873ff700 1 -- 172.21.15.71:0/3130493888 wait complete. 2023-07-06T01:08:55.902 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:08:55.916 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T01:08:54.823373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2899968,"data_stored":1774040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.312409"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523834+0000","last_change":"2023-07-06T01:08:50.523834+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523834+0000","last_undegraded":"2023-07-06T01:08:50.523834+0000","last_fullsized":"2023-07-06T01:08:50.523834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561492+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:51.561492+0000","last_peered":"2023-07-06T01:08:51.561492+0000","last_clean":"2023-07-06T01:08:51.561492+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:51.561492+0000","last_undegraded":"2023-07-06T01:08:51.561492+0000","last_fullsized":"2023-07-06T01:08:51.561492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.534233+0000","last_change":"2023-07-06T01:08:50.534233+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.534233+0000","last_undegraded":"2023-07-06T01:08:50.534233+0000","last_fullsized":"2023-07-06T01:08:50.534233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521068+0000","last_change":"2023-07-06T01:08:50.521068+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521068+0000","last_undegraded":"2023-07-06T01:08:50.521068+0000","last_fullsized":"2023-07-06T01:08:50.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.551114+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:51.551114+0000","last_peered":"2023-07-06T01:08:51.551114+0000","last_clean":"2023-07-06T01:08:51.551114+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:51.551114+0000","last_undegraded":"2023-07-06T01:08:51.551114+0000","last_fullsized":"2023-07-06T01:08:51.551114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.534330+0000","last_change":"2023-07-06T01:08:50.534330+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.534330+0000","last_undegraded":"2023-07-06T01:08:50.534330+0000","last_fullsized":"2023-07-06T01:08:50.534330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521443+0000","last_change":"2023-07-06T01:08:50.521443+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521443+0000","last_undegraded":"2023-07-06T01:08:50.521443+0000","last_fullsized":"2023-07-06T01:08:50.521443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.567746+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:51.567746+0000","last_peered":"2023-07-06T01:08:51.567746+0000","last_clean":"2023-07-06T01:08:51.567746+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:51.567746+0000","last_undegraded":"2023-07-06T01:08:51.567746+0000","last_fullsized":"2023-07-06T01:08:51.567746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550779+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:51.550779+0000","last_peered":"2023-07-06T01:08:51.550779+0000","last_clean":"2023-07-06T01:08:51.550779+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:51.550779+0000","last_undegraded":"2023-07-06T01:08:51.550779+0000","last_fullsized":"2023-07-06T01:08:51.550779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:21.687284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561474+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:51.561474+0000","last_peered":"2023-07-06T01:08:51.561474+0000","last_clean":"2023-07-06T01:08:51.561474+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:51.561474+0000","last_undegraded":"2023-07-06T01:08:51.561474+0000","last_fullsized":"2023-07-06T01:08:51.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533228+0000","last_change":"2023-07-06T01:08:50.533228+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533228+0000","last_undegraded":"2023-07-06T01:08:50.533228+0000","last_fullsized":"2023-07-06T01:08:50.533228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522072+0000","last_change":"2023-07-06T01:08:50.522072+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522072+0000","last_undegraded":"2023-07-06T01:08:50.522072+0000","last_fullsized":"2023-07-06T01:08:50.522072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.524535+0000","last_change":"2023-07-06T01:08:50.524535+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.524535+0000","last_undegraded":"2023-07-06T01:08:50.524535+0000","last_fullsized":"2023-07-06T01:08:50.524535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561576+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:51.561576+0000","last_peered":"2023-07-06T01:08:51.561576+0000","last_clean":"2023-07-06T01:08:51.561576+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:51.561576+0000","last_undegraded":"2023-07-06T01:08:51.561576+0000","last_fullsized":"2023-07-06T01:08:51.561576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520813+0000","last_change":"2023-07-06T01:08:50.520813+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520813+0000","last_undegraded":"2023-07-06T01:08:50.520813+0000","last_fullsized":"2023-07-06T01:08:50.520813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526317+0000","last_change":"2023-07-06T01:08:50.526317+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526317+0000","last_undegraded":"2023-07-06T01:08:50.526317+0000","last_fullsized":"2023-07-06T01:08:50.526317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557675+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:51.557675+0000","last_peered":"2023-07-06T01:08:51.557675+0000","last_clean":"2023-07-06T01:08:51.557675+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:51.557675+0000","last_undegraded":"2023-07-06T01:08:51.557675+0000","last_fullsized":"2023-07-06T01:08:51.557675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533297+0000","last_change":"2023-07-06T01:08:50.533297+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533297+0000","last_undegraded":"2023-07-06T01:08:50.533297+0000","last_fullsized":"2023-07-06T01:08:50.533297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523242+0000","last_change":"2023-07-06T01:08:50.523242+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523242+0000","last_undegraded":"2023-07-06T01:08:50.523242+0000","last_fullsized":"2023-07-06T01:08:50.523242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.532412+0000","last_change":"2023-07-06T01:08:50.532412+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.532412+0000","last_undegraded":"2023-07-06T01:08:50.532412+0000","last_fullsized":"2023-07-06T01:08:50.532412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521933+0000","last_change":"2023-07-06T01:08:50.521933+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521933+0000","last_undegraded":"2023-07-06T01:08:50.521933+0000","last_fullsized":"2023-07-06T01:08:50.521933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557593+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:51.557593+0000","last_peered":"2023-07-06T01:08:51.557593+0000","last_clean":"2023-07-06T01:08:51.557593+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:51.557593+0000","last_undegraded":"2023-07-06T01:08:51.557593+0000","last_fullsized":"2023-07-06T01:08:51.557593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:18.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.525630+0000","last_change":"2023-07-06T01:08:50.525630+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.525630+0000","last_undegraded":"2023-07-06T01:08:50.525630+0000","last_fullsized":"2023-07-06T01:08:50.525630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520240+0000","last_change":"2023-07-06T01:08:50.520240+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520240+0000","last_undegraded":"2023-07-06T01:08:50.520240+0000","last_fullsized":"2023-07-06T01:08:50.520240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523285+0000","last_change":"2023-07-06T01:08:50.523285+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523285+0000","last_undegraded":"2023-07-06T01:08:50.523285+0000","last_fullsized":"2023-07-06T01:08:50.523285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521594+0000","last_change":"2023-07-06T01:08:50.521594+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521594+0000","last_undegraded":"2023-07-06T01:08:50.521594+0000","last_fullsized":"2023-07-06T01:08:50.521594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561550+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:51.561550+0000","last_peered":"2023-07-06T01:08:51.561550+0000","last_clean":"2023-07-06T01:08:51.561550+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:51.561550+0000","last_undegraded":"2023-07-06T01:08:51.561550+0000","last_fullsized":"2023-07-06T01:08:51.561550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.547735+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:50.547735+0000","last_peered":"2023-07-06T01:08:50.547735+0000","last_clean":"2023-07-06T01:08:50.547735+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:50.547735+0000","last_undegraded":"2023-07-06T01:08:50.547735+0000","last_fullsized":"2023-07-06T01:08:50.547735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:21.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.531285+0000","last_change":"2023-07-06T01:08:50.531285+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.531285+0000","last_undegraded":"2023-07-06T01:08:50.531285+0000","last_fullsized":"2023-07-06T01:08:50.531285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539513+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:50.539513+0000","last_peered":"2023-07-06T01:08:50.539513+0000","last_clean":"2023-07-06T01:08:50.539513+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:50.539513+0000","last_undegraded":"2023-07-06T01:08:50.539513+0000","last_fullsized":"2023-07-06T01:08:50.539513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550435+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:51.550435+0000","last_peered":"2023-07-06T01:08:51.550435+0000","last_clean":"2023-07-06T01:08:51.550435+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:51.550435+0000","last_undegraded":"2023-07-06T01:08:51.550435+0000","last_fullsized":"2023-07-06T01:08:51.550435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:33.241903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.542050+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:50.542050+0000","last_peered":"2023-07-06T01:08:50.542050+0000","last_clean":"2023-07-06T01:08:50.542050+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:50.542050+0000","last_undegraded":"2023-07-06T01:08:50.542050+0000","last_fullsized":"2023-07-06T01:08:50.542050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:55.840317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521965+0000","last_change":"2023-07-06T01:08:50.521965+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521965+0000","last_undegraded":"2023-07-06T01:08:50.521965+0000","last_fullsized":"2023-07-06T01:08:50.521965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529840+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:51.529840+0000","last_peered":"2023-07-06T01:08:51.529840+0000","last_clean":"2023-07-06T01:08:51.529840+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:51.529840+0000","last_undegraded":"2023-07-06T01:08:51.529840+0000","last_fullsized":"2023-07-06T01:08:51.529840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.527276+0000","last_change":"2023-07-06T01:08:50.527276+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.527276+0000","last_undegraded":"2023-07-06T01:08:50.527276+0000","last_fullsized":"2023-07-06T01:08:50.527276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.535933+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:51.535933+0000","last_peered":"2023-07-06T01:08:51.535933+0000","last_clean":"2023-07-06T01:08:51.535933+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:51.535933+0000","last_undegraded":"2023-07-06T01:08:51.535933+0000","last_fullsized":"2023-07-06T01:08:51.535933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:14.557999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526038+0000","last_change":"2023-07-06T01:08:50.526038+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526038+0000","last_undegraded":"2023-07-06T01:08:50.526038+0000","last_fullsized":"2023-07-06T01:08:50.526038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545183+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:50.545183+0000","last_peered":"2023-07-06T01:08:50.545183+0000","last_clean":"2023-07-06T01:08:50.545183+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:50.545183+0000","last_undegraded":"2023-07-06T01:08:50.545183+0000","last_fullsized":"2023-07-06T01:08:50.545183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:20.680536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522931+0000","last_change":"2023-07-06T01:08:50.522931+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522931+0000","last_undegraded":"2023-07-06T01:08:50.522931+0000","last_fullsized":"2023-07-06T01:08:50.522931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544595+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:50.544595+0000","last_peered":"2023-07-06T01:08:50.544595+0000","last_clean":"2023-07-06T01:08:50.544595+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:50.544595+0000","last_undegraded":"2023-07-06T01:08:50.544595+0000","last_fullsized":"2023-07-06T01:08:50.544595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:51:01.235254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533531+0000","last_change":"2023-07-06T01:08:50.533531+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533531+0000","last_undegraded":"2023-07-06T01:08:50.533531+0000","last_fullsized":"2023-07-06T01:08:50.533531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544682+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:50.544682+0000","last_peered":"2023-07-06T01:08:50.544682+0000","last_clean":"2023-07-06T01:08:50.544682+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:50.544682+0000","last_undegraded":"2023-07-06T01:08:50.544682+0000","last_fullsized":"2023-07-06T01:08:50.544682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.529420+0000","last_change":"2023-07-06T01:08:50.529420+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.529420+0000","last_undegraded":"2023-07-06T01:08:50.529420+0000","last_fullsized":"2023-07-06T01:08:50.529420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528681+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:51.528681+0000","last_peered":"2023-07-06T01:08:51.528681+0000","last_clean":"2023-07-06T01:08:51.528681+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:51.528681+0000","last_undegraded":"2023-07-06T01:08:51.528681+0000","last_fullsized":"2023-07-06T01:08:51.528681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561532+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:51.561532+0000","last_peered":"2023-07-06T01:08:51.561532+0000","last_clean":"2023-07-06T01:08:51.561532+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:51.561532+0000","last_undegraded":"2023-07-06T01:08:51.561532+0000","last_fullsized":"2023-07-06T01:08:51.561532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544655+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:50.544655+0000","last_peered":"2023-07-06T01:08:50.544655+0000","last_clean":"2023-07-06T01:08:50.544655+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:50.544655+0000","last_undegraded":"2023-07-06T01:08:50.544655+0000","last_fullsized":"2023-07-06T01:08:50.544655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:32.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550797+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:51.550797+0000","last_peered":"2023-07-06T01:08:51.550797+0000","last_clean":"2023-07-06T01:08:51.550797+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:51.550797+0000","last_undegraded":"2023-07-06T01:08:51.550797+0000","last_fullsized":"2023-07-06T01:08:51.550797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:49.267223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.533192+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:50.533192+0000","last_peered":"2023-07-06T01:08:50.533192+0000","last_clean":"2023-07-06T01:08:50.533192+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:50.533192+0000","last_undegraded":"2023-07-06T01:08:50.533192+0000","last_fullsized":"2023-07-06T01:08:50.533192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:55.840317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.530119+0000","last_change":"2023-07-06T01:08:50.530119+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.530119+0000","last_undegraded":"2023-07-06T01:08:50.530119+0000","last_fullsized":"2023-07-06T01:08:50.530119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545150+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:50.545150+0000","last_peered":"2023-07-06T01:08:50.545150+0000","last_clean":"2023-07-06T01:08:50.545150+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:50.545150+0000","last_undegraded":"2023-07-06T01:08:50.545150+0000","last_fullsized":"2023-07-06T01:08:50.545150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:48.837818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561444+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:51.561444+0000","last_peered":"2023-07-06T01:08:51.561444+0000","last_clean":"2023-07-06T01:08:51.561444+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:51.561444+0000","last_undegraded":"2023-07-06T01:08:51.561444+0000","last_fullsized":"2023-07-06T01:08:51.561444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545119+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:50.545119+0000","last_peered":"2023-07-06T01:08:50.545119+0000","last_clean":"2023-07-06T01:08:50.545119+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:50.545119+0000","last_undegraded":"2023-07-06T01:08:50.545119+0000","last_fullsized":"2023-07-06T01:08:50.545119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:09.991008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528119+0000","last_change":"2023-07-06T01:08:50.528119+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528119+0000","last_undegraded":"2023-07-06T01:08:50.528119+0000","last_fullsized":"2023-07-06T01:08:50.528119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545199+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:50.545199+0000","last_peered":"2023-07-06T01:08:50.545199+0000","last_clean":"2023-07-06T01:08:50.545199+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:50.545199+0000","last_undegraded":"2023-07-06T01:08:50.545199+0000","last_fullsized":"2023-07-06T01:08:50.545199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:41.923174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523002+0000","last_change":"2023-07-06T01:08:50.523002+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523002+0000","last_undegraded":"2023-07-06T01:08:50.523002+0000","last_fullsized":"2023-07-06T01:08:50.523002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531958+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:51.531958+0000","last_peered":"2023-07-06T01:08:51.531958+0000","last_clean":"2023-07-06T01:08:51.531958+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:51.531958+0000","last_undegraded":"2023-07-06T01:08:51.531958+0000","last_fullsized":"2023-07-06T01:08:51.531958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.549593+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:51.549593+0000","last_peered":"2023-07-06T01:08:51.549593+0000","last_clean":"2023-07-06T01:08:51.549593+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:51.549593+0000","last_undegraded":"2023-07-06T01:08:51.549593+0000","last_fullsized":"2023-07-06T01:08:51.549593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539578+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:50.539578+0000","last_peered":"2023-07-06T01:08:50.539578+0000","last_clean":"2023-07-06T01:08:50.539578+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:50.539578+0000","last_undegraded":"2023-07-06T01:08:50.539578+0000","last_fullsized":"2023-07-06T01:08:50.539578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:36.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.531654+0000","last_change":"2023-07-06T01:08:50.531654+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.531654+0000","last_undegraded":"2023-07-06T01:08:50.531654+0000","last_fullsized":"2023-07-06T01:08:50.531654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.538412+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:50.538412+0000","last_peered":"2023-07-06T01:08:50.538412+0000","last_clean":"2023-07-06T01:08:50.538412+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:50.538412+0000","last_undegraded":"2023-07-06T01:08:50.538412+0000","last_fullsized":"2023-07-06T01:08:50.538412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528599+0000","last_change":"2023-07-06T01:08:50.528599+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528599+0000","last_undegraded":"2023-07-06T01:08:50.528599+0000","last_fullsized":"2023-07-06T01:08:50.528599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.540572+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:50.540572+0000","last_peered":"2023-07-06T01:08:50.540572+0000","last_clean":"2023-07-06T01:08:50.540572+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:50.540572+0000","last_undegraded":"2023-07-06T01:08:50.540572+0000","last_fullsized":"2023-07-06T01:08:50.540572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:50:02.670638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528790+0000","last_change":"2023-07-06T01:08:50.528790+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528790+0000","last_undegraded":"2023-07-06T01:08:50.528790+0000","last_fullsized":"2023-07-06T01:08:50.528790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544947+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:50.544947+0000","last_peered":"2023-07-06T01:08:50.544947+0000","last_clean":"2023-07-06T01:08:50.544947+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:50.544947+0000","last_undegraded":"2023-07-06T01:08:50.544947+0000","last_fullsized":"2023-07-06T01:08:50.544947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:14:03.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521013+0000","last_change":"2023-07-06T01:08:50.521013+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521013+0000","last_undegraded":"2023-07-06T01:08:50.521013+0000","last_fullsized":"2023-07-06T01:08:50.521013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522793+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:50.522793+0000","last_peered":"2023-07-06T01:08:50.522793+0000","last_clean":"2023-07-06T01:08:50.522793+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:50.522793+0000","last_undegraded":"2023-07-06T01:08:50.522793+0000","last_fullsized":"2023-07-06T01:08:50.522793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:42.920596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.534381+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:51.534381+0000","last_peered":"2023-07-06T01:08:51.534381+0000","last_clean":"2023-07-06T01:08:51.534381+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:51.534381+0000","last_undegraded":"2023-07-06T01:08:51.534381+0000","last_fullsized":"2023-07-06T01:08:51.534381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:01.848614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520467+0000","last_change":"2023-07-06T01:08:50.520467+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520467+0000","last_undegraded":"2023-07-06T01:08:50.520467+0000","last_fullsized":"2023-07-06T01:08:50.520467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.536319+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:51.536319+0000","last_peered":"2023-07-06T01:08:51.536319+0000","last_clean":"2023-07-06T01:08:51.536319+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:51.536319+0000","last_undegraded":"2023-07-06T01:08:51.536319+0000","last_fullsized":"2023-07-06T01:08:51.536319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:30.752260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544623+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:50.544623+0000","last_peered":"2023-07-06T01:08:50.544623+0000","last_clean":"2023-07-06T01:08:50.544623+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:50.544623+0000","last_undegraded":"2023-07-06T01:08:50.544623+0000","last_fullsized":"2023-07-06T01:08:50.544623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:36.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520281+0000","last_change":"2023-07-06T01:08:50.520281+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520281+0000","last_undegraded":"2023-07-06T01:08:50.520281+0000","last_fullsized":"2023-07-06T01:08:50.520281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522334+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:50.522334+0000","last_peered":"2023-07-06T01:08:50.522334+0000","last_clean":"2023-07-06T01:08:50.522334+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:50.522334+0000","last_undegraded":"2023-07-06T01:08:50.522334+0000","last_fullsized":"2023-07-06T01:08:50.522334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:15.748208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.536879+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:50.536879+0000","last_peered":"2023-07-06T01:08:50.536879+0000","last_clean":"2023-07-06T01:08:50.536879+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:50.536879+0000","last_undegraded":"2023-07-06T01:08:50.536879+0000","last_fullsized":"2023-07-06T01:08:50.536879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522852+0000","last_change":"2023-07-06T01:08:50.522852+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522852+0000","last_undegraded":"2023-07-06T01:08:50.522852+0000","last_fullsized":"2023-07-06T01:08:50.522852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531467+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:51.531467+0000","last_peered":"2023-07-06T01:08:51.531467+0000","last_clean":"2023-07-06T01:08:51.531467+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:51.531467+0000","last_undegraded":"2023-07-06T01:08:51.531467+0000","last_fullsized":"2023-07-06T01:08:51.531467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:37.476727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522938+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:50.522938+0000","last_peered":"2023-07-06T01:08:50.522938+0000","last_clean":"2023-07-06T01:08:50.522938+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:50.522938+0000","last_undegraded":"2023-07-06T01:08:50.522938+0000","last_fullsized":"2023-07-06T01:08:50.522938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:30.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.542000+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:50.542000+0000","last_peered":"2023-07-06T01:08:50.542000+0000","last_clean":"2023-07-06T01:08:50.542000+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:50.542000+0000","last_undegraded":"2023-07-06T01:08:50.542000+0000","last_fullsized":"2023-07-06T01:08:50.542000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:21.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522455+0000","last_change":"2023-07-06T01:08:50.522455+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522455+0000","last_undegraded":"2023-07-06T01:08:50.522455+0000","last_fullsized":"2023-07-06T01:08:50.522455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.523085+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:50.523085+0000","last_peered":"2023-07-06T01:08:50.523085+0000","last_clean":"2023-07-06T01:08:50.523085+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:50.523085+0000","last_undegraded":"2023-07-06T01:08:50.523085+0000","last_fullsized":"2023-07-06T01:08:50.523085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:20.541176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528523+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:51.528523+0000","last_peered":"2023-07-06T01:08:51.528523+0000","last_clean":"2023-07-06T01:08:51.528523+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:51.528523+0000","last_undegraded":"2023-07-06T01:08:51.528523+0000","last_fullsized":"2023-07-06T01:08:51.528523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.548640+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:51.548640+0000","last_peered":"2023-07-06T01:08:51.548640+0000","last_clean":"2023-07-06T01:08:51.548640+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:51.548640+0000","last_undegraded":"2023-07-06T01:08:51.548640+0000","last_fullsized":"2023-07-06T01:08:51.548640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.523022+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:50.523022+0000","last_peered":"2023-07-06T01:08:50.523022+0000","last_clean":"2023-07-06T01:08:50.523022+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:50.523022+0000","last_undegraded":"2023-07-06T01:08:50.523022+0000","last_fullsized":"2023-07-06T01:08:50.523022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:42.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539485+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:50.539485+0000","last_peered":"2023-07-06T01:08:50.539485+0000","last_clean":"2023-07-06T01:08:50.539485+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:50.539485+0000","last_undegraded":"2023-07-06T01:08:50.539485+0000","last_fullsized":"2023-07-06T01:08:50.539485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.560504+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:51.560504+0000","last_peered":"2023-07-06T01:08:51.560504+0000","last_clean":"2023-07-06T01:08:51.560504+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:51.560504+0000","last_undegraded":"2023-07-06T01:08:51.560504+0000","last_fullsized":"2023-07-06T01:08:51.560504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.547292+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:50.547292+0000","last_peered":"2023-07-06T01:08:50.547292+0000","last_clean":"2023-07-06T01:08:50.547292+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:50.547292+0000","last_undegraded":"2023-07-06T01:08:50.547292+0000","last_fullsized":"2023-07-06T01:08:50.547292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.521939+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:50.521939+0000","last_peered":"2023-07-06T01:08:50.521939+0000","last_clean":"2023-07-06T01:08:50.521939+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:50.521939+0000","last_undegraded":"2023-07-06T01:08:50.521939+0000","last_fullsized":"2023-07-06T01:08:50.521939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:12.318565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528125+0000","last_change":"2023-07-06T01:08:50.528125+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528125+0000","last_undegraded":"2023-07-06T01:08:50.528125+0000","last_fullsized":"2023-07-06T01:08:50.528125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522264+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:50.522264+0000","last_peered":"2023-07-06T01:08:50.522264+0000","last_clean":"2023-07-06T01:08:50.522264+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:50.522264+0000","last_undegraded":"2023-07-06T01:08:50.522264+0000","last_fullsized":"2023-07-06T01:08:50.522264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:57.942136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529455+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:51.529455+0000","last_peered":"2023-07-06T01:08:51.529455+0000","last_clean":"2023-07-06T01:08:51.529455+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:51.529455+0000","last_undegraded":"2023-07-06T01:08:51.529455+0000","last_fullsized":"2023-07-06T01:08:51.529455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:16.552277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.527627+0000","last_change":"2023-07-06T01:08:50.527627+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.527627+0000","last_undegraded":"2023-07-06T01:08:50.527627+0000","last_fullsized":"2023-07-06T01:08:50.527627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563845+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:51.563845+0000","last_peered":"2023-07-06T01:08:51.563845+0000","last_clean":"2023-07-06T01:08:51.563845+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:51.563845+0000","last_undegraded":"2023-07-06T01:08:51.563845+0000","last_fullsized":"2023-07-06T01:08:51.563845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521067+0000","last_change":"2023-07-06T01:08:50.521067+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521067+0000","last_undegraded":"2023-07-06T01:08:50.521067+0000","last_fullsized":"2023-07-06T01:08:50.521067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.562490+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:51.562490+0000","last_peered":"2023-07-06T01:08:51.562490+0000","last_clean":"2023-07-06T01:08:51.562490+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:51.562490+0000","last_undegraded":"2023-07-06T01:08:51.562490+0000","last_fullsized":"2023-07-06T01:08:51.562490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528795+0000","last_change":"2023-07-06T01:08:50.528795+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528795+0000","last_undegraded":"2023-07-06T01:08:50.528795+0000","last_fullsized":"2023-07-06T01:08:50.528795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563303+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:51.563303+0000","last_peered":"2023-07-06T01:08:51.563303+0000","last_clean":"2023-07-06T01:08:51.563303+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:51.563303+0000","last_undegraded":"2023-07-06T01:08:51.563303+0000","last_fullsized":"2023-07-06T01:08:51.563303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.530957+0000","last_change":"2023-07-06T01:08:50.530957+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.530957+0000","last_undegraded":"2023-07-06T01:08:50.530957+0000","last_fullsized":"2023-07-06T01:08:50.530957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544917+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:50.544917+0000","last_peered":"2023-07-06T01:08:50.544917+0000","last_clean":"2023-07-06T01:08:50.544917+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:50.544917+0000","last_undegraded":"2023-07-06T01:08:50.544917+0000","last_fullsized":"2023-07-06T01:08:50.544917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526479+0000","last_change":"2023-07-06T01:08:50.526479+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526479+0000","last_undegraded":"2023-07-06T01:08:50.526479+0000","last_fullsized":"2023-07-06T01:08:50.526479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557988+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:51.557988+0000","last_peered":"2023-07-06T01:08:51.557988+0000","last_clean":"2023-07-06T01:08:51.557988+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:51.557988+0000","last_undegraded":"2023-07-06T01:08:51.557988+0000","last_fullsized":"2023-07-06T01:08:51.557988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526930+0000","last_change":"2023-07-06T01:08:50.526930+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526930+0000","last_undegraded":"2023-07-06T01:08:50.526930+0000","last_fullsized":"2023-07-06T01:08:50.526930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521157+0000","last_change":"2023-07-06T01:08:50.521157+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521157+0000","last_undegraded":"2023-07-06T01:08:50.521157+0000","last_fullsized":"2023-07-06T01:08:50.521157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526976+0000","last_change":"2023-07-06T01:08:50.526976+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526976+0000","last_undegraded":"2023-07-06T01:08:50.526976+0000","last_fullsized":"2023-07-06T01:08:50.526976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533374+0000","last_change":"2023-07-06T01:08:50.533374+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533374+0000","last_undegraded":"2023-07-06T01:08:50.533374+0000","last_fullsized":"2023-07-06T01:08:50.533374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.524896+0000","last_change":"2023-07-06T01:08:50.524896+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.524896+0000","last_undegraded":"2023-07-06T01:08:50.524896+0000","last_fullsized":"2023-07-06T01:08:50.524896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522559+0000","last_change":"2023-07-06T01:08:50.522559+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522559+0000","last_undegraded":"2023-07-06T01:08:50.522559+0000","last_fullsized":"2023-07-06T01:08:50.522559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:08:55.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:08:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.148+0000 7fcd949ff700 1 Processor -- start 2023-07-06T01:08:56.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.148+0000 7fcd949ff700 1 -- start start 2023-07-06T01:08:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.149+0000 7fcd949ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd900b5c90 0x7fcd900d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.149+0000 7fcd949ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd900b6110 0x7fcd900d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd949ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd900cf780 con 0x7fcd9015fca0 2023-07-06T01:08:56.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd949ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cd490 con 0x7fcd900b5c90 2023-07-06T01:08:56.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd949ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cd770 con 0x7fcd900b6110 2023-07-06T01:08:56.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd900b5c90 0x7fcd900d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd900b5c90 0x7fcd900d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45194/0 (socket says 172.21.15.71:45194) 2023-07-06T01:08:56.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd8e59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcd9015fca0 0x7fcd900d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57626/0 (socket says 172.21.15.71:57626) 2023-07-06T01:08:56.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 -- 172.21.15.71:0/1485882727 learned_addr learned my addr 172.21.15.71:0/1485882727 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:56.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd8ed9d700 1 --2- 172.21.15.71:0/1485882727 >> v2:172.21.15.194:3300/0 conn(0x7fcd900b6110 0x7fcd900d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 -- 172.21.15.71:0/1485882727 >> v2:172.21.15.194:3300/0 conn(0x7fcd900b6110 msgr2=0x7fcd900d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:56.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 --2- 172.21.15.71:0/1485882727 >> v2:172.21.15.194:3300/0 conn(0x7fcd900b6110 0x7fcd900d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 -- 172.21.15.71:0/1485882727 >> v1:172.21.15.71:6789/0 conn(0x7fcd9015fca0 legacy=0x7fcd900d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd87fff700 1 -- 172.21.15.71:0/1485882727 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900cda50 con 0x7fcd900b5c90 2023-07-06T01:08:56.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.150+0000 7fcd8dd9b700 1 -- 172.21.15.71:0/1485882727 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548798737 0 0) 0x7fcd900cf780 con 0x7fcd9015fca0 2023-07-06T01:08:56.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd87fff700 1 --2- 172.21.15.71:0/1485882727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b5c90 0x7fcd900d2d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd900cd410 tx=0x7fcd78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ae78c6643fe473 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd8dd9b700 1 -- 172.21.15.71:0/1485882727 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011830 con 0x7fcd900b5c90 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd8dd9b700 1 -- 172.21.15.71:0/1485882727 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78011990 con 0x7fcd900b5c90 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd8dd9b700 1 -- 172.21.15.71:0/1485882727 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011d20 con 0x7fcd900b5c90 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 -- 172.21.15.71:0/1485882727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b5c90 msgr2=0x7fcd900d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 --2- 172.21.15.71:0/1485882727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b5c90 0x7fcd900d2d40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd900cd410 tx=0x7fcd78009bd0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 -- 172.21.15.71:0/1485882727 shutdown_connections 2023-07-06T01:08:56.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 --2- 172.21.15.71:0/1485882727 >> v2:172.21.15.194:3300/0 conn(0x7fcd900b6110 0x7fcd900d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 --2- 172.21.15.71:0/1485882727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b5c90 0x7fcd900d2d40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 -- 172.21.15.71:0/1485882727 >> 172.21.15.71:0/1485882727 conn(0x7fcd9006c150 msgr2=0x7fcd9006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:56.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 -- 172.21.15.71:0/1485882727 shutdown_connections 2023-07-06T01:08:56.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.151+0000 7fcd949ff700 1 -- 172.21.15.71:0/1485882727 wait complete. 2023-07-06T01:08:56.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.153+0000 7fcd949ff700 1 Processor -- start 2023-07-06T01:08:56.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.153+0000 7fcd949ff700 1 -- start start 2023-07-06T01:08:56.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd949ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd900b5c90 0x7fcd901f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd949ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 0x7fcd900b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd949ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd9015fca0 0x7fcd900b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd949ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90149c20 con 0x7fcd900b6110 2023-07-06T01:08:56.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd949ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900c9f10 con 0x7fcd900b5c90 2023-07-06T01:08:56.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd949ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900ca1f0 con 0x7fcd9015fca0 2023-07-06T01:08:56.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.154+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 0x7fcd900b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 0x7fcd900b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45206/0 (socket says 172.21.15.71:45206) 2023-07-06T01:08:56.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 -- 172.21.15.71:0/3416092140 learned_addr learned my addr 172.21.15.71:0/3416092140 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:56.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd8e59c700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd900b5c90 0x7fcd901f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd8ed9d700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd9015fca0 0x7fcd900b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 -- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd9015fca0 msgr2=0x7fcd900b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd9015fca0 0x7fcd900b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 -- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd900b5c90 msgr2=0x7fcd901f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd900b5c90 0x7fcd901f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 -- 172.21.15.71:0/3416092140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009550 con 0x7fcd900b6110 2023-07-06T01:08:56.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd87fff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 0x7fcd900b2d20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009c10 tx=0x7fcd78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:56.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd780036a0 con 0x7fcd900b6110 2023-07-06T01:08:56.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78003800 con 0x7fcd900b6110 2023-07-06T01:08:56.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78003b70 con 0x7fcd900b6110 2023-07-06T01:08:56.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.155+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd900ca4d0 con 0x7fcd900b6110 2023-07-06T01:08:56.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.156+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd901f1d30 con 0x7fcd900b6110 2023-07-06T01:08:56.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.157+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd900ca9f0 con 0x7fcd900b6110 2023-07-06T01:08:56.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.157+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd78003cd0 con 0x7fcd900b6110 2023-07-06T01:08:56.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.158+0000 7fcd86ffd700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd7006ace0 0x7fcd7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.158+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd78021030 con 0x7fcd900b6110 2023-07-06T01:08:56.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.159+0000 7fcd8e59c700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd7006ace0 0x7fcd7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.159+0000 7fcd8e59c700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd7006ace0 0x7fcd7006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000f60 tx=0x7fcd80007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:56.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.162+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd900ca9f0 con 0x7fcd900b6110 2023-07-06T01:08:56.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.353+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd9006ae40 con 0x7fcd7006ace0 2023-07-06T01:08:56.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.362+0000 7fcd86ffd700 1 -- 172.21.15.71:0/3416092140 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282789 (secure 0 0 0) 0x7fcd80001290 con 0x7fcd7006ace0 2023-07-06T01:08:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:56.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd7006ace0 msgr2=0x7fcd7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd7006ace0 0x7fcd7006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000f60 tx=0x7fcd80007e70 comp rx=0 tx=0).stop 2023-07-06T01:08:56.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 msgr2=0x7fcd900b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 0x7fcd900b2d20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009c10 tx=0x7fcd78004750 comp rx=0 tx=0).stop 2023-07-06T01:08:56.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 shutdown_connections 2023-07-06T01:08:56.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd7006ace0 0x7fcd7006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd9015fca0 0x7fcd900b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd900b5c90 0x7fcd901f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 --2- 172.21.15.71:0/3416092140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd900b6110 0x7fcd900b2d20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 >> 172.21.15.71:0/3416092140 conn(0x7fcd9006c150 msgr2=0x7fcd900cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:56.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 shutdown_connections 2023-07-06T01:08:56.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.366+0000 7fcd949ff700 1 -- 172.21.15.71:0/3416092140 wait complete. 2023-07-06T01:08:56.375 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:08:56.376 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-07-06T01:08:56.372+0000 7f55189f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T01:08:56.386 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T01:08:54.823373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2899968,"data_stored":1774040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.312409"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523834+0000","last_change":"2023-07-06T01:08:50.523834+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523834+0000","last_undegraded":"2023-07-06T01:08:50.523834+0000","last_fullsized":"2023-07-06T01:08:50.523834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561492+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:51.561492+0000","last_peered":"2023-07-06T01:08:51.561492+0000","last_clean":"2023-07-06T01:08:51.561492+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:51.561492+0000","last_undegraded":"2023-07-06T01:08:51.561492+0000","last_fullsized":"2023-07-06T01:08:51.561492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.534233+0000","last_change":"2023-07-06T01:08:50.534233+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.534233+0000","last_undegraded":"2023-07-06T01:08:50.534233+0000","last_fullsized":"2023-07-06T01:08:50.534233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521068+0000","last_change":"2023-07-06T01:08:50.521068+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521068+0000","last_undegraded":"2023-07-06T01:08:50.521068+0000","last_fullsized":"2023-07-06T01:08:50.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.551114+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:51.551114+0000","last_peered":"2023-07-06T01:08:51.551114+0000","last_clean":"2023-07-06T01:08:51.551114+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:51.551114+0000","last_undegraded":"2023-07-06T01:08:51.551114+0000","last_fullsized":"2023-07-06T01:08:51.551114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.534330+0000","last_change":"2023-07-06T01:08:50.534330+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.534330+0000","last_undegraded":"2023-07-06T01:08:50.534330+0000","last_fullsized":"2023-07-06T01:08:50.534330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521443+0000","last_change":"2023-07-06T01:08:50.521443+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521443+0000","last_undegraded":"2023-07-06T01:08:50.521443+0000","last_fullsized":"2023-07-06T01:08:50.521443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.567746+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:51.567746+0000","last_peered":"2023-07-06T01:08:51.567746+0000","last_clean":"2023-07-06T01:08:51.567746+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:51.567746+0000","last_undegraded":"2023-07-06T01:08:51.567746+0000","last_fullsized":"2023-07-06T01:08:51.567746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550779+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:51.550779+0000","last_peered":"2023-07-06T01:08:51.550779+0000","last_clean":"2023-07-06T01:08:51.550779+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:51.550779+0000","last_undegraded":"2023-07-06T01:08:51.550779+0000","last_fullsized":"2023-07-06T01:08:51.550779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:21.687284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561474+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:51.561474+0000","last_peered":"2023-07-06T01:08:51.561474+0000","last_clean":"2023-07-06T01:08:51.561474+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:51.561474+0000","last_undegraded":"2023-07-06T01:08:51.561474+0000","last_fullsized":"2023-07-06T01:08:51.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533228+0000","last_change":"2023-07-06T01:08:50.533228+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533228+0000","last_undegraded":"2023-07-06T01:08:50.533228+0000","last_fullsized":"2023-07-06T01:08:50.533228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522072+0000","last_change":"2023-07-06T01:08:50.522072+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522072+0000","last_undegraded":"2023-07-06T01:08:50.522072+0000","last_fullsized":"2023-07-06T01:08:50.522072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.524535+0000","last_change":"2023-07-06T01:08:50.524535+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.524535+0000","last_undegraded":"2023-07-06T01:08:50.524535+0000","last_fullsized":"2023-07-06T01:08:50.524535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561576+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:51.561576+0000","last_peered":"2023-07-06T01:08:51.561576+0000","last_clean":"2023-07-06T01:08:51.561576+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:51.561576+0000","last_undegraded":"2023-07-06T01:08:51.561576+0000","last_fullsized":"2023-07-06T01:08:51.561576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520813+0000","last_change":"2023-07-06T01:08:50.520813+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520813+0000","last_undegraded":"2023-07-06T01:08:50.520813+0000","last_fullsized":"2023-07-06T01:08:50.520813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526317+0000","last_change":"2023-07-06T01:08:50.526317+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526317+0000","last_undegraded":"2023-07-06T01:08:50.526317+0000","last_fullsized":"2023-07-06T01:08:50.526317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557675+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:51.557675+0000","last_peered":"2023-07-06T01:08:51.557675+0000","last_clean":"2023-07-06T01:08:51.557675+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:51.557675+0000","last_undegraded":"2023-07-06T01:08:51.557675+0000","last_fullsized":"2023-07-06T01:08:51.557675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533297+0000","last_change":"2023-07-06T01:08:50.533297+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533297+0000","last_undegraded":"2023-07-06T01:08:50.533297+0000","last_fullsized":"2023-07-06T01:08:50.533297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523242+0000","last_change":"2023-07-06T01:08:50.523242+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523242+0000","last_undegraded":"2023-07-06T01:08:50.523242+0000","last_fullsized":"2023-07-06T01:08:50.523242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.532412+0000","last_change":"2023-07-06T01:08:50.532412+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.532412+0000","last_undegraded":"2023-07-06T01:08:50.532412+0000","last_fullsized":"2023-07-06T01:08:50.532412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521933+0000","last_change":"2023-07-06T01:08:50.521933+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521933+0000","last_undegraded":"2023-07-06T01:08:50.521933+0000","last_fullsized":"2023-07-06T01:08:50.521933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557593+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:51.557593+0000","last_peered":"2023-07-06T01:08:51.557593+0000","last_clean":"2023-07-06T01:08:51.557593+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:51.557593+0000","last_undegraded":"2023-07-06T01:08:51.557593+0000","last_fullsized":"2023-07-06T01:08:51.557593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:18.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.525630+0000","last_change":"2023-07-06T01:08:50.525630+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.525630+0000","last_undegraded":"2023-07-06T01:08:50.525630+0000","last_fullsized":"2023-07-06T01:08:50.525630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520240+0000","last_change":"2023-07-06T01:08:50.520240+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520240+0000","last_undegraded":"2023-07-06T01:08:50.520240+0000","last_fullsized":"2023-07-06T01:08:50.520240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523285+0000","last_change":"2023-07-06T01:08:50.523285+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523285+0000","last_undegraded":"2023-07-06T01:08:50.523285+0000","last_fullsized":"2023-07-06T01:08:50.523285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521594+0000","last_change":"2023-07-06T01:08:50.521594+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521594+0000","last_undegraded":"2023-07-06T01:08:50.521594+0000","last_fullsized":"2023-07-06T01:08:50.521594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561550+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:51.561550+0000","last_peered":"2023-07-06T01:08:51.561550+0000","last_clean":"2023-07-06T01:08:51.561550+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:51.561550+0000","last_undegraded":"2023-07-06T01:08:51.561550+0000","last_fullsized":"2023-07-06T01:08:51.561550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.547735+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:50.547735+0000","last_peered":"2023-07-06T01:08:50.547735+0000","last_clean":"2023-07-06T01:08:50.547735+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:50.547735+0000","last_undegraded":"2023-07-06T01:08:50.547735+0000","last_fullsized":"2023-07-06T01:08:50.547735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:21.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.531285+0000","last_change":"2023-07-06T01:08:50.531285+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.531285+0000","last_undegraded":"2023-07-06T01:08:50.531285+0000","last_fullsized":"2023-07-06T01:08:50.531285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539513+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:50.539513+0000","last_peered":"2023-07-06T01:08:50.539513+0000","last_clean":"2023-07-06T01:08:50.539513+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:50.539513+0000","last_undegraded":"2023-07-06T01:08:50.539513+0000","last_fullsized":"2023-07-06T01:08:50.539513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550435+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:51.550435+0000","last_peered":"2023-07-06T01:08:51.550435+0000","last_clean":"2023-07-06T01:08:51.550435+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:51.550435+0000","last_undegraded":"2023-07-06T01:08:51.550435+0000","last_fullsized":"2023-07-06T01:08:51.550435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:33.241903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.542050+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:50.542050+0000","last_peered":"2023-07-06T01:08:50.542050+0000","last_clean":"2023-07-06T01:08:50.542050+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:50.542050+0000","last_undegraded":"2023-07-06T01:08:50.542050+0000","last_fullsized":"2023-07-06T01:08:50.542050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:55.840317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521965+0000","last_change":"2023-07-06T01:08:50.521965+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521965+0000","last_undegraded":"2023-07-06T01:08:50.521965+0000","last_fullsized":"2023-07-06T01:08:50.521965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529840+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:51.529840+0000","last_peered":"2023-07-06T01:08:51.529840+0000","last_clean":"2023-07-06T01:08:51.529840+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:51.529840+0000","last_undegraded":"2023-07-06T01:08:51.529840+0000","last_fullsized":"2023-07-06T01:08:51.529840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.527276+0000","last_change":"2023-07-06T01:08:50.527276+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.527276+0000","last_undegraded":"2023-07-06T01:08:50.527276+0000","last_fullsized":"2023-07-06T01:08:50.527276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.535933+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:51.535933+0000","last_peered":"2023-07-06T01:08:51.535933+0000","last_clean":"2023-07-06T01:08:51.535933+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:51.535933+0000","last_undegraded":"2023-07-06T01:08:51.535933+0000","last_fullsized":"2023-07-06T01:08:51.535933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:14.557999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526038+0000","last_change":"2023-07-06T01:08:50.526038+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526038+0000","last_undegraded":"2023-07-06T01:08:50.526038+0000","last_fullsized":"2023-07-06T01:08:50.526038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545183+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:50.545183+0000","last_peered":"2023-07-06T01:08:50.545183+0000","last_clean":"2023-07-06T01:08:50.545183+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:50.545183+0000","last_undegraded":"2023-07-06T01:08:50.545183+0000","last_fullsized":"2023-07-06T01:08:50.545183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:20.680536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522931+0000","last_change":"2023-07-06T01:08:50.522931+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522931+0000","last_undegraded":"2023-07-06T01:08:50.522931+0000","last_fullsized":"2023-07-06T01:08:50.522931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544595+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:50.544595+0000","last_peered":"2023-07-06T01:08:50.544595+0000","last_clean":"2023-07-06T01:08:50.544595+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:50.544595+0000","last_undegraded":"2023-07-06T01:08:50.544595+0000","last_fullsized":"2023-07-06T01:08:50.544595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:51:01.235254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533531+0000","last_change":"2023-07-06T01:08:50.533531+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533531+0000","last_undegraded":"2023-07-06T01:08:50.533531+0000","last_fullsized":"2023-07-06T01:08:50.533531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544682+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:50.544682+0000","last_peered":"2023-07-06T01:08:50.544682+0000","last_clean":"2023-07-06T01:08:50.544682+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:50.544682+0000","last_undegraded":"2023-07-06T01:08:50.544682+0000","last_fullsized":"2023-07-06T01:08:50.544682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.529420+0000","last_change":"2023-07-06T01:08:50.529420+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.529420+0000","last_undegraded":"2023-07-06T01:08:50.529420+0000","last_fullsized":"2023-07-06T01:08:50.529420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528681+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:51.528681+0000","last_peered":"2023-07-06T01:08:51.528681+0000","last_clean":"2023-07-06T01:08:51.528681+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:51.528681+0000","last_undegraded":"2023-07-06T01:08:51.528681+0000","last_fullsized":"2023-07-06T01:08:51.528681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561532+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:51.561532+0000","last_peered":"2023-07-06T01:08:51.561532+0000","last_clean":"2023-07-06T01:08:51.561532+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:51.561532+0000","last_undegraded":"2023-07-06T01:08:51.561532+0000","last_fullsized":"2023-07-06T01:08:51.561532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544655+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:50.544655+0000","last_peered":"2023-07-06T01:08:50.544655+0000","last_clean":"2023-07-06T01:08:50.544655+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:50.544655+0000","last_undegraded":"2023-07-06T01:08:50.544655+0000","last_fullsized":"2023-07-06T01:08:50.544655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:32.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550797+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:51.550797+0000","last_peered":"2023-07-06T01:08:51.550797+0000","last_clean":"2023-07-06T01:08:51.550797+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:51.550797+0000","last_undegraded":"2023-07-06T01:08:51.550797+0000","last_fullsized":"2023-07-06T01:08:51.550797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:49.267223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.533192+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:50.533192+0000","last_peered":"2023-07-06T01:08:50.533192+0000","last_clean":"2023-07-06T01:08:50.533192+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:50.533192+0000","last_undegraded":"2023-07-06T01:08:50.533192+0000","last_fullsized":"2023-07-06T01:08:50.533192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:55.840317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.530119+0000","last_change":"2023-07-06T01:08:50.530119+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.530119+0000","last_undegraded":"2023-07-06T01:08:50.530119+0000","last_fullsized":"2023-07-06T01:08:50.530119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545150+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:50.545150+0000","last_peered":"2023-07-06T01:08:50.545150+0000","last_clean":"2023-07-06T01:08:50.545150+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:50.545150+0000","last_undegraded":"2023-07-06T01:08:50.545150+0000","last_fullsized":"2023-07-06T01:08:50.545150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:48.837818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561444+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:51.561444+0000","last_peered":"2023-07-06T01:08:51.561444+0000","last_clean":"2023-07-06T01:08:51.561444+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:51.561444+0000","last_undegraded":"2023-07-06T01:08:51.561444+0000","last_fullsized":"2023-07-06T01:08:51.561444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545119+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:50.545119+0000","last_peered":"2023-07-06T01:08:50.545119+0000","last_clean":"2023-07-06T01:08:50.545119+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:50.545119+0000","last_undegraded":"2023-07-06T01:08:50.545119+0000","last_fullsized":"2023-07-06T01:08:50.545119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:09.991008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528119+0000","last_change":"2023-07-06T01:08:50.528119+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528119+0000","last_undegraded":"2023-07-06T01:08:50.528119+0000","last_fullsized":"2023-07-06T01:08:50.528119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545199+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:50.545199+0000","last_peered":"2023-07-06T01:08:50.545199+0000","last_clean":"2023-07-06T01:08:50.545199+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:50.545199+0000","last_undegraded":"2023-07-06T01:08:50.545199+0000","last_fullsized":"2023-07-06T01:08:50.545199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:41.923174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523002+0000","last_change":"2023-07-06T01:08:50.523002+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523002+0000","last_undegraded":"2023-07-06T01:08:50.523002+0000","last_fullsized":"2023-07-06T01:08:50.523002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531958+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:51.531958+0000","last_peered":"2023-07-06T01:08:51.531958+0000","last_clean":"2023-07-06T01:08:51.531958+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:51.531958+0000","last_undegraded":"2023-07-06T01:08:51.531958+0000","last_fullsized":"2023-07-06T01:08:51.531958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.549593+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:51.549593+0000","last_peered":"2023-07-06T01:08:51.549593+0000","last_clean":"2023-07-06T01:08:51.549593+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:51.549593+0000","last_undegraded":"2023-07-06T01:08:51.549593+0000","last_fullsized":"2023-07-06T01:08:51.549593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539578+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:50.539578+0000","last_peered":"2023-07-06T01:08:50.539578+0000","last_clean":"2023-07-06T01:08:50.539578+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:50.539578+0000","last_undegraded":"2023-07-06T01:08:50.539578+0000","last_fullsized":"2023-07-06T01:08:50.539578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:36.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.531654+0000","last_change":"2023-07-06T01:08:50.531654+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.531654+0000","last_undegraded":"2023-07-06T01:08:50.531654+0000","last_fullsized":"2023-07-06T01:08:50.531654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.538412+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:50.538412+0000","last_peered":"2023-07-06T01:08:50.538412+0000","last_clean":"2023-07-06T01:08:50.538412+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:50.538412+0000","last_undegraded":"2023-07-06T01:08:50.538412+0000","last_fullsized":"2023-07-06T01:08:50.538412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528599+0000","last_change":"2023-07-06T01:08:50.528599+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528599+0000","last_undegraded":"2023-07-06T01:08:50.528599+0000","last_fullsized":"2023-07-06T01:08:50.528599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.540572+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:50.540572+0000","last_peered":"2023-07-06T01:08:50.540572+0000","last_clean":"2023-07-06T01:08:50.540572+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:50.540572+0000","last_undegraded":"2023-07-06T01:08:50.540572+0000","last_fullsized":"2023-07-06T01:08:50.540572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:50:02.670638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528790+0000","last_change":"2023-07-06T01:08:50.528790+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528790+0000","last_undegraded":"2023-07-06T01:08:50.528790+0000","last_fullsized":"2023-07-06T01:08:50.528790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544947+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:50.544947+0000","last_peered":"2023-07-06T01:08:50.544947+0000","last_clean":"2023-07-06T01:08:50.544947+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:50.544947+0000","last_undegraded":"2023-07-06T01:08:50.544947+0000","last_fullsized":"2023-07-06T01:08:50.544947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:14:03.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521013+0000","last_change":"2023-07-06T01:08:50.521013+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521013+0000","last_undegraded":"2023-07-06T01:08:50.521013+0000","last_fullsized":"2023-07-06T01:08:50.521013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522793+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:50.522793+0000","last_peered":"2023-07-06T01:08:50.522793+0000","last_clean":"2023-07-06T01:08:50.522793+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:50.522793+0000","last_undegraded":"2023-07-06T01:08:50.522793+0000","last_fullsized":"2023-07-06T01:08:50.522793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:42.920596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.534381+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:51.534381+0000","last_peered":"2023-07-06T01:08:51.534381+0000","last_clean":"2023-07-06T01:08:51.534381+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:51.534381+0000","last_undegraded":"2023-07-06T01:08:51.534381+0000","last_fullsized":"2023-07-06T01:08:51.534381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:01.848614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520467+0000","last_change":"2023-07-06T01:08:50.520467+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520467+0000","last_undegraded":"2023-07-06T01:08:50.520467+0000","last_fullsized":"2023-07-06T01:08:50.520467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.536319+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:51.536319+0000","last_peered":"2023-07-06T01:08:51.536319+0000","last_clean":"2023-07-06T01:08:51.536319+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:51.536319+0000","last_undegraded":"2023-07-06T01:08:51.536319+0000","last_fullsized":"2023-07-06T01:08:51.536319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:30.752260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544623+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:50.544623+0000","last_peered":"2023-07-06T01:08:50.544623+0000","last_clean":"2023-07-06T01:08:50.544623+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:50.544623+0000","last_undegraded":"2023-07-06T01:08:50.544623+0000","last_fullsized":"2023-07-06T01:08:50.544623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:36.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520281+0000","last_change":"2023-07-06T01:08:50.520281+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520281+0000","last_undegraded":"2023-07-06T01:08:50.520281+0000","last_fullsized":"2023-07-06T01:08:50.520281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522334+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:50.522334+0000","last_peered":"2023-07-06T01:08:50.522334+0000","last_clean":"2023-07-06T01:08:50.522334+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:50.522334+0000","last_undegraded":"2023-07-06T01:08:50.522334+0000","last_fullsized":"2023-07-06T01:08:50.522334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:15.748208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.536879+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:50.536879+0000","last_peered":"2023-07-06T01:08:50.536879+0000","last_clean":"2023-07-06T01:08:50.536879+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:50.536879+0000","last_undegraded":"2023-07-06T01:08:50.536879+0000","last_fullsized":"2023-07-06T01:08:50.536879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522852+0000","last_change":"2023-07-06T01:08:50.522852+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522852+0000","last_undegraded":"2023-07-06T01:08:50.522852+0000","last_fullsized":"2023-07-06T01:08:50.522852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531467+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:51.531467+0000","last_peered":"2023-07-06T01:08:51.531467+0000","last_clean":"2023-07-06T01:08:51.531467+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:51.531467+0000","last_undegraded":"2023-07-06T01:08:51.531467+0000","last_fullsized":"2023-07-06T01:08:51.531467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:37.476727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522938+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:50.522938+0000","last_peered":"2023-07-06T01:08:50.522938+0000","last_clean":"2023-07-06T01:08:50.522938+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:50.522938+0000","last_undegraded":"2023-07-06T01:08:50.522938+0000","last_fullsized":"2023-07-06T01:08:50.522938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:30.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.542000+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:50.542000+0000","last_peered":"2023-07-06T01:08:50.542000+0000","last_clean":"2023-07-06T01:08:50.542000+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:50.542000+0000","last_undegraded":"2023-07-06T01:08:50.542000+0000","last_fullsized":"2023-07-06T01:08:50.542000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:21.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522455+0000","last_change":"2023-07-06T01:08:50.522455+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522455+0000","last_undegraded":"2023-07-06T01:08:50.522455+0000","last_fullsized":"2023-07-06T01:08:50.522455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.523085+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:50.523085+0000","last_peered":"2023-07-06T01:08:50.523085+0000","last_clean":"2023-07-06T01:08:50.523085+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:50.523085+0000","last_undegraded":"2023-07-06T01:08:50.523085+0000","last_fullsized":"2023-07-06T01:08:50.523085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:20.541176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528523+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:51.528523+0000","last_peered":"2023-07-06T01:08:51.528523+0000","last_clean":"2023-07-06T01:08:51.528523+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:51.528523+0000","last_undegraded":"2023-07-06T01:08:51.528523+0000","last_fullsized":"2023-07-06T01:08:51.528523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.548640+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:51.548640+0000","last_peered":"2023-07-06T01:08:51.548640+0000","last_clean":"2023-07-06T01:08:51.548640+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:51.548640+0000","last_undegraded":"2023-07-06T01:08:51.548640+0000","last_fullsized":"2023-07-06T01:08:51.548640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.523022+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:50.523022+0000","last_peered":"2023-07-06T01:08:50.523022+0000","last_clean":"2023-07-06T01:08:50.523022+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:50.523022+0000","last_undegraded":"2023-07-06T01:08:50.523022+0000","last_fullsized":"2023-07-06T01:08:50.523022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:42.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539485+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:50.539485+0000","last_peered":"2023-07-06T01:08:50.539485+0000","last_clean":"2023-07-06T01:08:50.539485+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:50.539485+0000","last_undegraded":"2023-07-06T01:08:50.539485+0000","last_fullsized":"2023-07-06T01:08:50.539485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.560504+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:51.560504+0000","last_peered":"2023-07-06T01:08:51.560504+0000","last_clean":"2023-07-06T01:08:51.560504+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:51.560504+0000","last_undegraded":"2023-07-06T01:08:51.560504+0000","last_fullsized":"2023-07-06T01:08:51.560504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.547292+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:50.547292+0000","last_peered":"2023-07-06T01:08:50.547292+0000","last_clean":"2023-07-06T01:08:50.547292+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:50.547292+0000","last_undegraded":"2023-07-06T01:08:50.547292+0000","last_fullsized":"2023-07-06T01:08:50.547292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.521939+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:50.521939+0000","last_peered":"2023-07-06T01:08:50.521939+0000","last_clean":"2023-07-06T01:08:50.521939+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:50.521939+0000","last_undegraded":"2023-07-06T01:08:50.521939+0000","last_fullsized":"2023-07-06T01:08:50.521939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:12.318565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528125+0000","last_change":"2023-07-06T01:08:50.528125+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528125+0000","last_undegraded":"2023-07-06T01:08:50.528125+0000","last_fullsized":"2023-07-06T01:08:50.528125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522264+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:50.522264+0000","last_peered":"2023-07-06T01:08:50.522264+0000","last_clean":"2023-07-06T01:08:50.522264+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:50.522264+0000","last_undegraded":"2023-07-06T01:08:50.522264+0000","last_fullsized":"2023-07-06T01:08:50.522264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:57.942136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529455+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:51.529455+0000","last_peered":"2023-07-06T01:08:51.529455+0000","last_clean":"2023-07-06T01:08:51.529455+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:51.529455+0000","last_undegraded":"2023-07-06T01:08:51.529455+0000","last_fullsized":"2023-07-06T01:08:51.529455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:16.552277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.527627+0000","last_change":"2023-07-06T01:08:50.527627+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.527627+0000","last_undegraded":"2023-07-06T01:08:50.527627+0000","last_fullsized":"2023-07-06T01:08:50.527627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563845+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:51.563845+0000","last_peered":"2023-07-06T01:08:51.563845+0000","last_clean":"2023-07-06T01:08:51.563845+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:51.563845+0000","last_undegraded":"2023-07-06T01:08:51.563845+0000","last_fullsized":"2023-07-06T01:08:51.563845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521067+0000","last_change":"2023-07-06T01:08:50.521067+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521067+0000","last_undegraded":"2023-07-06T01:08:50.521067+0000","last_fullsized":"2023-07-06T01:08:50.521067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.562490+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:51.562490+0000","last_peered":"2023-07-06T01:08:51.562490+0000","last_clean":"2023-07-06T01:08:51.562490+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:51.562490+0000","last_undegraded":"2023-07-06T01:08:51.562490+0000","last_fullsized":"2023-07-06T01:08:51.562490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528795+0000","last_change":"2023-07-06T01:08:50.528795+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528795+0000","last_undegraded":"2023-07-06T01:08:50.528795+0000","last_fullsized":"2023-07-06T01:08:50.528795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563303+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:51.563303+0000","last_peered":"2023-07-06T01:08:51.563303+0000","last_clean":"2023-07-06T01:08:51.563303+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:51.563303+0000","last_undegraded":"2023-07-06T01:08:51.563303+0000","last_fullsized":"2023-07-06T01:08:51.563303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.530957+0000","last_change":"2023-07-06T01:08:50.530957+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.530957+0000","last_undegraded":"2023-07-06T01:08:50.530957+0000","last_fullsized":"2023-07-06T01:08:50.530957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544917+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:50.544917+0000","last_peered":"2023-07-06T01:08:50.544917+0000","last_clean":"2023-07-06T01:08:50.544917+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:50.544917+0000","last_undegraded":"2023-07-06T01:08:50.544917+0000","last_fullsized":"2023-07-06T01:08:50.544917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526479+0000","last_change":"2023-07-06T01:08:50.526479+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526479+0000","last_undegraded":"2023-07-06T01:08:50.526479+0000","last_fullsized":"2023-07-06T01:08:50.526479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557988+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:51.557988+0000","last_peered":"2023-07-06T01:08:51.557988+0000","last_clean":"2023-07-06T01:08:51.557988+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:51.557988+0000","last_undegraded":"2023-07-06T01:08:51.557988+0000","last_fullsized":"2023-07-06T01:08:51.557988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526930+0000","last_change":"2023-07-06T01:08:50.526930+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526930+0000","last_undegraded":"2023-07-06T01:08:50.526930+0000","last_fullsized":"2023-07-06T01:08:50.526930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521157+0000","last_change":"2023-07-06T01:08:50.521157+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521157+0000","last_undegraded":"2023-07-06T01:08:50.521157+0000","last_fullsized":"2023-07-06T01:08:50.521157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526976+0000","last_change":"2023-07-06T01:08:50.526976+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526976+0000","last_undegraded":"2023-07-06T01:08:50.526976+0000","last_fullsized":"2023-07-06T01:08:50.526976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533374+0000","last_change":"2023-07-06T01:08:50.533374+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533374+0000","last_undegraded":"2023-07-06T01:08:50.533374+0000","last_fullsized":"2023-07-06T01:08:50.533374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.524896+0000","last_change":"2023-07-06T01:08:50.524896+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.524896+0000","last_undegraded":"2023-07-06T01:08:50.524896+0000","last_fullsized":"2023-07-06T01:08:50.524896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522559+0000","last_change":"2023-07-06T01:08:50.522559+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522559+0000","last_undegraded":"2023-07-06T01:08:50.522559+0000","last_fullsized":"2023-07-06T01:08:50.522559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:08:56.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:08:56.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.620+0000 7f47571ff700 1 Processor -- start 2023-07-06T01:08:56.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.620+0000 7f47571ff700 1 -- start start 2023-07-06T01:08:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.621+0000 7f47571ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f47500b8920 0x7f47500af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.621+0000 7f47571ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500b3660 0x7f47500d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.621+0000 7f47571ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47500d1370 con 0x7f47500d0f10 2023-07-06T01:08:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.621+0000 7f47571ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475015cea0 con 0x7f47500b8920 2023-07-06T01:08:56.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.621+0000 7f47571ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47500b8cf0 con 0x7f47500b3660 2023-07-06T01:08:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f47500b8920 0x7f47500af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f47500b8920 0x7f47500af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45220/0 (socket says 172.21.15.71:45220) 2023-07-06T01:08:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 -- 172.21.15.71:0/70037464 learned_addr learned my addr 172.21.15.71:0/70037464 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:56.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f475579c700 1 --1- 172.21.15.71:0/70037464 >> v1:172.21.15.71:6789/0 conn(0x7f47500d0f10 0x7f47500b25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57630/0 (socket says 172.21.15.71:57630) 2023-07-06T01:08:56.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f474ffff700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500b3660 0x7f47500d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 -- 172.21.15.71:0/70037464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500b3660 msgr2=0x7f47500d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:56.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500b3660 0x7f47500d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 -- 172.21.15.71:0/70037464 >> v1:172.21.15.71:6789/0 conn(0x7f47500d0f10 legacy=0x7f47500b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f474f7fe700 1 -- 172.21.15.71:0/70037464 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312194402 0 0) 0x7f47500d1370 con 0x7f47500d0f10 2023-07-06T01:08:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 -- 172.21.15.71:0/70037464 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47500b23b0 con 0x7f47500b8920 2023-07-06T01:08:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f474ffff700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500b3660 0x7f47500d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.622+0000 7f4754f9b700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500af990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4744006fd0 tx=0x7f4744009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4933ce7aaba57c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f474f7fe700 1 -- 172.21.15.71:0/70037464 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744005e30 con 0x7f47500b8920 2023-07-06T01:08:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f474f7fe700 1 -- 172.21.15.71:0/70037464 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4744004030 con 0x7f47500b8920 2023-07-06T01:08:56.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f474f7fe700 1 -- 172.21.15.71:0/70037464 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47440043e0 con 0x7f47500b8920 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 -- 172.21.15.71:0/70037464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 msgr2=0x7f47500af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500af990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4744006fd0 tx=0x7f4744009bd0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 -- 172.21.15.71:0/70037464 shutdown_connections 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500af990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 --2- 172.21.15.71:0/70037464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500b3660 0x7f47500d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 -- 172.21.15.71:0/70037464 >> 172.21.15.71:0/70037464 conn(0x7f475009c130 msgr2=0x7f47500d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:56.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 -- 172.21.15.71:0/70037464 shutdown_connections 2023-07-06T01:08:56.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.623+0000 7f47571ff700 1 -- 172.21.15.71:0/70037464 wait complete. 2023-07-06T01:08:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.625+0000 7f47571ff700 1 Processor -- start 2023-07-06T01:08:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.625+0000 7f47571ff700 1 -- start start 2023-07-06T01:08:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f47571ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47500b3660 0x7f4750150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f47571ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f47571ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500d0f10 0x7f4750154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f47571ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475015e5f0 con 0x7f47500b8920 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f47571ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475015e780 con 0x7f47500b3660 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f47571ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47501509d0 con 0x7f47500d0f10 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f474ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f474ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45230/0 (socket says 172.21.15.71:45230) 2023-07-06T01:08:56.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.626+0000 7f474ffff700 1 -- 172.21.15.71:0/1660899145 learned_addr learned my addr 172.21.15.71:0/1660899145 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f4754f9b700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47500b3660 0x7f4750150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f475579c700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500d0f10 0x7f4750154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474ffff700 1 -- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500d0f10 msgr2=0x7f4750154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474ffff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500d0f10 0x7f4750154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474ffff700 1 -- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47500b3660 msgr2=0x7f4750150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474ffff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47500b3660 0x7f4750150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474ffff700 1 -- 172.21.15.71:0/1660899145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009500 con 0x7f47500b8920 2023-07-06T01:08:56.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474ffff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500c8610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c780 tx=0x7f473c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:56.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c011800 con 0x7f47500b8920 2023-07-06T01:08:56.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c011960 con 0x7f47500b8920 2023-07-06T01:08:56.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c011cd0 con 0x7f47500b8920 2023-07-06T01:08:56.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.627+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47500c91c0 con 0x7f47500b8920 2023-07-06T01:08:56.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.628+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47500c9780 con 0x7f47500b8920 2023-07-06T01:08:56.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.628+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475004eb90 con 0x7f47500b8920 2023-07-06T01:08:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.629+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f473c021350 con 0x7f47500b8920 2023-07-06T01:08:56.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.630+0000 7f474d7fa700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f473406ace0 0x7f473406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.630+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f473c089320 con 0x7f47500b8920 2023-07-06T01:08:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.631+0000 7f4754f9b700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f473406ace0 0x7f473406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.631+0000 7f4754f9b700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f473406ace0 0x7f473406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4744009c10 tx=0x7f4744008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:56.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.634+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f473c057e50 con 0x7f47500b8920 2023-07-06T01:08:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.822+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47500b05e0 con 0x7f473406ace0 2023-07-06T01:08:56.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.831+0000 7f474d7fa700 1 -- 172.21.15.71:0/1660899145 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282789 (secure 0 0 0) 0x7f4744021070 con 0x7f473406ace0 2023-07-06T01:08:56.836 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f473406ace0 msgr2=0x7f473406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f473406ace0 0x7f473406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4744009c10 tx=0x7f4744008070 comp rx=0 tx=0).stop 2023-07-06T01:08:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 msgr2=0x7f47500c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500c8610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c780 tx=0x7f473c00ca90 comp rx=0 tx=0).stop 2023-07-06T01:08:56.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 shutdown_connections 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f473406ace0 0x7f473406d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47500d0f10 0x7f4750154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47500b3660 0x7f4750150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 --2- 172.21.15.71:0/1660899145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47500b8920 0x7f47500c8610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 >> 172.21.15.71:0/1660899145 conn(0x7f475009c130 msgr2=0x7f475006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 shutdown_connections 2023-07-06T01:08:56.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:56.836+0000 7f47571ff700 1 -- 172.21.15.71:0/1660899145 wait complete. 2023-07-06T01:08:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:08:56.855 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-06T01:08:54.823373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":169,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218448,"kb_used_data":2832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756272,"statfs":{"total":773094113280,"available":772870422528,"internally_reserved":0,"allocated":2899968,"data_stored":1774040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.312409"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523834+0000","last_change":"2023-07-06T01:08:50.523834+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523834+0000","last_undegraded":"2023-07-06T01:08:50.523834+0000","last_fullsized":"2023-07-06T01:08:50.523834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561492+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:51.561492+0000","last_peered":"2023-07-06T01:08:51.561492+0000","last_clean":"2023-07-06T01:08:51.561492+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:51.561492+0000","last_undegraded":"2023-07-06T01:08:51.561492+0000","last_fullsized":"2023-07-06T01:08:51.561492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.534233+0000","last_change":"2023-07-06T01:08:50.534233+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.534233+0000","last_undegraded":"2023-07-06T01:08:50.534233+0000","last_fullsized":"2023-07-06T01:08:50.534233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521068+0000","last_change":"2023-07-06T01:08:50.521068+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521068+0000","last_undegraded":"2023-07-06T01:08:50.521068+0000","last_fullsized":"2023-07-06T01:08:50.521068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.551114+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:51.551114+0000","last_peered":"2023-07-06T01:08:51.551114+0000","last_clean":"2023-07-06T01:08:51.551114+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:51.551114+0000","last_undegraded":"2023-07-06T01:08:51.551114+0000","last_fullsized":"2023-07-06T01:08:51.551114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.534330+0000","last_change":"2023-07-06T01:08:50.534330+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.534330+0000","last_undegraded":"2023-07-06T01:08:50.534330+0000","last_fullsized":"2023-07-06T01:08:50.534330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521443+0000","last_change":"2023-07-06T01:08:50.521443+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521443+0000","last_undegraded":"2023-07-06T01:08:50.521443+0000","last_fullsized":"2023-07-06T01:08:50.521443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.567746+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:51.567746+0000","last_peered":"2023-07-06T01:08:51.567746+0000","last_clean":"2023-07-06T01:08:51.567746+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:51.567746+0000","last_undegraded":"2023-07-06T01:08:51.567746+0000","last_fullsized":"2023-07-06T01:08:51.567746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550779+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:51.550779+0000","last_peered":"2023-07-06T01:08:51.550779+0000","last_clean":"2023-07-06T01:08:51.550779+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:51.550779+0000","last_undegraded":"2023-07-06T01:08:51.550779+0000","last_fullsized":"2023-07-06T01:08:51.550779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:21.687284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561474+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:51.561474+0000","last_peered":"2023-07-06T01:08:51.561474+0000","last_clean":"2023-07-06T01:08:51.561474+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:51.561474+0000","last_undegraded":"2023-07-06T01:08:51.561474+0000","last_fullsized":"2023-07-06T01:08:51.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533228+0000","last_change":"2023-07-06T01:08:50.533228+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533228+0000","last_undegraded":"2023-07-06T01:08:50.533228+0000","last_fullsized":"2023-07-06T01:08:50.533228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522072+0000","last_change":"2023-07-06T01:08:50.522072+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522072+0000","last_undegraded":"2023-07-06T01:08:50.522072+0000","last_fullsized":"2023-07-06T01:08:50.522072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.524535+0000","last_change":"2023-07-06T01:08:50.524535+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.524535+0000","last_undegraded":"2023-07-06T01:08:50.524535+0000","last_fullsized":"2023-07-06T01:08:50.524535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561576+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:51.561576+0000","last_peered":"2023-07-06T01:08:51.561576+0000","last_clean":"2023-07-06T01:08:51.561576+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:51.561576+0000","last_undegraded":"2023-07-06T01:08:51.561576+0000","last_fullsized":"2023-07-06T01:08:51.561576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520813+0000","last_change":"2023-07-06T01:08:50.520813+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520813+0000","last_undegraded":"2023-07-06T01:08:50.520813+0000","last_fullsized":"2023-07-06T01:08:50.520813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526317+0000","last_change":"2023-07-06T01:08:50.526317+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526317+0000","last_undegraded":"2023-07-06T01:08:50.526317+0000","last_fullsized":"2023-07-06T01:08:50.526317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557675+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:51.557675+0000","last_peered":"2023-07-06T01:08:51.557675+0000","last_clean":"2023-07-06T01:08:51.557675+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:51.557675+0000","last_undegraded":"2023-07-06T01:08:51.557675+0000","last_fullsized":"2023-07-06T01:08:51.557675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533297+0000","last_change":"2023-07-06T01:08:50.533297+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533297+0000","last_undegraded":"2023-07-06T01:08:50.533297+0000","last_fullsized":"2023-07-06T01:08:50.533297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523242+0000","last_change":"2023-07-06T01:08:50.523242+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523242+0000","last_undegraded":"2023-07-06T01:08:50.523242+0000","last_fullsized":"2023-07-06T01:08:50.523242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.532412+0000","last_change":"2023-07-06T01:08:50.532412+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.532412+0000","last_undegraded":"2023-07-06T01:08:50.532412+0000","last_fullsized":"2023-07-06T01:08:50.532412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521933+0000","last_change":"2023-07-06T01:08:50.521933+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521933+0000","last_undegraded":"2023-07-06T01:08:50.521933+0000","last_fullsized":"2023-07-06T01:08:50.521933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557593+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:51.557593+0000","last_peered":"2023-07-06T01:08:51.557593+0000","last_clean":"2023-07-06T01:08:51.557593+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:51.557593+0000","last_undegraded":"2023-07-06T01:08:51.557593+0000","last_fullsized":"2023-07-06T01:08:51.557593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:18.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.525630+0000","last_change":"2023-07-06T01:08:50.525630+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.525630+0000","last_undegraded":"2023-07-06T01:08:50.525630+0000","last_fullsized":"2023-07-06T01:08:50.525630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520240+0000","last_change":"2023-07-06T01:08:50.520240+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520240+0000","last_undegraded":"2023-07-06T01:08:50.520240+0000","last_fullsized":"2023-07-06T01:08:50.520240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523285+0000","last_change":"2023-07-06T01:08:50.523285+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523285+0000","last_undegraded":"2023-07-06T01:08:50.523285+0000","last_fullsized":"2023-07-06T01:08:50.523285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521594+0000","last_change":"2023-07-06T01:08:50.521594+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521594+0000","last_undegraded":"2023-07-06T01:08:50.521594+0000","last_fullsized":"2023-07-06T01:08:50.521594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561550+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:51.561550+0000","last_peered":"2023-07-06T01:08:51.561550+0000","last_clean":"2023-07-06T01:08:51.561550+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:51.561550+0000","last_undegraded":"2023-07-06T01:08:51.561550+0000","last_fullsized":"2023-07-06T01:08:51.561550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.547735+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:50.547735+0000","last_peered":"2023-07-06T01:08:50.547735+0000","last_clean":"2023-07-06T01:08:50.547735+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:50.547735+0000","last_undegraded":"2023-07-06T01:08:50.547735+0000","last_fullsized":"2023-07-06T01:08:50.547735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:21.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.531285+0000","last_change":"2023-07-06T01:08:50.531285+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.531285+0000","last_undegraded":"2023-07-06T01:08:50.531285+0000","last_fullsized":"2023-07-06T01:08:50.531285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539513+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:50.539513+0000","last_peered":"2023-07-06T01:08:50.539513+0000","last_clean":"2023-07-06T01:08:50.539513+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:50.539513+0000","last_undegraded":"2023-07-06T01:08:50.539513+0000","last_fullsized":"2023-07-06T01:08:50.539513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550435+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:51.550435+0000","last_peered":"2023-07-06T01:08:51.550435+0000","last_clean":"2023-07-06T01:08:51.550435+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:51.550435+0000","last_undegraded":"2023-07-06T01:08:51.550435+0000","last_fullsized":"2023-07-06T01:08:51.550435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:33.241903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.542050+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:50.542050+0000","last_peered":"2023-07-06T01:08:50.542050+0000","last_clean":"2023-07-06T01:08:50.542050+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:50.542050+0000","last_undegraded":"2023-07-06T01:08:50.542050+0000","last_fullsized":"2023-07-06T01:08:50.542050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:55.840317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521965+0000","last_change":"2023-07-06T01:08:50.521965+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521965+0000","last_undegraded":"2023-07-06T01:08:50.521965+0000","last_fullsized":"2023-07-06T01:08:50.521965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529840+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:51.529840+0000","last_peered":"2023-07-06T01:08:51.529840+0000","last_clean":"2023-07-06T01:08:51.529840+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:51.529840+0000","last_undegraded":"2023-07-06T01:08:51.529840+0000","last_fullsized":"2023-07-06T01:08:51.529840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.527276+0000","last_change":"2023-07-06T01:08:50.527276+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.527276+0000","last_undegraded":"2023-07-06T01:08:50.527276+0000","last_fullsized":"2023-07-06T01:08:50.527276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.535933+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:51.535933+0000","last_peered":"2023-07-06T01:08:51.535933+0000","last_clean":"2023-07-06T01:08:51.535933+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:51.535933+0000","last_undegraded":"2023-07-06T01:08:51.535933+0000","last_fullsized":"2023-07-06T01:08:51.535933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:14.557999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526038+0000","last_change":"2023-07-06T01:08:50.526038+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526038+0000","last_undegraded":"2023-07-06T01:08:50.526038+0000","last_fullsized":"2023-07-06T01:08:50.526038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545183+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:50.545183+0000","last_peered":"2023-07-06T01:08:50.545183+0000","last_clean":"2023-07-06T01:08:50.545183+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:50.545183+0000","last_undegraded":"2023-07-06T01:08:50.545183+0000","last_fullsized":"2023-07-06T01:08:50.545183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:20.680536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522931+0000","last_change":"2023-07-06T01:08:50.522931+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522931+0000","last_undegraded":"2023-07-06T01:08:50.522931+0000","last_fullsized":"2023-07-06T01:08:50.522931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544595+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:50.544595+0000","last_peered":"2023-07-06T01:08:50.544595+0000","last_clean":"2023-07-06T01:08:50.544595+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:50.544595+0000","last_undegraded":"2023-07-06T01:08:50.544595+0000","last_fullsized":"2023-07-06T01:08:50.544595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:51:01.235254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533531+0000","last_change":"2023-07-06T01:08:50.533531+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533531+0000","last_undegraded":"2023-07-06T01:08:50.533531+0000","last_fullsized":"2023-07-06T01:08:50.533531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544682+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:50.544682+0000","last_peered":"2023-07-06T01:08:50.544682+0000","last_clean":"2023-07-06T01:08:50.544682+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:50.544682+0000","last_undegraded":"2023-07-06T01:08:50.544682+0000","last_fullsized":"2023-07-06T01:08:50.544682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.529420+0000","last_change":"2023-07-06T01:08:50.529420+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.529420+0000","last_undegraded":"2023-07-06T01:08:50.529420+0000","last_fullsized":"2023-07-06T01:08:50.529420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528681+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:51.528681+0000","last_peered":"2023-07-06T01:08:51.528681+0000","last_clean":"2023-07-06T01:08:51.528681+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:51.528681+0000","last_undegraded":"2023-07-06T01:08:51.528681+0000","last_fullsized":"2023-07-06T01:08:51.528681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561532+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:51.561532+0000","last_peered":"2023-07-06T01:08:51.561532+0000","last_clean":"2023-07-06T01:08:51.561532+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:51.561532+0000","last_undegraded":"2023-07-06T01:08:51.561532+0000","last_fullsized":"2023-07-06T01:08:51.561532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544655+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:50.544655+0000","last_peered":"2023-07-06T01:08:50.544655+0000","last_clean":"2023-07-06T01:08:50.544655+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:50.544655+0000","last_undegraded":"2023-07-06T01:08:50.544655+0000","last_fullsized":"2023-07-06T01:08:50.544655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:32.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550797+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:51.550797+0000","last_peered":"2023-07-06T01:08:51.550797+0000","last_clean":"2023-07-06T01:08:51.550797+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:51.550797+0000","last_undegraded":"2023-07-06T01:08:51.550797+0000","last_fullsized":"2023-07-06T01:08:51.550797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:49.267223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.533192+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:50.533192+0000","last_peered":"2023-07-06T01:08:50.533192+0000","last_clean":"2023-07-06T01:08:50.533192+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:50.533192+0000","last_undegraded":"2023-07-06T01:08:50.533192+0000","last_fullsized":"2023-07-06T01:08:50.533192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:55.840317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.530119+0000","last_change":"2023-07-06T01:08:50.530119+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.530119+0000","last_undegraded":"2023-07-06T01:08:50.530119+0000","last_fullsized":"2023-07-06T01:08:50.530119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545150+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:50.545150+0000","last_peered":"2023-07-06T01:08:50.545150+0000","last_clean":"2023-07-06T01:08:50.545150+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:50.545150+0000","last_undegraded":"2023-07-06T01:08:50.545150+0000","last_fullsized":"2023-07-06T01:08:50.545150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:48.837818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561444+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:51.561444+0000","last_peered":"2023-07-06T01:08:51.561444+0000","last_clean":"2023-07-06T01:08:51.561444+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:51.561444+0000","last_undegraded":"2023-07-06T01:08:51.561444+0000","last_fullsized":"2023-07-06T01:08:51.561444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545119+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:50.545119+0000","last_peered":"2023-07-06T01:08:50.545119+0000","last_clean":"2023-07-06T01:08:50.545119+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:50.545119+0000","last_undegraded":"2023-07-06T01:08:50.545119+0000","last_fullsized":"2023-07-06T01:08:50.545119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:09.991008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528119+0000","last_change":"2023-07-06T01:08:50.528119+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528119+0000","last_undegraded":"2023-07-06T01:08:50.528119+0000","last_fullsized":"2023-07-06T01:08:50.528119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.545199+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:50.545199+0000","last_peered":"2023-07-06T01:08:50.545199+0000","last_clean":"2023-07-06T01:08:50.545199+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:50.545199+0000","last_undegraded":"2023-07-06T01:08:50.545199+0000","last_fullsized":"2023-07-06T01:08:50.545199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:41.923174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.523002+0000","last_change":"2023-07-06T01:08:50.523002+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.523002+0000","last_undegraded":"2023-07-06T01:08:50.523002+0000","last_fullsized":"2023-07-06T01:08:50.523002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531958+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:51.531958+0000","last_peered":"2023-07-06T01:08:51.531958+0000","last_clean":"2023-07-06T01:08:51.531958+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:51.531958+0000","last_undegraded":"2023-07-06T01:08:51.531958+0000","last_fullsized":"2023-07-06T01:08:51.531958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.549593+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:51.549593+0000","last_peered":"2023-07-06T01:08:51.549593+0000","last_clean":"2023-07-06T01:08:51.549593+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:51.549593+0000","last_undegraded":"2023-07-06T01:08:51.549593+0000","last_fullsized":"2023-07-06T01:08:51.549593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539578+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:50.539578+0000","last_peered":"2023-07-06T01:08:50.539578+0000","last_clean":"2023-07-06T01:08:50.539578+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:50.539578+0000","last_undegraded":"2023-07-06T01:08:50.539578+0000","last_fullsized":"2023-07-06T01:08:50.539578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:36.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.531654+0000","last_change":"2023-07-06T01:08:50.531654+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.531654+0000","last_undegraded":"2023-07-06T01:08:50.531654+0000","last_fullsized":"2023-07-06T01:08:50.531654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.538412+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:50.538412+0000","last_peered":"2023-07-06T01:08:50.538412+0000","last_clean":"2023-07-06T01:08:50.538412+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:50.538412+0000","last_undegraded":"2023-07-06T01:08:50.538412+0000","last_fullsized":"2023-07-06T01:08:50.538412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528599+0000","last_change":"2023-07-06T01:08:50.528599+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528599+0000","last_undegraded":"2023-07-06T01:08:50.528599+0000","last_fullsized":"2023-07-06T01:08:50.528599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.540572+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:50.540572+0000","last_peered":"2023-07-06T01:08:50.540572+0000","last_clean":"2023-07-06T01:08:50.540572+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:50.540572+0000","last_undegraded":"2023-07-06T01:08:50.540572+0000","last_fullsized":"2023-07-06T01:08:50.540572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:50:02.670638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528790+0000","last_change":"2023-07-06T01:08:50.528790+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528790+0000","last_undegraded":"2023-07-06T01:08:50.528790+0000","last_fullsized":"2023-07-06T01:08:50.528790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544947+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:50.544947+0000","last_peered":"2023-07-06T01:08:50.544947+0000","last_clean":"2023-07-06T01:08:50.544947+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:50.544947+0000","last_undegraded":"2023-07-06T01:08:50.544947+0000","last_fullsized":"2023-07-06T01:08:50.544947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:14:03.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521013+0000","last_change":"2023-07-06T01:08:50.521013+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521013+0000","last_undegraded":"2023-07-06T01:08:50.521013+0000","last_fullsized":"2023-07-06T01:08:50.521013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522793+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:50.522793+0000","last_peered":"2023-07-06T01:08:50.522793+0000","last_clean":"2023-07-06T01:08:50.522793+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:50.522793+0000","last_undegraded":"2023-07-06T01:08:50.522793+0000","last_fullsized":"2023-07-06T01:08:50.522793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:42.920596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.534381+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:51.534381+0000","last_peered":"2023-07-06T01:08:51.534381+0000","last_clean":"2023-07-06T01:08:51.534381+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:51.534381+0000","last_undegraded":"2023-07-06T01:08:51.534381+0000","last_fullsized":"2023-07-06T01:08:51.534381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:01.848614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520467+0000","last_change":"2023-07-06T01:08:50.520467+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520467+0000","last_undegraded":"2023-07-06T01:08:50.520467+0000","last_fullsized":"2023-07-06T01:08:50.520467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.536319+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:51.536319+0000","last_peered":"2023-07-06T01:08:51.536319+0000","last_clean":"2023-07-06T01:08:51.536319+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:51.536319+0000","last_undegraded":"2023-07-06T01:08:51.536319+0000","last_fullsized":"2023-07-06T01:08:51.536319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:30.752260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544623+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:50.544623+0000","last_peered":"2023-07-06T01:08:50.544623+0000","last_clean":"2023-07-06T01:08:50.544623+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:50.544623+0000","last_undegraded":"2023-07-06T01:08:50.544623+0000","last_fullsized":"2023-07-06T01:08:50.544623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:40:36.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.520281+0000","last_change":"2023-07-06T01:08:50.520281+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.520281+0000","last_undegraded":"2023-07-06T01:08:50.520281+0000","last_fullsized":"2023-07-06T01:08:50.520281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522334+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:50.522334+0000","last_peered":"2023-07-06T01:08:50.522334+0000","last_clean":"2023-07-06T01:08:50.522334+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:50.522334+0000","last_undegraded":"2023-07-06T01:08:50.522334+0000","last_fullsized":"2023-07-06T01:08:50.522334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:15.748208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.536879+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:50.536879+0000","last_peered":"2023-07-06T01:08:50.536879+0000","last_clean":"2023-07-06T01:08:50.536879+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:50.536879+0000","last_undegraded":"2023-07-06T01:08:50.536879+0000","last_fullsized":"2023-07-06T01:08:50.536879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522852+0000","last_change":"2023-07-06T01:08:50.522852+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522852+0000","last_undegraded":"2023-07-06T01:08:50.522852+0000","last_fullsized":"2023-07-06T01:08:50.522852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531467+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:51.531467+0000","last_peered":"2023-07-06T01:08:51.531467+0000","last_clean":"2023-07-06T01:08:51.531467+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:51.531467+0000","last_undegraded":"2023-07-06T01:08:51.531467+0000","last_fullsized":"2023-07-06T01:08:51.531467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:37.476727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":171,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522938+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:50.522938+0000","last_peered":"2023-07-06T01:08:50.522938+0000","last_clean":"2023-07-06T01:08:50.522938+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:50.522938+0000","last_undegraded":"2023-07-06T01:08:50.522938+0000","last_fullsized":"2023-07-06T01:08:50.522938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:30.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.542000+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:50.542000+0000","last_peered":"2023-07-06T01:08:50.542000+0000","last_clean":"2023-07-06T01:08:50.542000+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:50.542000+0000","last_undegraded":"2023-07-06T01:08:50.542000+0000","last_fullsized":"2023-07-06T01:08:50.542000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:17:21.088087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522455+0000","last_change":"2023-07-06T01:08:50.522455+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522455+0000","last_undegraded":"2023-07-06T01:08:50.522455+0000","last_fullsized":"2023-07-06T01:08:50.522455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.523085+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:50.523085+0000","last_peered":"2023-07-06T01:08:50.523085+0000","last_clean":"2023-07-06T01:08:50.523085+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:50.523085+0000","last_undegraded":"2023-07-06T01:08:50.523085+0000","last_fullsized":"2023-07-06T01:08:50.523085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:20.541176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528523+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:51.528523+0000","last_peered":"2023-07-06T01:08:51.528523+0000","last_clean":"2023-07-06T01:08:51.528523+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:51.528523+0000","last_undegraded":"2023-07-06T01:08:51.528523+0000","last_fullsized":"2023-07-06T01:08:51.528523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.548640+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:51.548640+0000","last_peered":"2023-07-06T01:08:51.548640+0000","last_clean":"2023-07-06T01:08:51.548640+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:51.548640+0000","last_undegraded":"2023-07-06T01:08:51.548640+0000","last_fullsized":"2023-07-06T01:08:51.548640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.523022+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:50.523022+0000","last_peered":"2023-07-06T01:08:50.523022+0000","last_clean":"2023-07-06T01:08:50.523022+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:50.523022+0000","last_undegraded":"2023-07-06T01:08:50.523022+0000","last_fullsized":"2023-07-06T01:08:50.523022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:42.512700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.539485+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:50.539485+0000","last_peered":"2023-07-06T01:08:50.539485+0000","last_clean":"2023-07-06T01:08:50.539485+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:50.539485+0000","last_undegraded":"2023-07-06T01:08:50.539485+0000","last_fullsized":"2023-07-06T01:08:50.539485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.560504+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:51.560504+0000","last_peered":"2023-07-06T01:08:51.560504+0000","last_clean":"2023-07-06T01:08:51.560504+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:51.560504+0000","last_undegraded":"2023-07-06T01:08:51.560504+0000","last_fullsized":"2023-07-06T01:08:51.560504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.547292+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:50.547292+0000","last_peered":"2023-07-06T01:08:50.547292+0000","last_clean":"2023-07-06T01:08:50.547292+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:50.547292+0000","last_undegraded":"2023-07-06T01:08:50.547292+0000","last_fullsized":"2023-07-06T01:08:50.547292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.521939+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:50.521939+0000","last_peered":"2023-07-06T01:08:50.521939+0000","last_clean":"2023-07-06T01:08:50.521939+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:50.521939+0000","last_undegraded":"2023-07-06T01:08:50.521939+0000","last_fullsized":"2023-07-06T01:08:50.521939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:12.318565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528125+0000","last_change":"2023-07-06T01:08:50.528125+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528125+0000","last_undegraded":"2023-07-06T01:08:50.528125+0000","last_fullsized":"2023-07-06T01:08:50.528125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.522264+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:50.522264+0000","last_peered":"2023-07-06T01:08:50.522264+0000","last_clean":"2023-07-06T01:08:50.522264+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:50.522264+0000","last_undegraded":"2023-07-06T01:08:50.522264+0000","last_fullsized":"2023-07-06T01:08:50.522264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:57.942136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529455+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:51.529455+0000","last_peered":"2023-07-06T01:08:51.529455+0000","last_clean":"2023-07-06T01:08:51.529455+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:51.529455+0000","last_undegraded":"2023-07-06T01:08:51.529455+0000","last_fullsized":"2023-07-06T01:08:51.529455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:16.552277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.527627+0000","last_change":"2023-07-06T01:08:50.527627+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.527627+0000","last_undegraded":"2023-07-06T01:08:50.527627+0000","last_fullsized":"2023-07-06T01:08:50.527627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563845+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:51.563845+0000","last_peered":"2023-07-06T01:08:51.563845+0000","last_clean":"2023-07-06T01:08:51.563845+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:51.563845+0000","last_undegraded":"2023-07-06T01:08:51.563845+0000","last_fullsized":"2023-07-06T01:08:51.563845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521067+0000","last_change":"2023-07-06T01:08:50.521067+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521067+0000","last_undegraded":"2023-07-06T01:08:50.521067+0000","last_fullsized":"2023-07-06T01:08:50.521067+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.562490+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:51.562490+0000","last_peered":"2023-07-06T01:08:51.562490+0000","last_clean":"2023-07-06T01:08:51.562490+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:51.562490+0000","last_undegraded":"2023-07-06T01:08:51.562490+0000","last_fullsized":"2023-07-06T01:08:51.562490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.528795+0000","last_change":"2023-07-06T01:08:50.528795+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.528795+0000","last_undegraded":"2023-07-06T01:08:50.528795+0000","last_fullsized":"2023-07-06T01:08:50.528795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563303+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:51.563303+0000","last_peered":"2023-07-06T01:08:51.563303+0000","last_clean":"2023-07-06T01:08:51.563303+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:51.563303+0000","last_undegraded":"2023-07-06T01:08:51.563303+0000","last_fullsized":"2023-07-06T01:08:51.563303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.530957+0000","last_change":"2023-07-06T01:08:50.530957+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.530957+0000","last_undegraded":"2023-07-06T01:08:50.530957+0000","last_fullsized":"2023-07-06T01:08:50.530957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-07-06T01:08:50.544917+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:50.544917+0000","last_peered":"2023-07-06T01:08:50.544917+0000","last_clean":"2023-07-06T01:08:50.544917+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:50.544917+0000","last_undegraded":"2023-07-06T01:08:50.544917+0000","last_fullsized":"2023-07-06T01:08:50.544917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:27:12.369665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526479+0000","last_change":"2023-07-06T01:08:50.526479+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526479+0000","last_undegraded":"2023-07-06T01:08:50.526479+0000","last_fullsized":"2023-07-06T01:08:50.526479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557988+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:51.557988+0000","last_peered":"2023-07-06T01:08:51.557988+0000","last_clean":"2023-07-06T01:08:51.557988+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:51.557988+0000","last_undegraded":"2023-07-06T01:08:51.557988+0000","last_fullsized":"2023-07-06T01:08:51.557988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526930+0000","last_change":"2023-07-06T01:08:50.526930+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526930+0000","last_undegraded":"2023-07-06T01:08:50.526930+0000","last_fullsized":"2023-07-06T01:08:50.526930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.521157+0000","last_change":"2023-07-06T01:08:50.521157+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.521157+0000","last_undegraded":"2023-07-06T01:08:50.521157+0000","last_fullsized":"2023-07-06T01:08:50.521157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.526976+0000","last_change":"2023-07-06T01:08:50.526976+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.526976+0000","last_undegraded":"2023-07-06T01:08:50.526976+0000","last_fullsized":"2023-07-06T01:08:50.526976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.533374+0000","last_change":"2023-07-06T01:08:50.533374+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.533374+0000","last_undegraded":"2023-07-06T01:08:50.533374+0000","last_fullsized":"2023-07-06T01:08:50.533374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.524896+0000","last_change":"2023-07-06T01:08:50.524896+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.524896+0000","last_undegraded":"2023-07-06T01:08:50.524896+0000","last_fullsized":"2023-07-06T01:08:50.524896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2023-07-06T01:08:50.522559+0000","last_change":"2023-07-06T01:08:50.522559+0000","last_active":"2023-07-06T01:08:50.507282+0000","last_peered":"2023-07-06T01:08:50.507282+0000","last_clean":"2023-07-06T01:08:50.507282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:08:50.522559+0000","last_undegraded":"2023-07-06T01:08:50.522559+0000","last_fullsized":"2023-07-06T01:08:50.522559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:08:56.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-07-06T01:08:56.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.523834+0000', 'last_change': '2023-07-06T01:08:50.523834+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.523834+0000', 'last_undegraded': '2023-07-06T01:08:50.523834+0000', 'last_fullsized': '2023-07-06T01:08:50.523834+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T01:08:56.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-07-06T01:08:56.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.534233+0000', 'last_change': '2023-07-06T01:08:50.534233+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.534233+0000', 'last_undegraded': '2023-07-06T01:08:50.534233+0000', 'last_fullsized': '2023-07-06T01:08:50.534233+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-07-06T01:08:56.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521068+0000', 'last_change': '2023-07-06T01:08:50.521068+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521068+0000', 'last_undegraded': '2023-07-06T01:08:50.521068+0000', 'last_fullsized': '2023-07-06T01:08:50.521068+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T01:08:56.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-07-06T01:08:56.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.534330+0000', 'last_change': '2023-07-06T01:08:50.534330+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.534330+0000', 'last_undegraded': '2023-07-06T01:08:50.534330+0000', 'last_fullsized': '2023-07-06T01:08:50.534330+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-07-06T01:08:56.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521443+0000', 'last_change': '2023-07-06T01:08:50.521443+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521443+0000', 'last_undegraded': '2023-07-06T01:08:50.521443+0000', 'last_fullsized': '2023-07-06T01:08:50.521443+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T01:08:56.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-07-06T01:08:56.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.533228+0000', 'last_change': '2023-07-06T01:08:50.533228+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.533228+0000', 'last_undegraded': '2023-07-06T01:08:50.533228+0000', 'last_fullsized': '2023-07-06T01:08:50.533228+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-07-06T01:08:56.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.522072+0000', 'last_change': '2023-07-06T01:08:50.522072+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.522072+0000', 'last_undegraded': '2023-07-06T01:08:50.522072+0000', 'last_fullsized': '2023-07-06T01:08:50.522072+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T01:08:56.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-07-06T01:08:56.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.524535+0000', 'last_change': '2023-07-06T01:08:50.524535+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.524535+0000', 'last_undegraded': '2023-07-06T01:08:50.524535+0000', 'last_fullsized': '2023-07-06T01:08:50.524535+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T01:08:56.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-07-06T01:08:56.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.520813+0000', 'last_change': '2023-07-06T01:08:50.520813+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.520813+0000', 'last_undegraded': '2023-07-06T01:08:50.520813+0000', 'last_fullsized': '2023-07-06T01:08:50.520813+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T01:08:56.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-07-06T01:08:56.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.526317+0000', 'last_change': '2023-07-06T01:08:50.526317+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.526317+0000', 'last_undegraded': '2023-07-06T01:08:50.526317+0000', 'last_fullsized': '2023-07-06T01:08:50.526317+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-07-06T01:08:56.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.533297+0000', 'last_change': '2023-07-06T01:08:50.533297+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.533297+0000', 'last_undegraded': '2023-07-06T01:08:50.533297+0000', 'last_fullsized': '2023-07-06T01:08:50.533297+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-07-06T01:08:56.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.523242+0000', 'last_change': '2023-07-06T01:08:50.523242+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.523242+0000', 'last_undegraded': '2023-07-06T01:08:50.523242+0000', 'last_fullsized': '2023-07-06T01:08:50.523242+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T01:08:56.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-07-06T01:08:56.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.532412+0000', 'last_change': '2023-07-06T01:08:50.532412+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.532412+0000', 'last_undegraded': '2023-07-06T01:08:50.532412+0000', 'last_fullsized': '2023-07-06T01:08:50.532412+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-07-06T01:08:56.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521933+0000', 'last_change': '2023-07-06T01:08:50.521933+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521933+0000', 'last_undegraded': '2023-07-06T01:08:50.521933+0000', 'last_fullsized': '2023-07-06T01:08:50.521933+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T01:08:56.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-07-06T01:08:56.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.525630+0000', 'last_change': '2023-07-06T01:08:50.525630+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.525630+0000', 'last_undegraded': '2023-07-06T01:08:50.525630+0000', 'last_fullsized': '2023-07-06T01:08:50.525630+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-07-06T01:08:56.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.520240+0000', 'last_change': '2023-07-06T01:08:50.520240+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.520240+0000', 'last_undegraded': '2023-07-06T01:08:50.520240+0000', 'last_fullsized': '2023-07-06T01:08:50.520240+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T01:08:56.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-07-06T01:08:56.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.523285+0000', 'last_change': '2023-07-06T01:08:50.523285+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.523285+0000', 'last_undegraded': '2023-07-06T01:08:50.523285+0000', 'last_fullsized': '2023-07-06T01:08:50.523285+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-07-06T01:08:56.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521594+0000', 'last_change': '2023-07-06T01:08:50.521594+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521594+0000', 'last_undegraded': '2023-07-06T01:08:50.521594+0000', 'last_fullsized': '2023-07-06T01:08:50.521594+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-07-06T01:08:56.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.531285+0000', 'last_change': '2023-07-06T01:08:50.531285+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.531285+0000', 'last_undegraded': '2023-07-06T01:08:50.531285+0000', 'last_fullsized': '2023-07-06T01:08:50.531285+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-07-06T01:08:56.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521965+0000', 'last_change': '2023-07-06T01:08:50.521965+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521965+0000', 'last_undegraded': '2023-07-06T01:08:50.521965+0000', 'last_fullsized': '2023-07-06T01:08:50.521965+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T01:08:56.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-07-06T01:08:56.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.527276+0000', 'last_change': '2023-07-06T01:08:50.527276+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.527276+0000', 'last_undegraded': '2023-07-06T01:08:50.527276+0000', 'last_fullsized': '2023-07-06T01:08:50.527276+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-07-06T01:08:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.526038+0000', 'last_change': '2023-07-06T01:08:50.526038+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.526038+0000', 'last_undegraded': '2023-07-06T01:08:50.526038+0000', 'last_fullsized': '2023-07-06T01:08:50.526038+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-07-06T01:08:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.522931+0000', 'last_change': '2023-07-06T01:08:50.522931+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.522931+0000', 'last_undegraded': '2023-07-06T01:08:50.522931+0000', 'last_fullsized': '2023-07-06T01:08:50.522931+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.874 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-07-06T01:08:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.533531+0000', 'last_change': '2023-07-06T01:08:50.533531+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.533531+0000', 'last_undegraded': '2023-07-06T01:08:50.533531+0000', 'last_fullsized': '2023-07-06T01:08:50.533531+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-07-06T01:08:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.529420+0000', 'last_change': '2023-07-06T01:08:50.529420+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.529420+0000', 'last_undegraded': '2023-07-06T01:08:50.529420+0000', 'last_fullsized': '2023-07-06T01:08:50.529420+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.875 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-07-06T01:08:56.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.530119+0000', 'last_change': '2023-07-06T01:08:50.530119+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.530119+0000', 'last_undegraded': '2023-07-06T01:08:50.530119+0000', 'last_fullsized': '2023-07-06T01:08:50.530119+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.876 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-07-06T01:08:56.876 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.528119+0000', 'last_change': '2023-07-06T01:08:50.528119+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.528119+0000', 'last_undegraded': '2023-07-06T01:08:50.528119+0000', 'last_fullsized': '2023-07-06T01:08:50.528119+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-07-06T01:08:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.523002+0000', 'last_change': '2023-07-06T01:08:50.523002+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.523002+0000', 'last_undegraded': '2023-07-06T01:08:50.523002+0000', 'last_fullsized': '2023-07-06T01:08:50.523002+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T01:08:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-07-06T01:08:56.877 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.531654+0000', 'last_change': '2023-07-06T01:08:50.531654+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.531654+0000', 'last_undegraded': '2023-07-06T01:08:50.531654+0000', 'last_fullsized': '2023-07-06T01:08:50.531654+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-07-06T01:08:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.528599+0000', 'last_change': '2023-07-06T01:08:50.528599+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.528599+0000', 'last_undegraded': '2023-07-06T01:08:50.528599+0000', 'last_fullsized': '2023-07-06T01:08:50.528599+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-07-06T01:08:56.878 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.528790+0000', 'last_change': '2023-07-06T01:08:50.528790+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.528790+0000', 'last_undegraded': '2023-07-06T01:08:50.528790+0000', 'last_fullsized': '2023-07-06T01:08:50.528790+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-07-06T01:08:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521013+0000', 'last_change': '2023-07-06T01:08:50.521013+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521013+0000', 'last_undegraded': '2023-07-06T01:08:50.521013+0000', 'last_fullsized': '2023-07-06T01:08:50.521013+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-07-06T01:08:56.879 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.520467+0000', 'last_change': '2023-07-06T01:08:50.520467+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.520467+0000', 'last_undegraded': '2023-07-06T01:08:50.520467+0000', 'last_fullsized': '2023-07-06T01:08:50.520467+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-07-06T01:08:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.520281+0000', 'last_change': '2023-07-06T01:08:50.520281+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.520281+0000', 'last_undegraded': '2023-07-06T01:08:50.520281+0000', 'last_fullsized': '2023-07-06T01:08:50.520281+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.880 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-07-06T01:08:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.522852+0000', 'last_change': '2023-07-06T01:08:50.522852+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.522852+0000', 'last_undegraded': '2023-07-06T01:08:50.522852+0000', 'last_fullsized': '2023-07-06T01:08:50.522852+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-07-06T01:08:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.522455+0000', 'last_change': '2023-07-06T01:08:50.522455+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.522455+0000', 'last_undegraded': '2023-07-06T01:08:50.522455+0000', 'last_fullsized': '2023-07-06T01:08:50.522455+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T01:08:56.881 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-07-06T01:08:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.528125+0000', 'last_change': '2023-07-06T01:08:50.528125+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.528125+0000', 'last_undegraded': '2023-07-06T01:08:50.528125+0000', 'last_fullsized': '2023-07-06T01:08:50.528125+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-07-06T01:08:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.527627+0000', 'last_change': '2023-07-06T01:08:50.527627+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.527627+0000', 'last_undegraded': '2023-07-06T01:08:50.527627+0000', 'last_fullsized': '2023-07-06T01:08:50.527627+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.882 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-07-06T01:08:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521067+0000', 'last_change': '2023-07-06T01:08:50.521067+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521067+0000', 'last_undegraded': '2023-07-06T01:08:50.521067+0000', 'last_fullsized': '2023-07-06T01:08:50.521067+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T01:08:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-07-06T01:08:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.528795+0000', 'last_change': '2023-07-06T01:08:50.528795+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.528795+0000', 'last_undegraded': '2023-07-06T01:08:50.528795+0000', 'last_fullsized': '2023-07-06T01:08:50.528795+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-07-06T01:08:56.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.530957+0000', 'last_change': '2023-07-06T01:08:50.530957+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.530957+0000', 'last_undegraded': '2023-07-06T01:08:50.530957+0000', 'last_fullsized': '2023-07-06T01:08:50.530957+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.884 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-07-06T01:08:56.884 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.526479+0000', 'last_change': '2023-07-06T01:08:50.526479+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.526479+0000', 'last_undegraded': '2023-07-06T01:08:50.526479+0000', 'last_fullsized': '2023-07-06T01:08:50.526479+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-07-06T01:08:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.526930+0000', 'last_change': '2023-07-06T01:08:50.526930+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.526930+0000', 'last_undegraded': '2023-07-06T01:08:50.526930+0000', 'last_fullsized': '2023-07-06T01:08:50.526930+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-07-06T01:08:56.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.521157+0000', 'last_change': '2023-07-06T01:08:50.521157+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.521157+0000', 'last_undegraded': '2023-07-06T01:08:50.521157+0000', 'last_fullsized': '2023-07-06T01:08:50.521157+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T01:08:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-07-06T01:08:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.526976+0000', 'last_change': '2023-07-06T01:08:50.526976+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.526976+0000', 'last_undegraded': '2023-07-06T01:08:50.526976+0000', 'last_fullsized': '2023-07-06T01:08:50.526976+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-07-06T01:08:56.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.533374+0000', 'last_change': '2023-07-06T01:08:50.533374+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.533374+0000', 'last_undegraded': '2023-07-06T01:08:50.533374+0000', 'last_fullsized': '2023-07-06T01:08:50.533374+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T01:08:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-07-06T01:08:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.524896+0000', 'last_change': '2023-07-06T01:08:50.524896+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.524896+0000', 'last_undegraded': '2023-07-06T01:08:50.524896+0000', 'last_fullsized': '2023-07-06T01:08:50.524896+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T01:08:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-07-06T01:08:56.887 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2023-07-06T01:08:50.522559+0000', 'last_change': '2023-07-06T01:08:50.522559+0000', 'last_active': '2023-07-06T01:08:50.507282+0000', 'last_peered': '2023-07-06T01:08:50.507282+0000', 'last_clean': '2023-07-06T01:08:50.507282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T01:08:50.522559+0000', 'last_undegraded': '2023-07-06T01:08:50.522559+0000', 'last_fullsized': '2023-07-06T01:08:50.522559+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'last_clean_scrub_stamp': '2023-07-06T01:08:50.507282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T01:08:56.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T01:08:57.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.085+0000 7f62761ff700 1 Processor -- start 2023-07-06T01:08:57.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.085+0000 7f62761ff700 1 -- start start 2023-07-06T01:08:57.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f62761ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62700b5c90 0x7f62700d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f62761ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f62761ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62700cf780 con 0x7f627015fca0 2023-07-06T01:08:57.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f62761ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700cd490 con 0x7f62700b5c90 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f62761ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700cd770 con 0x7f62700b6110 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62700b5c90 0x7f62700d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f62700b5c90 0x7f62700d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45240/0 (socket says 172.21.15.71:45240) 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 -- 172.21.15.71:0/546929309 learned_addr learned my addr 172.21.15.71:0/546929309 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f626ffff700 1 --2- 172.21.15.71:0/546929309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 -- 172.21.15.71:0/546929309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 msgr2=0x7f62700d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:08:57.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 --2- 172.21.15.71:0/546929309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 -- 172.21.15.71:0/546929309 >> v1:172.21.15.194:6789/0 conn(0x7f627015fca0 legacy=0x7f62700d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.087+0000 7f6267fff700 1 -- 172.21.15.71:0/546929309 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700cda50 con 0x7f62700b5c90 2023-07-06T01:08:57.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f6267fff700 1 --2- 172.21.15.71:0/546929309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62700b5c90 0x7f62700d2d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62580098f0 tx=0x7f6258009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5fd33830ca0d2d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f626effd700 1 -- 172.21.15.71:0/546929309 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258011830 con 0x7f62700b5c90 2023-07-06T01:08:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f626effd700 1 -- 172.21.15.71:0/546929309 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6258011990 con 0x7f62700b5c90 2023-07-06T01:08:57.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f626effd700 1 -- 172.21.15.71:0/546929309 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258011d20 con 0x7f62700b5c90 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f62761ff700 1 -- 172.21.15.71:0/546929309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62700b5c90 msgr2=0x7f62700d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f62761ff700 1 --2- 172.21.15.71:0/546929309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62700b5c90 0x7f62700d2d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f62580098f0 tx=0x7f6258009c00 comp rx=0 tx=0).stop 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f62761ff700 1 -- 172.21.15.71:0/546929309 shutdown_connections 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f62761ff700 1 --2- 172.21.15.71:0/546929309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f62761ff700 1 --2- 172.21.15.71:0/546929309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62700b5c90 0x7f62700d2d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.088+0000 7f62761ff700 1 -- 172.21.15.71:0/546929309 >> 172.21.15.71:0/546929309 conn(0x7f627006c150 msgr2=0x7f627006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:57.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.089+0000 7f62761ff700 1 -- 172.21.15.71:0/546929309 shutdown_connections 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.089+0000 7f62761ff700 1 -- 172.21.15.71:0/546929309 wait complete. 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.090+0000 7f62761ff700 1 Processor -- start 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.090+0000 7f62761ff700 1 -- start start 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f62761ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62700b5c90 0x7f62700c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f62761ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f62761ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 0x7f62700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f62761ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700cbdc0 con 0x7f627015fca0 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f62761ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c7890 con 0x7f62700b5c90 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f62761ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62700c6ff0 con 0x7f62700b6110 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f626ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 0x7f62700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f626ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 0x7f62700b77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45252/0 (socket says 172.21.15.71:45252) 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.091+0000 7f626ffff700 1 -- 172.21.15.71:0/2552925701 learned_addr learned my addr 172.21.15.71:0/2552925701 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626ffff700 1 -- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 msgr2=0x7f62700cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f6267fff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626f7fe700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62700b5c90 0x7f62700c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626ffff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626ffff700 1 -- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62700b5c90 msgr2=0x7f62700c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626ffff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62700b5c90 0x7f62700c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626ffff700 1 -- 172.21.15.71:0/2552925701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258009550 con 0x7f627015fca0 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626f7fe700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62700b5c90 0x7f62700c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f6267fff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:08:57.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626ffff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 0x7f62700b77a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f626800efc0 tx=0x7f626800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800cce0 con 0x7f627015fca0 2023-07-06T01:08:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626800f040 con 0x7f627015fca0 2023-07-06T01:08:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268014480 con 0x7f627015fca0 2023-07-06T01:08:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62700c72d0 con 0x7f627015fca0 2023-07-06T01:08:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.092+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62701f55c0 con 0x7f627015fca0 2023-07-06T01:08:57.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.093+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62701f5420 con 0x7f627015fca0 2023-07-06T01:08:57.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.094+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62680145e0 con 0x7f627015fca0 2023-07-06T01:08:57.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.096+0000 7f626cff9700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f625006ace0 0x7f625006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.096+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6268089e90 con 0x7f627015fca0 2023-07-06T01:08:57.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.096+0000 7f626f7fe700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f625006ace0 0x7f625006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.097+0000 7f626f7fe700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f625006ace0 0x7f625006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6260000f60 tx=0x7f6260009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:57.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.100+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62701f5420 con 0x7f627015fca0 2023-07-06T01:08:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.374+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f62701f5420 con 0x7f627015fca0 2023-07-06T01:08:57.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.374+0000 7f626cff9700 1 -- 172.21.15.71:0/2552925701 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1095 (secure 0 0 0) 0x7f62701f5420 con 0x7f627015fca0 2023-07-06T01:08:57.376 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:57.376 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":33,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1688605715,"num_in_osds":8,"osd_in_since":1688605707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":57},{"state_name":"creating+peering","count":48}],"num_pgs":105,"num_pools":4,"num_objects":6,"data_bytes":590950,"bytes_used":223690752,"bytes_avail":772870422528,"bytes_total":773094113280,"inactive_pgs_ratio":0.45714285969734192,"write_bytes_sec":192,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4297}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-07-06T01:08:23.599773+0000","services":{}},"progress_events":{}} 2023-07-06T01:08:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f625006ace0 msgr2=0x7f625006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f625006ace0 0x7f625006d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6260000f60 tx=0x7f6260009040 comp rx=0 tx=0).stop 2023-07-06T01:08:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 msgr2=0x7f62700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 0x7f62700b77a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f626800efc0 tx=0x7f626800c3a0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 shutdown_connections 2023-07-06T01:08:57.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f625006ace0 0x7f625006d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f627015fca0 0x7f62700b77a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62700b5c90 0x7f62700c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 --2- 172.21.15.71:0/2552925701 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62700b6110 0x7f62700cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 >> 172.21.15.71:0/2552925701 conn(0x7f627006c150 msgr2=0x7f62700cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.376+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 shutdown_connections 2023-07-06T01:08:57.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.377+0000 7f62761ff700 1 -- 172.21.15.71:0/2552925701 wait complete. 2023-07-06T01:08:57.396 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T01:08:57.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:08:57.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.589+0000 7f256d39d700 1 Processor -- start 2023-07-06T01:08:57.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.589+0000 7f256d39d700 1 -- start start 2023-07-06T01:08:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.590+0000 7f256d39d700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f25680d32a0 0x7f25680b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.590+0000 7f256d39d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680b24c0 con 0x7f256815d3d0 2023-07-06T01:08:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.590+0000 7f256d39d700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680cd250 con 0x7f256815d000 2023-07-06T01:08:57.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.590+0000 7f256d39d700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680cd530 con 0x7f25680d32a0 2023-07-06T01:08:57.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.590+0000 7f25677fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f256815d3d0 0x7f25680d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57638/0 (socket says 172.21.15.71:57638) 2023-07-06T01:08:57.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f25677fe700 1 -- 172.21.15.71:0/260789446 learned_addr learned my addr 172.21.15.71:0/260789446 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:08:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f256cb9c700 1 --2- 172.21.15.71:0/260789446 >> v2:172.21.15.194:3300/0 conn(0x7f25680d32a0 0x7f25680b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020245597 0 0) 0x7f255c001110 con 0x7f256815d3d0 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25500035b0 con 0x7f256815d3d0 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553487667 0 0) 0x7f25680cd250 con 0x7f256815d000 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f255c001110 con 0x7f256815d000 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f256cb9c700 1 -- 172.21.15.71:0/260789446 >> v1:172.21.15.194:6789/0 conn(0x7f256815d000 legacy=0x7f25680cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068208568 0 0) 0x7f25500035b0 con 0x7f256815d3d0 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f256cb9c700 1 -- 172.21.15.71:0/260789446 >> v1:172.21.15.71:6789/0 conn(0x7f256815d3d0 legacy=0x7f25680d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.591+0000 7f256cb9c700 1 -- 172.21.15.71:0/260789446 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680cd810 con 0x7f25680d32a0 2023-07-06T01:08:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256cb9c700 1 --2- 172.21.15.71:0/260789446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680d32a0 0x7f25680b1f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2560009d90 tx=0x7f256000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ace99a7586f39d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e070 con 0x7f25680d32a0 2023-07-06T01:08:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560003a20 con 0x7f25680d32a0 2023-07-06T01:08:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f2566ffd700 1 -- 172.21.15.71:0/260789446 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c001800 con 0x7f25680d32a0 2023-07-06T01:08:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 -- 172.21.15.71:0/260789446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680d32a0 msgr2=0x7f25680b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 --2- 172.21.15.71:0/260789446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680d32a0 0x7f25680b1f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2560009d90 tx=0x7f256000b330 comp rx=0 tx=0).stop 2023-07-06T01:08:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 -- 172.21.15.71:0/260789446 shutdown_connections 2023-07-06T01:08:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 --2- 172.21.15.71:0/260789446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680d32a0 0x7f25680b1f80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 -- 172.21.15.71:0/260789446 >> 172.21.15.71:0/260789446 conn(0x7f256806a4e0 msgr2=0x7f256806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 -- 172.21.15.71:0/260789446 shutdown_connections 2023-07-06T01:08:57.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.592+0000 7f256d39d700 1 -- 172.21.15.71:0/260789446 wait complete. 2023-07-06T01:08:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.594+0000 7f256d39d700 1 Processor -- start 2023-07-06T01:08:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.594+0000 7f256d39d700 1 -- start start 2023-07-06T01:08:57.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f256d39d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25680d32a0 0x7f2568155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f256d39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 0x7f256815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f256d39d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256815d3d0 0x7f25681600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f256d39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680cce40 con 0x7f256815d000 2023-07-06T01:08:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f256d39d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568156370 con 0x7f256815d3d0 2023-07-06T01:08:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f256d39d700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25681e8810 con 0x7f25680d32a0 2023-07-06T01:08:57.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f25677fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 0x7f256815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f25677fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 0x7f256815fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45268/0 (socket says 172.21.15.71:45268) 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.595+0000 7f25677fe700 1 -- 172.21.15.71:0/4244408893 learned_addr learned my addr 172.21.15.71:0/4244408893 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f256cb9c700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256815d3d0 0x7f25681600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f2567fff700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25680d32a0 0x7f2568155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f25677fe700 1 -- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25680d32a0 msgr2=0x7f2568155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f25677fe700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25680d32a0 0x7f2568155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f25677fe700 1 -- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256815d3d0 msgr2=0x7f25681600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f25677fe700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256815d3d0 0x7f25681600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f25677fe700 1 -- 172.21.15.71:0/4244408893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009a70 con 0x7f256815d000 2023-07-06T01:08:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f25677fe700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 0x7f256815fb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f255c00cad0 tx=0x7f255c00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c004a80 con 0x7f256815d000 2023-07-06T01:08:57.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c004c00 con 0x7f256815d000 2023-07-06T01:08:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25681f5180 con 0x7f256815d000 2023-07-06T01:08:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.596+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0070d0 con 0x7f256815d000 2023-07-06T01:08:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.597+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681f5740 con 0x7f256815d000 2023-07-06T01:08:57.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.597+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25681f5960 con 0x7f256815d000 2023-07-06T01:08:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.598+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f255c007230 con 0x7f256815d000 2023-07-06T01:08:57.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.599+0000 7f2564ff9700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f255406ace0 0x7f255406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:08:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.599+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f255c0885d0 con 0x7f256815d000 2023-07-06T01:08:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.599+0000 7f2567fff700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f255406ace0 0x7f255406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:08:57.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.600+0000 7f2567fff700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f255406ace0 0x7f255406d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25580011e0 tx=0x7f2558009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:08:57.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.603+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f255c053670 con 0x7f256815d000 2023-07-06T01:08:57.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.796+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25681f5000 con 0x7f255406ace0 2023-07-06T01:08:57.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.805+0000 7f2564ff9700 1 -- 172.21.15.71:0/4244408893 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286686 (secure 0 0 0) 0x7f25580050d0 con 0x7f255406ace0 2023-07-06T01:08:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:08:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f255406ace0 msgr2=0x7f255406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f255406ace0 0x7f255406d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25580011e0 tx=0x7f2558009040 comp rx=0 tx=0).stop 2023-07-06T01:08:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 msgr2=0x7f256815fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:08:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 0x7f256815fb90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f255c00cad0 tx=0x7f255c00ce90 comp rx=0 tx=0).stop 2023-07-06T01:08:57.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 shutdown_connections 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f255406ace0 0x7f255406d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256815d3d0 0x7f25681600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25680d32a0 0x7f2568155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 --2- 172.21.15.71:0/4244408893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f256815d000 0x7f256815fb90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 >> 172.21.15.71:0/4244408893 conn(0x7f256806a4e0 msgr2=0x7f25680d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 shutdown_connections 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:08:57.809+0000 7f256d39d700 1 -- 172.21.15.71:0/4244408893 wait complete. 2023-07-06T01:08:57.813 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:08:57.828 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-06T01:08:56.831079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218668,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756052,"statfs":{"total":773094113280,"available":772870197248,"internally_reserved":0,"allocated":3125248,"data_stored":1873456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.316995"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083933+0000","last_change":"2023-07-06T01:08:51.546507+0000","last_active":"2023-07-06T01:08:53.083933+0000","last_peered":"2023-07-06T01:08:53.083933+0000","last_clean":"2023-07-06T01:08:53.083933+0000","last_became_active":"2023-07-06T01:08:51.546121+0000","last_became_peered":"2023-07-06T01:08:51.546121+0000","last_unstale":"2023-07-06T01:08:53.083933+0000","last_undegraded":"2023-07-06T01:08:53.083933+0000","last_fullsized":"2023-07-06T01:08:53.083933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:26.336987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561492+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:51.561492+0000","last_peered":"2023-07-06T01:08:51.561492+0000","last_clean":"2023-07-06T01:08:51.561492+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:51.561492+0000","last_undegraded":"2023-07-06T01:08:51.561492+0000","last_fullsized":"2023-07-06T01:08:51.561492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085333+0000","last_change":"2023-07-06T01:08:51.566075+0000","last_active":"2023-07-06T01:08:53.085333+0000","last_peered":"2023-07-06T01:08:53.085333+0000","last_clean":"2023-07-06T01:08:53.085333+0000","last_became_active":"2023-07-06T01:08:51.565537+0000","last_became_peered":"2023-07-06T01:08:51.565537+0000","last_unstale":"2023-07-06T01:08:53.085333+0000","last_undegraded":"2023-07-06T01:08:53.085333+0000","last_fullsized":"2023-07-06T01:08:53.085333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085007+0000","last_change":"2023-07-06T01:08:51.544319+0000","last_active":"2023-07-06T01:08:53.085007+0000","last_peered":"2023-07-06T01:08:53.085007+0000","last_clean":"2023-07-06T01:08:53.085007+0000","last_became_active":"2023-07-06T01:08:51.544030+0000","last_became_peered":"2023-07-06T01:08:51.544030+0000","last_unstale":"2023-07-06T01:08:53.085007+0000","last_undegraded":"2023-07-06T01:08:53.085007+0000","last_fullsized":"2023-07-06T01:08:53.085007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.551114+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:51.551114+0000","last_peered":"2023-07-06T01:08:51.551114+0000","last_clean":"2023-07-06T01:08:51.551114+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:51.551114+0000","last_undegraded":"2023-07-06T01:08:51.551114+0000","last_fullsized":"2023-07-06T01:08:51.551114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086081+0000","last_change":"2023-07-06T01:08:51.562443+0000","last_active":"2023-07-06T01:08:53.086081+0000","last_peered":"2023-07-06T01:08:53.086081+0000","last_clean":"2023-07-06T01:08:53.086081+0000","last_became_active":"2023-07-06T01:08:51.561788+0000","last_became_peered":"2023-07-06T01:08:51.561788+0000","last_unstale":"2023-07-06T01:08:53.086081+0000","last_undegraded":"2023-07-06T01:08:53.086081+0000","last_fullsized":"2023-07-06T01:08:53.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086840+0000","last_change":"2023-07-06T01:08:51.548054+0000","last_active":"2023-07-06T01:08:53.086840+0000","last_peered":"2023-07-06T01:08:53.086840+0000","last_clean":"2023-07-06T01:08:53.086840+0000","last_became_active":"2023-07-06T01:08:51.547567+0000","last_became_peered":"2023-07-06T01:08:51.547567+0000","last_unstale":"2023-07-06T01:08:53.086840+0000","last_undegraded":"2023-07-06T01:08:53.086840+0000","last_fullsized":"2023-07-06T01:08:53.086840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.567746+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:51.567746+0000","last_peered":"2023-07-06T01:08:51.567746+0000","last_clean":"2023-07-06T01:08:51.567746+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:51.567746+0000","last_undegraded":"2023-07-06T01:08:51.567746+0000","last_fullsized":"2023-07-06T01:08:51.567746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550779+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:51.550779+0000","last_peered":"2023-07-06T01:08:51.550779+0000","last_clean":"2023-07-06T01:08:51.550779+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:51.550779+0000","last_undegraded":"2023-07-06T01:08:51.550779+0000","last_fullsized":"2023-07-06T01:08:51.550779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:21.687284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561474+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:51.561474+0000","last_peered":"2023-07-06T01:08:51.561474+0000","last_clean":"2023-07-06T01:08:51.561474+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:51.561474+0000","last_undegraded":"2023-07-06T01:08:51.561474+0000","last_fullsized":"2023-07-06T01:08:51.561474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085511+0000","last_change":"2023-07-06T01:08:51.565857+0000","last_active":"2023-07-06T01:08:53.085511+0000","last_peered":"2023-07-06T01:08:53.085511+0000","last_clean":"2023-07-06T01:08:53.085511+0000","last_became_active":"2023-07-06T01:08:51.565237+0000","last_became_peered":"2023-07-06T01:08:51.565237+0000","last_unstale":"2023-07-06T01:08:53.085511+0000","last_undegraded":"2023-07-06T01:08:53.085511+0000","last_fullsized":"2023-07-06T01:08:53.085511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083889+0000","last_change":"2023-07-06T01:08:51.565593+0000","last_active":"2023-07-06T01:08:53.083889+0000","last_peered":"2023-07-06T01:08:53.083889+0000","last_clean":"2023-07-06T01:08:53.083889+0000","last_became_active":"2023-07-06T01:08:51.565334+0000","last_became_peered":"2023-07-06T01:08:51.565334+0000","last_unstale":"2023-07-06T01:08:53.083889+0000","last_undegraded":"2023-07-06T01:08:53.083889+0000","last_fullsized":"2023-07-06T01:08:53.083889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:48.859326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083791+0000","last_change":"2023-07-06T01:08:51.545491+0000","last_active":"2023-07-06T01:08:53.083791+0000","last_peered":"2023-07-06T01:08:53.083791+0000","last_clean":"2023-07-06T01:08:53.083791+0000","last_became_active":"2023-07-06T01:08:51.545185+0000","last_became_peered":"2023-07-06T01:08:51.545185+0000","last_unstale":"2023-07-06T01:08:53.083791+0000","last_undegraded":"2023-07-06T01:08:53.083791+0000","last_fullsized":"2023-07-06T01:08:53.083791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561576+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:51.561576+0000","last_peered":"2023-07-06T01:08:51.561576+0000","last_clean":"2023-07-06T01:08:51.561576+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:51.561576+0000","last_undegraded":"2023-07-06T01:08:51.561576+0000","last_fullsized":"2023-07-06T01:08:51.561576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086970+0000","last_change":"2023-07-06T01:08:51.547864+0000","last_active":"2023-07-06T01:08:53.086970+0000","last_peered":"2023-07-06T01:08:53.086970+0000","last_clean":"2023-07-06T01:08:53.086970+0000","last_became_active":"2023-07-06T01:08:51.547170+0000","last_became_peered":"2023-07-06T01:08:51.547170+0000","last_unstale":"2023-07-06T01:08:53.086970+0000","last_undegraded":"2023-07-06T01:08:53.086970+0000","last_fullsized":"2023-07-06T01:08:53.086970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085158+0000","last_change":"2023-07-06T01:08:51.562917+0000","last_active":"2023-07-06T01:08:53.085158+0000","last_peered":"2023-07-06T01:08:53.085158+0000","last_clean":"2023-07-06T01:08:53.085158+0000","last_became_active":"2023-07-06T01:08:51.562635+0000","last_became_peered":"2023-07-06T01:08:51.562635+0000","last_unstale":"2023-07-06T01:08:53.085158+0000","last_undegraded":"2023-07-06T01:08:53.085158+0000","last_fullsized":"2023-07-06T01:08:53.085158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557675+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:51.557675+0000","last_peered":"2023-07-06T01:08:51.557675+0000","last_clean":"2023-07-06T01:08:51.557675+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:51.557675+0000","last_undegraded":"2023-07-06T01:08:51.557675+0000","last_fullsized":"2023-07-06T01:08:51.557675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085257+0000","last_change":"2023-07-06T01:08:51.562248+0000","last_active":"2023-07-06T01:08:53.085257+0000","last_peered":"2023-07-06T01:08:53.085257+0000","last_clean":"2023-07-06T01:08:53.085257+0000","last_became_active":"2023-07-06T01:08:51.561945+0000","last_became_peered":"2023-07-06T01:08:51.561945+0000","last_unstale":"2023-07-06T01:08:53.085257+0000","last_undegraded":"2023-07-06T01:08:53.085257+0000","last_fullsized":"2023-07-06T01:08:53.085257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083937+0000","last_change":"2023-07-06T01:08:51.552763+0000","last_active":"2023-07-06T01:08:53.083937+0000","last_peered":"2023-07-06T01:08:53.083937+0000","last_clean":"2023-07-06T01:08:53.083937+0000","last_became_active":"2023-07-06T01:08:51.552507+0000","last_became_peered":"2023-07-06T01:08:51.552507+0000","last_unstale":"2023-07-06T01:08:53.083937+0000","last_undegraded":"2023-07-06T01:08:53.083937+0000","last_fullsized":"2023-07-06T01:08:53.083937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085562+0000","last_change":"2023-07-06T01:08:51.564791+0000","last_active":"2023-07-06T01:08:53.085562+0000","last_peered":"2023-07-06T01:08:53.085562+0000","last_clean":"2023-07-06T01:08:53.085562+0000","last_became_active":"2023-07-06T01:08:51.564227+0000","last_became_peered":"2023-07-06T01:08:51.564227+0000","last_unstale":"2023-07-06T01:08:53.085562+0000","last_undegraded":"2023-07-06T01:08:53.085562+0000","last_fullsized":"2023-07-06T01:08:53.085562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087254+0000","last_change":"2023-07-06T01:08:51.548812+0000","last_active":"2023-07-06T01:08:53.087254+0000","last_peered":"2023-07-06T01:08:53.087254+0000","last_clean":"2023-07-06T01:08:53.087254+0000","last_became_active":"2023-07-06T01:08:51.548481+0000","last_became_peered":"2023-07-06T01:08:51.548481+0000","last_unstale":"2023-07-06T01:08:53.087254+0000","last_undegraded":"2023-07-06T01:08:53.087254+0000","last_fullsized":"2023-07-06T01:08:53.087254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557593+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:51.557593+0000","last_peered":"2023-07-06T01:08:51.557593+0000","last_clean":"2023-07-06T01:08:51.557593+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:51.557593+0000","last_undegraded":"2023-07-06T01:08:51.557593+0000","last_fullsized":"2023-07-06T01:08:51.557593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:18.665192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552229+0000","last_change":"2023-07-06T01:08:51.545243+0000","last_active":"2023-07-06T01:08:52.552229+0000","last_peered":"2023-07-06T01:08:52.552229+0000","last_clean":"2023-07-06T01:08:52.552229+0000","last_became_active":"2023-07-06T01:08:51.544960+0000","last_became_peered":"2023-07-06T01:08:51.544960+0000","last_unstale":"2023-07-06T01:08:52.552229+0000","last_undegraded":"2023-07-06T01:08:52.552229+0000","last_fullsized":"2023-07-06T01:08:52.552229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086966+0000","last_change":"2023-07-06T01:08:51.546755+0000","last_active":"2023-07-06T01:08:53.086966+0000","last_peered":"2023-07-06T01:08:53.086966+0000","last_clean":"2023-07-06T01:08:53.086966+0000","last_became_active":"2023-07-06T01:08:51.546419+0000","last_became_peered":"2023-07-06T01:08:51.546419+0000","last_unstale":"2023-07-06T01:08:53.086966+0000","last_undegraded":"2023-07-06T01:08:53.086966+0000","last_fullsized":"2023-07-06T01:08:53.086966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:54.356882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084592+0000","last_change":"2023-07-06T01:08:51.552436+0000","last_active":"2023-07-06T01:08:53.084592+0000","last_peered":"2023-07-06T01:08:53.084592+0000","last_clean":"2023-07-06T01:08:53.084592+0000","last_became_active":"2023-07-06T01:08:51.552191+0000","last_became_peered":"2023-07-06T01:08:51.552191+0000","last_unstale":"2023-07-06T01:08:53.084592+0000","last_undegraded":"2023-07-06T01:08:53.084592+0000","last_fullsized":"2023-07-06T01:08:53.084592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084557+0000","last_change":"2023-07-06T01:08:51.545034+0000","last_active":"2023-07-06T01:08:53.084557+0000","last_peered":"2023-07-06T01:08:53.084557+0000","last_clean":"2023-07-06T01:08:53.084557+0000","last_became_active":"2023-07-06T01:08:51.544709+0000","last_became_peered":"2023-07-06T01:08:51.544709+0000","last_unstale":"2023-07-06T01:08:53.084557+0000","last_undegraded":"2023-07-06T01:08:53.084557+0000","last_fullsized":"2023-07-06T01:08:53.084557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561550+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:51.561550+0000","last_peered":"2023-07-06T01:08:51.561550+0000","last_clean":"2023-07-06T01:08:51.561550+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:51.561550+0000","last_undegraded":"2023-07-06T01:08:51.561550+0000","last_fullsized":"2023-07-06T01:08:51.561550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086323+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:53.086323+0000","last_peered":"2023-07-06T01:08:53.086323+0000","last_clean":"2023-07-06T01:08:53.086323+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:53.086323+0000","last_undegraded":"2023-07-06T01:08:53.086323+0000","last_fullsized":"2023-07-06T01:08:53.086323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:17.319280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.553004+0000","last_change":"2023-07-06T01:08:51.547294+0000","last_active":"2023-07-06T01:08:52.553004+0000","last_peered":"2023-07-06T01:08:52.553004+0000","last_clean":"2023-07-06T01:08:52.553004+0000","last_became_active":"2023-07-06T01:08:51.547030+0000","last_became_peered":"2023-07-06T01:08:51.547030+0000","last_unstale":"2023-07-06T01:08:52.553004+0000","last_undegraded":"2023-07-06T01:08:52.553004+0000","last_fullsized":"2023-07-06T01:08:52.553004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084281+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:53.084281+0000","last_peered":"2023-07-06T01:08:53.084281+0000","last_clean":"2023-07-06T01:08:53.084281+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:53.084281+0000","last_undegraded":"2023-07-06T01:08:53.084281+0000","last_fullsized":"2023-07-06T01:08:53.084281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:36.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550435+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:51.550435+0000","last_peered":"2023-07-06T01:08:51.550435+0000","last_clean":"2023-07-06T01:08:51.550435+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:51.550435+0000","last_undegraded":"2023-07-06T01:08:51.550435+0000","last_fullsized":"2023-07-06T01:08:51.550435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:33.241903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552092+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:52.552092+0000","last_peered":"2023-07-06T01:08:52.552092+0000","last_clean":"2023-07-06T01:08:52.552092+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:52.552092+0000","last_undegraded":"2023-07-06T01:08:52.552092+0000","last_fullsized":"2023-07-06T01:08:52.552092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085320+0000","last_change":"2023-07-06T01:08:51.557675+0000","last_active":"2023-07-06T01:08:53.085320+0000","last_peered":"2023-07-06T01:08:53.085320+0000","last_clean":"2023-07-06T01:08:53.085320+0000","last_became_active":"2023-07-06T01:08:51.557340+0000","last_became_peered":"2023-07-06T01:08:51.557340+0000","last_unstale":"2023-07-06T01:08:53.085320+0000","last_undegraded":"2023-07-06T01:08:53.085320+0000","last_fullsized":"2023-07-06T01:08:53.085320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:02.855361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529840+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:51.529840+0000","last_peered":"2023-07-06T01:08:51.529840+0000","last_clean":"2023-07-06T01:08:51.529840+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:51.529840+0000","last_undegraded":"2023-07-06T01:08:51.529840+0000","last_fullsized":"2023-07-06T01:08:51.529840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552061+0000","last_change":"2023-07-06T01:08:51.549974+0000","last_active":"2023-07-06T01:08:52.552061+0000","last_peered":"2023-07-06T01:08:52.552061+0000","last_clean":"2023-07-06T01:08:52.552061+0000","last_became_active":"2023-07-06T01:08:51.549708+0000","last_became_peered":"2023-07-06T01:08:51.549708+0000","last_unstale":"2023-07-06T01:08:52.552061+0000","last_undegraded":"2023-07-06T01:08:52.552061+0000","last_fullsized":"2023-07-06T01:08:52.552061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.535933+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:51.535933+0000","last_peered":"2023-07-06T01:08:51.535933+0000","last_clean":"2023-07-06T01:08:51.535933+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:51.535933+0000","last_undegraded":"2023-07-06T01:08:51.535933+0000","last_fullsized":"2023-07-06T01:08:51.535933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:14.557999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552097+0000","last_change":"2023-07-06T01:08:51.552404+0000","last_active":"2023-07-06T01:08:52.552097+0000","last_peered":"2023-07-06T01:08:52.552097+0000","last_clean":"2023-07-06T01:08:52.552097+0000","last_became_active":"2023-07-06T01:08:51.551398+0000","last_became_peered":"2023-07-06T01:08:51.551398+0000","last_unstale":"2023-07-06T01:08:52.552097+0000","last_undegraded":"2023-07-06T01:08:52.552097+0000","last_fullsized":"2023-07-06T01:08:52.552097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087253+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:53.087253+0000","last_peered":"2023-07-06T01:08:53.087253+0000","last_clean":"2023-07-06T01:08:53.087253+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:53.087253+0000","last_undegraded":"2023-07-06T01:08:53.087253+0000","last_fullsized":"2023-07-06T01:08:53.087253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:18.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084462+0000","last_change":"2023-07-06T01:08:51.553928+0000","last_active":"2023-07-06T01:08:53.084462+0000","last_peered":"2023-07-06T01:08:53.084462+0000","last_clean":"2023-07-06T01:08:53.084462+0000","last_became_active":"2023-07-06T01:08:51.553607+0000","last_became_peered":"2023-07-06T01:08:51.553607+0000","last_unstale":"2023-07-06T01:08:53.084462+0000","last_undegraded":"2023-07-06T01:08:53.084462+0000","last_fullsized":"2023-07-06T01:08:53.084462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085895+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:53.085895+0000","last_peered":"2023-07-06T01:08:53.085895+0000","last_clean":"2023-07-06T01:08:53.085895+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:53.085895+0000","last_undegraded":"2023-07-06T01:08:53.085895+0000","last_fullsized":"2023-07-06T01:08:53.085895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086082+0000","last_change":"2023-07-06T01:08:51.564390+0000","last_active":"2023-07-06T01:08:53.086082+0000","last_peered":"2023-07-06T01:08:53.086082+0000","last_clean":"2023-07-06T01:08:53.086082+0000","last_became_active":"2023-07-06T01:08:51.563606+0000","last_became_peered":"2023-07-06T01:08:51.563606+0000","last_unstale":"2023-07-06T01:08:53.086082+0000","last_undegraded":"2023-07-06T01:08:53.086082+0000","last_fullsized":"2023-07-06T01:08:53.086082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:01.040810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086960+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:53.086960+0000","last_peered":"2023-07-06T01:08:53.086960+0000","last_clean":"2023-07-06T01:08:53.086960+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:53.086960+0000","last_undegraded":"2023-07-06T01:08:53.086960+0000","last_fullsized":"2023-07-06T01:08:53.086960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552404+0000","last_change":"2023-07-06T01:08:51.548167+0000","last_active":"2023-07-06T01:08:52.552404+0000","last_peered":"2023-07-06T01:08:52.552404+0000","last_clean":"2023-07-06T01:08:52.552404+0000","last_became_active":"2023-07-06T01:08:51.547839+0000","last_became_peered":"2023-07-06T01:08:51.547839+0000","last_unstale":"2023-07-06T01:08:52.552404+0000","last_undegraded":"2023-07-06T01:08:52.552404+0000","last_fullsized":"2023-07-06T01:08:52.552404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528681+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:51.528681+0000","last_peered":"2023-07-06T01:08:51.528681+0000","last_clean":"2023-07-06T01:08:51.528681+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:51.528681+0000","last_undegraded":"2023-07-06T01:08:51.528681+0000","last_fullsized":"2023-07-06T01:08:51.528681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:38:44.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561532+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:51.561532+0000","last_peered":"2023-07-06T01:08:51.561532+0000","last_clean":"2023-07-06T01:08:51.561532+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:51.561532+0000","last_undegraded":"2023-07-06T01:08:51.561532+0000","last_fullsized":"2023-07-06T01:08:51.561532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086809+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:53.086809+0000","last_peered":"2023-07-06T01:08:53.086809+0000","last_clean":"2023-07-06T01:08:53.086809+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:53.086809+0000","last_undegraded":"2023-07-06T01:08:53.086809+0000","last_fullsized":"2023-07-06T01:08:53.086809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.550797+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:51.550797+0000","last_peered":"2023-07-06T01:08:51.550797+0000","last_clean":"2023-07-06T01:08:51.550797+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:51.550797+0000","last_undegraded":"2023-07-06T01:08:51.550797+0000","last_fullsized":"2023-07-06T01:08:51.550797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:00:49.267223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084513+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:53.084513+0000","last_peered":"2023-07-06T01:08:53.084513+0000","last_clean":"2023-07-06T01:08:53.084513+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:53.084513+0000","last_undegraded":"2023-07-06T01:08:53.084513+0000","last_fullsized":"2023-07-06T01:08:53.084513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552880+0000","last_change":"2023-07-06T01:08:51.549714+0000","last_active":"2023-07-06T01:08:52.552880+0000","last_peered":"2023-07-06T01:08:52.552880+0000","last_clean":"2023-07-06T01:08:52.552880+0000","last_became_active":"2023-07-06T01:08:51.549235+0000","last_became_peered":"2023-07-06T01:08:51.549235+0000","last_unstale":"2023-07-06T01:08:52.552880+0000","last_undegraded":"2023-07-06T01:08:52.552880+0000","last_fullsized":"2023-07-06T01:08:52.552880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087586+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:53.087586+0000","last_peered":"2023-07-06T01:08:53.087586+0000","last_clean":"2023-07-06T01:08:53.087586+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:53.087586+0000","last_undegraded":"2023-07-06T01:08:53.087586+0000","last_fullsized":"2023-07-06T01:08:53.087586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:16.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.561444+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:51.561444+0000","last_peered":"2023-07-06T01:08:51.561444+0000","last_clean":"2023-07-06T01:08:51.561444+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:51.561444+0000","last_undegraded":"2023-07-06T01:08:51.561444+0000","last_fullsized":"2023-07-06T01:08:51.561444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087122+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:53.087122+0000","last_peered":"2023-07-06T01:08:53.087122+0000","last_clean":"2023-07-06T01:08:53.087122+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:53.087122+0000","last_undegraded":"2023-07-06T01:08:53.087122+0000","last_fullsized":"2023-07-06T01:08:53.087122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085626+0000","last_change":"2023-07-06T01:08:51.562553+0000","last_active":"2023-07-06T01:08:53.085626+0000","last_peered":"2023-07-06T01:08:53.085626+0000","last_clean":"2023-07-06T01:08:53.085626+0000","last_became_active":"2023-07-06T01:08:51.562093+0000","last_became_peered":"2023-07-06T01:08:51.562093+0000","last_unstale":"2023-07-06T01:08:53.085626+0000","last_undegraded":"2023-07-06T01:08:53.085626+0000","last_fullsized":"2023-07-06T01:08:53.085626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087474+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:53.087474+0000","last_peered":"2023-07-06T01:08:53.087474+0000","last_clean":"2023-07-06T01:08:53.087474+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:53.087474+0000","last_undegraded":"2023-07-06T01:08:53.087474+0000","last_fullsized":"2023-07-06T01:08:53.087474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:29.179839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085394+0000","last_change":"2023-07-06T01:08:51.547190+0000","last_active":"2023-07-06T01:08:53.085394+0000","last_peered":"2023-07-06T01:08:53.085394+0000","last_clean":"2023-07-06T01:08:53.085394+0000","last_became_active":"2023-07-06T01:08:51.546880+0000","last_became_peered":"2023-07-06T01:08:51.546880+0000","last_unstale":"2023-07-06T01:08:53.085394+0000","last_undegraded":"2023-07-06T01:08:53.085394+0000","last_fullsized":"2023-07-06T01:08:53.085394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531958+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:51.531958+0000","last_peered":"2023-07-06T01:08:51.531958+0000","last_clean":"2023-07-06T01:08:51.531958+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:51.531958+0000","last_undegraded":"2023-07-06T01:08:51.531958+0000","last_fullsized":"2023-07-06T01:08:51.531958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.549593+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:51.549593+0000","last_peered":"2023-07-06T01:08:51.549593+0000","last_clean":"2023-07-06T01:08:51.549593+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:51.549593+0000","last_undegraded":"2023-07-06T01:08:51.549593+0000","last_fullsized":"2023-07-06T01:08:51.549593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552785+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:52.552785+0000","last_peered":"2023-07-06T01:08:52.552785+0000","last_clean":"2023-07-06T01:08:52.552785+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:52.552785+0000","last_undegraded":"2023-07-06T01:08:52.552785+0000","last_fullsized":"2023-07-06T01:08:52.552785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085734+0000","last_change":"2023-07-06T01:08:51.564576+0000","last_active":"2023-07-06T01:08:53.085734+0000","last_peered":"2023-07-06T01:08:53.085734+0000","last_clean":"2023-07-06T01:08:53.085734+0000","last_became_active":"2023-07-06T01:08:51.563750+0000","last_became_peered":"2023-07-06T01:08:51.563750+0000","last_unstale":"2023-07-06T01:08:53.085734+0000","last_undegraded":"2023-07-06T01:08:53.085734+0000","last_fullsized":"2023-07-06T01:08:53.085734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085219+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:53.085219+0000","last_peered":"2023-07-06T01:08:53.085219+0000","last_clean":"2023-07-06T01:08:53.085219+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:53.085219+0000","last_undegraded":"2023-07-06T01:08:53.085219+0000","last_fullsized":"2023-07-06T01:08:53.085219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085774+0000","last_change":"2023-07-06T01:08:51.565749+0000","last_active":"2023-07-06T01:08:53.085774+0000","last_peered":"2023-07-06T01:08:53.085774+0000","last_clean":"2023-07-06T01:08:53.085774+0000","last_became_active":"2023-07-06T01:08:51.564882+0000","last_became_peered":"2023-07-06T01:08:51.564882+0000","last_unstale":"2023-07-06T01:08:53.085774+0000","last_undegraded":"2023-07-06T01:08:53.085774+0000","last_fullsized":"2023-07-06T01:08:53.085774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086013+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:53.086013+0000","last_peered":"2023-07-06T01:08:53.086013+0000","last_clean":"2023-07-06T01:08:53.086013+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:53.086013+0000","last_undegraded":"2023-07-06T01:08:53.086013+0000","last_fullsized":"2023-07-06T01:08:53.086013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085438+0000","last_change":"2023-07-06T01:08:51.557074+0000","last_active":"2023-07-06T01:08:53.085438+0000","last_peered":"2023-07-06T01:08:53.085438+0000","last_clean":"2023-07-06T01:08:53.085438+0000","last_became_active":"2023-07-06T01:08:51.556801+0000","last_became_peered":"2023-07-06T01:08:51.556801+0000","last_unstale":"2023-07-06T01:08:53.085438+0000","last_undegraded":"2023-07-06T01:08:53.085438+0000","last_fullsized":"2023-07-06T01:08:53.085438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551959+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:52.551959+0000","last_peered":"2023-07-06T01:08:52.551959+0000","last_clean":"2023-07-06T01:08:52.551959+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:52.551959+0000","last_undegraded":"2023-07-06T01:08:52.551959+0000","last_fullsized":"2023-07-06T01:08:52.551959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:44.334492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084747+0000","last_change":"2023-07-06T01:08:51.553184+0000","last_active":"2023-07-06T01:08:53.084747+0000","last_peered":"2023-07-06T01:08:53.084747+0000","last_clean":"2023-07-06T01:08:53.084747+0000","last_became_active":"2023-07-06T01:08:51.552931+0000","last_became_peered":"2023-07-06T01:08:51.552931+0000","last_unstale":"2023-07-06T01:08:53.084747+0000","last_undegraded":"2023-07-06T01:08:53.084747+0000","last_fullsized":"2023-07-06T01:08:53.084747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084322+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:53.084322+0000","last_peered":"2023-07-06T01:08:53.084322+0000","last_clean":"2023-07-06T01:08:53.084322+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:53.084322+0000","last_undegraded":"2023-07-06T01:08:53.084322+0000","last_fullsized":"2023-07-06T01:08:53.084322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:19.832781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.534381+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:51.534381+0000","last_peered":"2023-07-06T01:08:51.534381+0000","last_clean":"2023-07-06T01:08:51.534381+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:51.534381+0000","last_undegraded":"2023-07-06T01:08:51.534381+0000","last_fullsized":"2023-07-06T01:08:51.534381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:01.848614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084364+0000","last_change":"2023-07-06T01:08:51.557906+0000","last_active":"2023-07-06T01:08:53.084364+0000","last_peered":"2023-07-06T01:08:53.084364+0000","last_clean":"2023-07-06T01:08:53.084364+0000","last_became_active":"2023-07-06T01:08:51.557620+0000","last_became_peered":"2023-07-06T01:08:51.557620+0000","last_unstale":"2023-07-06T01:08:53.084364+0000","last_undegraded":"2023-07-06T01:08:53.084364+0000","last_fullsized":"2023-07-06T01:08:53.084364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.536319+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:51.536319+0000","last_peered":"2023-07-06T01:08:51.536319+0000","last_clean":"2023-07-06T01:08:51.536319+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:51.536319+0000","last_undegraded":"2023-07-06T01:08:51.536319+0000","last_fullsized":"2023-07-06T01:08:51.536319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:30.752260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086255+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:53.086255+0000","last_peered":"2023-07-06T01:08:53.086255+0000","last_clean":"2023-07-06T01:08:53.086255+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:53.086255+0000","last_undegraded":"2023-07-06T01:08:53.086255+0000","last_fullsized":"2023-07-06T01:08:53.086255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:53.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084397+0000","last_change":"2023-07-06T01:08:51.546136+0000","last_active":"2023-07-06T01:08:53.084397+0000","last_peered":"2023-07-06T01:08:53.084397+0000","last_clean":"2023-07-06T01:08:53.084397+0000","last_became_active":"2023-07-06T01:08:51.545893+0000","last_became_peered":"2023-07-06T01:08:51.545893+0000","last_unstale":"2023-07-06T01:08:53.084397+0000","last_undegraded":"2023-07-06T01:08:53.084397+0000","last_fullsized":"2023-07-06T01:08:53.084397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083722+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:53.083722+0000","last_peered":"2023-07-06T01:08:53.083722+0000","last_clean":"2023-07-06T01:08:53.083722+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:53.083722+0000","last_undegraded":"2023-07-06T01:08:53.083722+0000","last_fullsized":"2023-07-06T01:08:53.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:26.895276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084090+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:53.084090+0000","last_peered":"2023-07-06T01:08:53.084090+0000","last_clean":"2023-07-06T01:08:53.084090+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:53.084090+0000","last_undegraded":"2023-07-06T01:08:53.084090+0000","last_fullsized":"2023-07-06T01:08:53.084090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:12.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084599+0000","last_change":"2023-07-06T01:08:51.559769+0000","last_active":"2023-07-06T01:08:53.084599+0000","last_peered":"2023-07-06T01:08:53.084599+0000","last_clean":"2023-07-06T01:08:53.084599+0000","last_became_active":"2023-07-06T01:08:51.559480+0000","last_became_peered":"2023-07-06T01:08:51.559480+0000","last_unstale":"2023-07-06T01:08:53.084599+0000","last_undegraded":"2023-07-06T01:08:53.084599+0000","last_fullsized":"2023-07-06T01:08:53.084599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.531467+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:51.531467+0000","last_peered":"2023-07-06T01:08:51.531467+0000","last_clean":"2023-07-06T01:08:51.531467+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:51.531467+0000","last_undegraded":"2023-07-06T01:08:51.531467+0000","last_fullsized":"2023-07-06T01:08:51.531467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:37.476727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086793+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:53.086793+0000","last_peered":"2023-07-06T01:08:53.086793+0000","last_clean":"2023-07-06T01:08:53.086793+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:53.086793+0000","last_undegraded":"2023-07-06T01:08:53.086793+0000","last_fullsized":"2023-07-06T01:08:53.086793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:07.245265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552114+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:52.552114+0000","last_peered":"2023-07-06T01:08:52.552114+0000","last_clean":"2023-07-06T01:08:52.552114+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:52.552114+0000","last_undegraded":"2023-07-06T01:08:52.552114+0000","last_fullsized":"2023-07-06T01:08:52.552114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085655+0000","last_change":"2023-07-06T01:08:51.567558+0000","last_active":"2023-07-06T01:08:53.085655+0000","last_peered":"2023-07-06T01:08:53.085655+0000","last_clean":"2023-07-06T01:08:53.085655+0000","last_became_active":"2023-07-06T01:08:51.567124+0000","last_became_peered":"2023-07-06T01:08:51.567124+0000","last_unstale":"2023-07-06T01:08:53.085655+0000","last_undegraded":"2023-07-06T01:08:53.085655+0000","last_fullsized":"2023-07-06T01:08:53.085655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087397+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:53.087397+0000","last_peered":"2023-07-06T01:08:53.087397+0000","last_clean":"2023-07-06T01:08:53.087397+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:53.087397+0000","last_undegraded":"2023-07-06T01:08:53.087397+0000","last_fullsized":"2023-07-06T01:08:53.087397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:19.934388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.528523+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:51.528523+0000","last_peered":"2023-07-06T01:08:51.528523+0000","last_clean":"2023-07-06T01:08:51.528523+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:51.528523+0000","last_undegraded":"2023-07-06T01:08:51.528523+0000","last_fullsized":"2023-07-06T01:08:51.528523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:00:54.490764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.548640+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:51.548640+0000","last_peered":"2023-07-06T01:08:51.548640+0000","last_clean":"2023-07-06T01:08:51.548640+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:51.548640+0000","last_undegraded":"2023-07-06T01:08:51.548640+0000","last_fullsized":"2023-07-06T01:08:51.548640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087298+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:53.087298+0000","last_peered":"2023-07-06T01:08:53.087298+0000","last_clean":"2023-07-06T01:08:53.087298+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:53.087298+0000","last_undegraded":"2023-07-06T01:08:53.087298+0000","last_fullsized":"2023-07-06T01:08:53.087298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:11.979401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084458+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:53.084458+0000","last_peered":"2023-07-06T01:08:53.084458+0000","last_clean":"2023-07-06T01:08:53.084458+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:53.084458+0000","last_undegraded":"2023-07-06T01:08:53.084458+0000","last_fullsized":"2023-07-06T01:08:53.084458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.560504+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:51.560504+0000","last_peered":"2023-07-06T01:08:51.560504+0000","last_clean":"2023-07-06T01:08:51.560504+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:51.560504+0000","last_undegraded":"2023-07-06T01:08:51.560504+0000","last_fullsized":"2023-07-06T01:08:51.560504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:42.929922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552734+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:52.552734+0000","last_peered":"2023-07-06T01:08:52.552734+0000","last_clean":"2023-07-06T01:08:52.552734+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:52.552734+0000","last_undegraded":"2023-07-06T01:08:52.552734+0000","last_fullsized":"2023-07-06T01:08:52.552734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:19.629343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084587+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:53.084587+0000","last_peered":"2023-07-06T01:08:53.084587+0000","last_clean":"2023-07-06T01:08:53.084587+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:53.084587+0000","last_undegraded":"2023-07-06T01:08:53.084587+0000","last_fullsized":"2023-07-06T01:08:53.084587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551899+0000","last_change":"2023-07-06T01:08:51.545985+0000","last_active":"2023-07-06T01:08:52.551899+0000","last_peered":"2023-07-06T01:08:52.551899+0000","last_clean":"2023-07-06T01:08:52.551899+0000","last_became_active":"2023-07-06T01:08:51.545528+0000","last_became_peered":"2023-07-06T01:08:51.545528+0000","last_unstale":"2023-07-06T01:08:52.551899+0000","last_undegraded":"2023-07-06T01:08:52.551899+0000","last_fullsized":"2023-07-06T01:08:52.551899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085152+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:53.085152+0000","last_peered":"2023-07-06T01:08:53.085152+0000","last_clean":"2023-07-06T01:08:53.085152+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:53.085152+0000","last_undegraded":"2023-07-06T01:08:53.085152+0000","last_fullsized":"2023-07-06T01:08:53.085152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:36.583295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.529455+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:51.529455+0000","last_peered":"2023-07-06T01:08:51.529455+0000","last_clean":"2023-07-06T01:08:51.529455+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:51.529455+0000","last_undegraded":"2023-07-06T01:08:51.529455+0000","last_fullsized":"2023-07-06T01:08:51.529455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:24:16.552277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085799+0000","last_change":"2023-07-06T01:08:51.561799+0000","last_active":"2023-07-06T01:08:53.085799+0000","last_peered":"2023-07-06T01:08:53.085799+0000","last_clean":"2023-07-06T01:08:53.085799+0000","last_became_active":"2023-07-06T01:08:51.561471+0000","last_became_peered":"2023-07-06T01:08:51.561471+0000","last_unstale":"2023-07-06T01:08:53.085799+0000","last_undegraded":"2023-07-06T01:08:53.085799+0000","last_fullsized":"2023-07-06T01:08:53.085799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563845+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:51.563845+0000","last_peered":"2023-07-06T01:08:51.563845+0000","last_clean":"2023-07-06T01:08:51.563845+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:51.563845+0000","last_undegraded":"2023-07-06T01:08:51.563845+0000","last_fullsized":"2023-07-06T01:08:51.563845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083970+0000","last_change":"2023-07-06T01:08:51.545591+0000","last_active":"2023-07-06T01:08:53.083970+0000","last_peered":"2023-07-06T01:08:53.083970+0000","last_clean":"2023-07-06T01:08:53.083970+0000","last_became_active":"2023-07-06T01:08:51.545275+0000","last_became_peered":"2023-07-06T01:08:51.545275+0000","last_unstale":"2023-07-06T01:08:53.083970+0000","last_undegraded":"2023-07-06T01:08:53.083970+0000","last_fullsized":"2023-07-06T01:08:53.083970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.562490+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:51.562490+0000","last_peered":"2023-07-06T01:08:51.562490+0000","last_clean":"2023-07-06T01:08:51.562490+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:51.562490+0000","last_undegraded":"2023-07-06T01:08:51.562490+0000","last_fullsized":"2023-07-06T01:08:51.562490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:47.852578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086414+0000","last_change":"2023-07-06T01:08:51.564597+0000","last_active":"2023-07-06T01:08:53.086414+0000","last_peered":"2023-07-06T01:08:53.086414+0000","last_clean":"2023-07-06T01:08:53.086414+0000","last_became_active":"2023-07-06T01:08:51.564031+0000","last_became_peered":"2023-07-06T01:08:51.564031+0000","last_unstale":"2023-07-06T01:08:53.086414+0000","last_undegraded":"2023-07-06T01:08:53.086414+0000","last_fullsized":"2023-07-06T01:08:53.086414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:30.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.563303+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:51.563303+0000","last_peered":"2023-07-06T01:08:51.563303+0000","last_clean":"2023-07-06T01:08:51.563303+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:51.563303+0000","last_undegraded":"2023-07-06T01:08:51.563303+0000","last_fullsized":"2023-07-06T01:08:51.563303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086339+0000","last_change":"2023-07-06T01:08:51.564862+0000","last_active":"2023-07-06T01:08:53.086339+0000","last_peered":"2023-07-06T01:08:53.086339+0000","last_clean":"2023-07-06T01:08:53.086339+0000","last_became_active":"2023-07-06T01:08:51.564536+0000","last_became_peered":"2023-07-06T01:08:51.564536+0000","last_unstale":"2023-07-06T01:08:53.086339+0000","last_undegraded":"2023-07-06T01:08:53.086339+0000","last_fullsized":"2023-07-06T01:08:53.086339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:26.281015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552320+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:52.552320+0000","last_peered":"2023-07-06T01:08:52.552320+0000","last_clean":"2023-07-06T01:08:52.552320+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:52.552320+0000","last_undegraded":"2023-07-06T01:08:52.552320+0000","last_fullsized":"2023-07-06T01:08:52.552320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551948+0000","last_change":"2023-07-06T01:08:51.550387+0000","last_active":"2023-07-06T01:08:52.551948+0000","last_peered":"2023-07-06T01:08:52.551948+0000","last_clean":"2023-07-06T01:08:52.551948+0000","last_became_active":"2023-07-06T01:08:51.550102+0000","last_became_peered":"2023-07-06T01:08:51.550102+0000","last_unstale":"2023-07-06T01:08:52.551948+0000","last_undegraded":"2023-07-06T01:08:52.551948+0000","last_fullsized":"2023-07-06T01:08:52.551948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-06T01:08:51.557988+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:51.557988+0000","last_peered":"2023-07-06T01:08:51.557988+0000","last_clean":"2023-07-06T01:08:51.557988+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:51.557988+0000","last_undegraded":"2023-07-06T01:08:51.557988+0000","last_fullsized":"2023-07-06T01:08:51.557988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085028+0000","last_change":"2023-07-06T01:08:51.563224+0000","last_active":"2023-07-06T01:08:53.085028+0000","last_peered":"2023-07-06T01:08:53.085028+0000","last_clean":"2023-07-06T01:08:53.085028+0000","last_became_active":"2023-07-06T01:08:51.563080+0000","last_became_peered":"2023-07-06T01:08:51.563080+0000","last_unstale":"2023-07-06T01:08:53.085028+0000","last_undegraded":"2023-07-06T01:08:53.085028+0000","last_fullsized":"2023-07-06T01:08:53.085028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085052+0000","last_change":"2023-07-06T01:08:51.543670+0000","last_active":"2023-07-06T01:08:53.085052+0000","last_peered":"2023-07-06T01:08:53.085052+0000","last_clean":"2023-07-06T01:08:53.085052+0000","last_became_active":"2023-07-06T01:08:51.542701+0000","last_became_peered":"2023-07-06T01:08:51.542701+0000","last_unstale":"2023-07-06T01:08:53.085052+0000","last_undegraded":"2023-07-06T01:08:53.085052+0000","last_fullsized":"2023-07-06T01:08:53.085052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551937+0000","last_change":"2023-07-06T01:08:51.548220+0000","last_active":"2023-07-06T01:08:52.551937+0000","last_peered":"2023-07-06T01:08:52.551937+0000","last_clean":"2023-07-06T01:08:52.551937+0000","last_became_active":"2023-07-06T01:08:51.547940+0000","last_became_peered":"2023-07-06T01:08:51.547940+0000","last_unstale":"2023-07-06T01:08:52.551937+0000","last_undegraded":"2023-07-06T01:08:52.551937+0000","last_fullsized":"2023-07-06T01:08:52.551937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086197+0000","last_change":"2023-07-06T01:08:51.561978+0000","last_active":"2023-07-06T01:08:53.086197+0000","last_peered":"2023-07-06T01:08:53.086197+0000","last_clean":"2023-07-06T01:08:53.086197+0000","last_became_active":"2023-07-06T01:08:51.561567+0000","last_became_peered":"2023-07-06T01:08:51.561567+0000","last_unstale":"2023-07-06T01:08:53.086197+0000","last_undegraded":"2023-07-06T01:08:53.086197+0000","last_fullsized":"2023-07-06T01:08:53.086197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552910+0000","last_change":"2023-07-06T01:08:51.557783+0000","last_active":"2023-07-06T01:08:52.552910+0000","last_peered":"2023-07-06T01:08:52.552910+0000","last_clean":"2023-07-06T01:08:52.552910+0000","last_became_active":"2023-07-06T01:08:51.553006+0000","last_became_peered":"2023-07-06T01:08:51.553006+0000","last_unstale":"2023-07-06T01:08:52.552910+0000","last_undegraded":"2023-07-06T01:08:52.552910+0000","last_fullsized":"2023-07-06T01:08:52.552910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084259+0000","last_change":"2023-07-06T01:08:51.554515+0000","last_active":"2023-07-06T01:08:53.084259+0000","last_peered":"2023-07-06T01:08:53.084259+0000","last_clean":"2023-07-06T01:08:53.084259+0000","last_became_active":"2023-07-06T01:08:51.554231+0000","last_became_peered":"2023-07-06T01:08:51.554231+0000","last_unstale":"2023-07-06T01:08:53.084259+0000","last_undegraded":"2023-07-06T01:08:53.084259+0000","last_fullsized":"2023-07-06T01:08:53.084259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":666186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":75818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:09:00.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:09:01.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.037+0000 7f19715ff700 1 Processor -- start 2023-07-06T01:09:01.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.037+0000 7f19715ff700 1 -- start start 2023-07-06T01:09:01.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f19715ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f19715ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f196c0b5c90 0x7f196c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f19715ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f196c0b6100 0x7f196c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f19715ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0cf780 con 0x7f196c0b6100 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f19715ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0cd490 con 0x7f196c0b5c90 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f19715ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0cd770 con 0x7f196c15fca0 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f196b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f196c0b6100 0x7f196c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f196b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f196c0b6100 0x7f196c0d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45284/0 (socket says 172.21.15.71:45284) 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f196b7fe700 1 -- 172.21.15.71:0/3464225856 learned_addr learned my addr 172.21.15.71:0/3464225856 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.038+0000 7f196affd700 1 --2- 172.21.15.71:0/3464225856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196a7fc700 1 --2- 172.21.15.71:0/3464225856 >> v2:172.21.15.194:3300/0 conn(0x7f196c0b5c90 0x7f196c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196b7fe700 1 -- 172.21.15.71:0/3464225856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 msgr2=0x7f196c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196b7fe700 1 --2- 172.21.15.71:0/3464225856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196b7fe700 1 -- 172.21.15.71:0/3464225856 >> v2:172.21.15.194:3300/0 conn(0x7f196c0b5c90 msgr2=0x7f196c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196b7fe700 1 --2- 172.21.15.71:0/3464225856 >> v2:172.21.15.194:3300/0 conn(0x7f196c0b5c90 0x7f196c0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196b7fe700 1 -- 172.21.15.71:0/3464225856 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0cda50 con 0x7f196c0b6100 2023-07-06T01:09:01.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f196b7fe700 1 --2- 172.21.15.71:0/3464225856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0d3280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f196c06cda0 tx=0x7f196400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6ca54399fbfeae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:01.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f1969ffb700 1 -- 172.21.15.71:0/3464225856 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400e070 con 0x7f196c0b6100 2023-07-06T01:09:01.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f1969ffb700 1 -- 172.21.15.71:0/3464225856 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400b9c0 con 0x7f196c0b6100 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.039+0000 7f1969ffb700 1 -- 172.21.15.71:0/3464225856 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400bd70 con 0x7f196c0b6100 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 -- 172.21.15.71:0/3464225856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 msgr2=0x7f196c0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 --2- 172.21.15.71:0/3464225856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0d3280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f196c06cda0 tx=0x7f196400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 -- 172.21.15.71:0/3464225856 shutdown_connections 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 --2- 172.21.15.71:0/3464225856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 --2- 172.21.15.71:0/3464225856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0d3280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 --2- 172.21.15.71:0/3464225856 >> v2:172.21.15.194:3300/0 conn(0x7f196c0b5c90 0x7f196c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 -- 172.21.15.71:0/3464225856 >> 172.21.15.71:0/3464225856 conn(0x7f196c06c150 msgr2=0x7f196c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:01.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 -- 172.21.15.71:0/3464225856 shutdown_connections 2023-07-06T01:09:01.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.040+0000 7f19715ff700 1 -- 172.21.15.71:0/3464225856 wait complete. 2023-07-06T01:09:01.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.042+0000 7f19715ff700 1 Processor -- start 2023-07-06T01:09:01.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.042+0000 7f19715ff700 1 -- start start 2023-07-06T01:09:01.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f19715ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f196c0b5c90 0x7f196c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f19715ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f19715ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f19715ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0c9280 con 0x7f196c0b6100 2023-07-06T01:09:01.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f19715ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15d350 con 0x7f196c0b5c90 2023-07-06T01:09:01.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f19715ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15d630 con 0x7f196c15fca0 2023-07-06T01:09:01.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45294/0 (socket says 172.21.15.71:45294) 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 -- 172.21.15.71:0/122027528 learned_addr learned my addr 172.21.15.71:0/122027528 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196affd700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f196c0b5c90 0x7f196c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196b7fe700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 -- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 msgr2=0x7f196c0cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 -- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f196c0b5c90 msgr2=0x7f196c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f196c0b5c90 0x7f196c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196a7fc700 1 -- 172.21.15.71:0/122027528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009b30 con 0x7f196c0b6100 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196b7fe700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.043+0000 7f196affd700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f196c0b5c90 0x7f196c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.044+0000 7f196a7fc700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0c8d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f196000c7f0 tx=0x7f196000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.044+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011800 con 0x7f196c0b6100 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.044+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960011960 con 0x7f196c0b6100 2023-07-06T01:09:01.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.044+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c15d910 con 0x7f196c0b6100 2023-07-06T01:09:01.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.044+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011d10 con 0x7f196c0b6100 2023-07-06T01:09:01.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.044+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c147a70 con 0x7f196c0b6100 2023-07-06T01:09:01.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.045+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c15de30 con 0x7f196c0b6100 2023-07-06T01:09:01.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.046+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1960018360 con 0x7f196c0b6100 2023-07-06T01:09:01.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.047+0000 7f19537fe700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f195806ace0 0x7f195806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.047+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1960088fd0 con 0x7f196c0b6100 2023-07-06T01:09:01.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.047+0000 7f196affd700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f195806ace0 0x7f195806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.048+0000 7f196affd700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f195806ace0 0x7f195806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f195c0099f0 tx=0x7f195c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:01.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.051+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f196c15de30 con 0x7f196c0b6100 2023-07-06T01:09:01.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.242+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f196c15d4c0 con 0x7f195806ace0 2023-07-06T01:09:01.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.251+0000 7f19537fe700 1 -- 172.21.15.71:0/122027528 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286720 (secure 0 0 0) 0x7f196c15d4c0 con 0x7f195806ace0 2023-07-06T01:09:01.257 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f195806ace0 msgr2=0x7f195806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f195806ace0 0x7f195806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f195c0099f0 tx=0x7f195c008040 comp rx=0 tx=0).stop 2023-07-06T01:09:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 msgr2=0x7f196c0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0c8d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f196000c7f0 tx=0x7f196000cbb0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 shutdown_connections 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f195806ace0 0x7f195806d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f196c15fca0 0x7f196c0cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f196c0b5c90 0x7f196c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 --2- 172.21.15.71:0/122027528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f196c0b6100 0x7f196c0c8d40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 >> 172.21.15.71:0/122027528 conn(0x7f196c06c150 msgr2=0x7f196c0cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:01.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 shutdown_connections 2023-07-06T01:09:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.255+0000 7f19715ff700 1 -- 172.21.15.71:0/122027528 wait complete. 2023-07-06T01:09:01.261 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:09:01.275 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-06T01:09:00.832266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218728,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755992,"statfs":{"total":773094113280,"available":772870135808,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.306946"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083933+0000","last_change":"2023-07-06T01:08:51.546507+0000","last_active":"2023-07-06T01:08:53.083933+0000","last_peered":"2023-07-06T01:08:53.083933+0000","last_clean":"2023-07-06T01:08:53.083933+0000","last_became_active":"2023-07-06T01:08:51.546121+0000","last_became_peered":"2023-07-06T01:08:51.546121+0000","last_unstale":"2023-07-06T01:08:53.083933+0000","last_undegraded":"2023-07-06T01:08:53.083933+0000","last_fullsized":"2023-07-06T01:08:53.083933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:26.336987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084667+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:53.084667+0000","last_peered":"2023-07-06T01:08:53.084667+0000","last_clean":"2023-07-06T01:08:53.084667+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:53.084667+0000","last_undegraded":"2023-07-06T01:08:53.084667+0000","last_fullsized":"2023-07-06T01:08:53.084667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085333+0000","last_change":"2023-07-06T01:08:51.566075+0000","last_active":"2023-07-06T01:08:53.085333+0000","last_peered":"2023-07-06T01:08:53.085333+0000","last_clean":"2023-07-06T01:08:53.085333+0000","last_became_active":"2023-07-06T01:08:51.565537+0000","last_became_peered":"2023-07-06T01:08:51.565537+0000","last_unstale":"2023-07-06T01:08:53.085333+0000","last_undegraded":"2023-07-06T01:08:53.085333+0000","last_fullsized":"2023-07-06T01:08:53.085333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085007+0000","last_change":"2023-07-06T01:08:51.544319+0000","last_active":"2023-07-06T01:08:53.085007+0000","last_peered":"2023-07-06T01:08:53.085007+0000","last_clean":"2023-07-06T01:08:53.085007+0000","last_became_active":"2023-07-06T01:08:51.544030+0000","last_became_peered":"2023-07-06T01:08:51.544030+0000","last_unstale":"2023-07-06T01:08:53.085007+0000","last_undegraded":"2023-07-06T01:08:53.085007+0000","last_fullsized":"2023-07-06T01:08:53.085007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550847+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:52.550847+0000","last_peered":"2023-07-06T01:08:52.550847+0000","last_clean":"2023-07-06T01:08:52.550847+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:52.550847+0000","last_undegraded":"2023-07-06T01:08:52.550847+0000","last_fullsized":"2023-07-06T01:08:52.550847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086081+0000","last_change":"2023-07-06T01:08:51.562443+0000","last_active":"2023-07-06T01:08:53.086081+0000","last_peered":"2023-07-06T01:08:53.086081+0000","last_clean":"2023-07-06T01:08:53.086081+0000","last_became_active":"2023-07-06T01:08:51.561788+0000","last_became_peered":"2023-07-06T01:08:51.561788+0000","last_unstale":"2023-07-06T01:08:53.086081+0000","last_undegraded":"2023-07-06T01:08:53.086081+0000","last_fullsized":"2023-07-06T01:08:53.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086840+0000","last_change":"2023-07-06T01:08:51.548054+0000","last_active":"2023-07-06T01:08:53.086840+0000","last_peered":"2023-07-06T01:08:53.086840+0000","last_clean":"2023-07-06T01:08:53.086840+0000","last_became_active":"2023-07-06T01:08:51.547567+0000","last_became_peered":"2023-07-06T01:08:51.547567+0000","last_unstale":"2023-07-06T01:08:53.086840+0000","last_undegraded":"2023-07-06T01:08:53.086840+0000","last_fullsized":"2023-07-06T01:08:53.086840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084532+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:53.084532+0000","last_peered":"2023-07-06T01:08:53.084532+0000","last_clean":"2023-07-06T01:08:53.084532+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:53.084532+0000","last_undegraded":"2023-07-06T01:08:53.084532+0000","last_fullsized":"2023-07-06T01:08:53.084532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550700+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:52.550700+0000","last_peered":"2023-07-06T01:08:52.550700+0000","last_clean":"2023-07-06T01:08:52.550700+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:52.550700+0000","last_undegraded":"2023-07-06T01:08:52.550700+0000","last_fullsized":"2023-07-06T01:08:52.550700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:15.564746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085937+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:53.085937+0000","last_peered":"2023-07-06T01:08:53.085937+0000","last_clean":"2023-07-06T01:08:53.085937+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:53.085937+0000","last_undegraded":"2023-07-06T01:08:53.085937+0000","last_fullsized":"2023-07-06T01:08:53.085937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085511+0000","last_change":"2023-07-06T01:08:51.565857+0000","last_active":"2023-07-06T01:08:53.085511+0000","last_peered":"2023-07-06T01:08:53.085511+0000","last_clean":"2023-07-06T01:08:53.085511+0000","last_became_active":"2023-07-06T01:08:51.565237+0000","last_became_peered":"2023-07-06T01:08:51.565237+0000","last_unstale":"2023-07-06T01:08:53.085511+0000","last_undegraded":"2023-07-06T01:08:53.085511+0000","last_fullsized":"2023-07-06T01:08:53.085511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083889+0000","last_change":"2023-07-06T01:08:51.565593+0000","last_active":"2023-07-06T01:08:53.083889+0000","last_peered":"2023-07-06T01:08:53.083889+0000","last_clean":"2023-07-06T01:08:53.083889+0000","last_became_active":"2023-07-06T01:08:51.565334+0000","last_became_peered":"2023-07-06T01:08:51.565334+0000","last_unstale":"2023-07-06T01:08:53.083889+0000","last_undegraded":"2023-07-06T01:08:53.083889+0000","last_fullsized":"2023-07-06T01:08:53.083889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:48.859326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083791+0000","last_change":"2023-07-06T01:08:51.545491+0000","last_active":"2023-07-06T01:08:53.083791+0000","last_peered":"2023-07-06T01:08:53.083791+0000","last_clean":"2023-07-06T01:08:53.083791+0000","last_became_active":"2023-07-06T01:08:51.545185+0000","last_became_peered":"2023-07-06T01:08:51.545185+0000","last_unstale":"2023-07-06T01:08:53.083791+0000","last_undegraded":"2023-07-06T01:08:53.083791+0000","last_fullsized":"2023-07-06T01:08:53.083791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085059+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:53.085059+0000","last_peered":"2023-07-06T01:08:53.085059+0000","last_clean":"2023-07-06T01:08:53.085059+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:53.085059+0000","last_undegraded":"2023-07-06T01:08:53.085059+0000","last_fullsized":"2023-07-06T01:08:53.085059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086970+0000","last_change":"2023-07-06T01:08:51.547864+0000","last_active":"2023-07-06T01:08:53.086970+0000","last_peered":"2023-07-06T01:08:53.086970+0000","last_clean":"2023-07-06T01:08:53.086970+0000","last_became_active":"2023-07-06T01:08:51.547170+0000","last_became_peered":"2023-07-06T01:08:51.547170+0000","last_unstale":"2023-07-06T01:08:53.086970+0000","last_undegraded":"2023-07-06T01:08:53.086970+0000","last_fullsized":"2023-07-06T01:08:53.086970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085158+0000","last_change":"2023-07-06T01:08:51.562917+0000","last_active":"2023-07-06T01:08:53.085158+0000","last_peered":"2023-07-06T01:08:53.085158+0000","last_clean":"2023-07-06T01:08:53.085158+0000","last_became_active":"2023-07-06T01:08:51.562635+0000","last_became_peered":"2023-07-06T01:08:51.562635+0000","last_unstale":"2023-07-06T01:08:53.085158+0000","last_undegraded":"2023-07-06T01:08:53.085158+0000","last_fullsized":"2023-07-06T01:08:53.085158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550899+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:52.550899+0000","last_peered":"2023-07-06T01:08:52.550899+0000","last_clean":"2023-07-06T01:08:52.550899+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:52.550899+0000","last_undegraded":"2023-07-06T01:08:52.550899+0000","last_fullsized":"2023-07-06T01:08:52.550899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085257+0000","last_change":"2023-07-06T01:08:51.562248+0000","last_active":"2023-07-06T01:08:53.085257+0000","last_peered":"2023-07-06T01:08:53.085257+0000","last_clean":"2023-07-06T01:08:53.085257+0000","last_became_active":"2023-07-06T01:08:51.561945+0000","last_became_peered":"2023-07-06T01:08:51.561945+0000","last_unstale":"2023-07-06T01:08:53.085257+0000","last_undegraded":"2023-07-06T01:08:53.085257+0000","last_fullsized":"2023-07-06T01:08:53.085257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083937+0000","last_change":"2023-07-06T01:08:51.552763+0000","last_active":"2023-07-06T01:08:53.083937+0000","last_peered":"2023-07-06T01:08:53.083937+0000","last_clean":"2023-07-06T01:08:53.083937+0000","last_became_active":"2023-07-06T01:08:51.552507+0000","last_became_peered":"2023-07-06T01:08:51.552507+0000","last_unstale":"2023-07-06T01:08:53.083937+0000","last_undegraded":"2023-07-06T01:08:53.083937+0000","last_fullsized":"2023-07-06T01:08:53.083937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085562+0000","last_change":"2023-07-06T01:08:51.564791+0000","last_active":"2023-07-06T01:08:53.085562+0000","last_peered":"2023-07-06T01:08:53.085562+0000","last_clean":"2023-07-06T01:08:53.085562+0000","last_became_active":"2023-07-06T01:08:51.564227+0000","last_became_peered":"2023-07-06T01:08:51.564227+0000","last_unstale":"2023-07-06T01:08:53.085562+0000","last_undegraded":"2023-07-06T01:08:53.085562+0000","last_fullsized":"2023-07-06T01:08:53.085562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087254+0000","last_change":"2023-07-06T01:08:51.548812+0000","last_active":"2023-07-06T01:08:53.087254+0000","last_peered":"2023-07-06T01:08:53.087254+0000","last_clean":"2023-07-06T01:08:53.087254+0000","last_became_active":"2023-07-06T01:08:51.548481+0000","last_became_peered":"2023-07-06T01:08:51.548481+0000","last_unstale":"2023-07-06T01:08:53.087254+0000","last_undegraded":"2023-07-06T01:08:53.087254+0000","last_fullsized":"2023-07-06T01:08:53.087254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550919+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:52.550919+0000","last_peered":"2023-07-06T01:08:52.550919+0000","last_clean":"2023-07-06T01:08:52.550919+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:52.550919+0000","last_undegraded":"2023-07-06T01:08:52.550919+0000","last_fullsized":"2023-07-06T01:08:52.550919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552229+0000","last_change":"2023-07-06T01:08:51.545243+0000","last_active":"2023-07-06T01:08:52.552229+0000","last_peered":"2023-07-06T01:08:52.552229+0000","last_clean":"2023-07-06T01:08:52.552229+0000","last_became_active":"2023-07-06T01:08:51.544960+0000","last_became_peered":"2023-07-06T01:08:51.544960+0000","last_unstale":"2023-07-06T01:08:52.552229+0000","last_undegraded":"2023-07-06T01:08:52.552229+0000","last_fullsized":"2023-07-06T01:08:52.552229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086966+0000","last_change":"2023-07-06T01:08:51.546755+0000","last_active":"2023-07-06T01:08:53.086966+0000","last_peered":"2023-07-06T01:08:53.086966+0000","last_clean":"2023-07-06T01:08:53.086966+0000","last_became_active":"2023-07-06T01:08:51.546419+0000","last_became_peered":"2023-07-06T01:08:51.546419+0000","last_unstale":"2023-07-06T01:08:53.086966+0000","last_undegraded":"2023-07-06T01:08:53.086966+0000","last_fullsized":"2023-07-06T01:08:53.086966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:54.356882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084592+0000","last_change":"2023-07-06T01:08:51.552436+0000","last_active":"2023-07-06T01:08:53.084592+0000","last_peered":"2023-07-06T01:08:53.084592+0000","last_clean":"2023-07-06T01:08:53.084592+0000","last_became_active":"2023-07-06T01:08:51.552191+0000","last_became_peered":"2023-07-06T01:08:51.552191+0000","last_unstale":"2023-07-06T01:08:53.084592+0000","last_undegraded":"2023-07-06T01:08:53.084592+0000","last_fullsized":"2023-07-06T01:08:53.084592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084557+0000","last_change":"2023-07-06T01:08:51.545034+0000","last_active":"2023-07-06T01:08:53.084557+0000","last_peered":"2023-07-06T01:08:53.084557+0000","last_clean":"2023-07-06T01:08:53.084557+0000","last_became_active":"2023-07-06T01:08:51.544709+0000","last_became_peered":"2023-07-06T01:08:51.544709+0000","last_unstale":"2023-07-06T01:08:53.084557+0000","last_undegraded":"2023-07-06T01:08:53.084557+0000","last_fullsized":"2023-07-06T01:08:53.084557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085448+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:53.085448+0000","last_peered":"2023-07-06T01:08:53.085448+0000","last_clean":"2023-07-06T01:08:53.085448+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:53.085448+0000","last_undegraded":"2023-07-06T01:08:53.085448+0000","last_fullsized":"2023-07-06T01:08:53.085448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086323+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:53.086323+0000","last_peered":"2023-07-06T01:08:53.086323+0000","last_clean":"2023-07-06T01:08:53.086323+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:53.086323+0000","last_undegraded":"2023-07-06T01:08:53.086323+0000","last_fullsized":"2023-07-06T01:08:53.086323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:17.319280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.553004+0000","last_change":"2023-07-06T01:08:51.547294+0000","last_active":"2023-07-06T01:08:52.553004+0000","last_peered":"2023-07-06T01:08:52.553004+0000","last_clean":"2023-07-06T01:08:52.553004+0000","last_became_active":"2023-07-06T01:08:51.547030+0000","last_became_peered":"2023-07-06T01:08:51.547030+0000","last_unstale":"2023-07-06T01:08:52.553004+0000","last_undegraded":"2023-07-06T01:08:52.553004+0000","last_fullsized":"2023-07-06T01:08:52.553004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084281+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:53.084281+0000","last_peered":"2023-07-06T01:08:53.084281+0000","last_clean":"2023-07-06T01:08:53.084281+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:53.084281+0000","last_undegraded":"2023-07-06T01:08:53.084281+0000","last_fullsized":"2023-07-06T01:08:53.084281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:36.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551180+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:52.551180+0000","last_peered":"2023-07-06T01:08:52.551180+0000","last_clean":"2023-07-06T01:08:52.551180+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:52.551180+0000","last_undegraded":"2023-07-06T01:08:52.551180+0000","last_fullsized":"2023-07-06T01:08:52.551180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552092+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:52.552092+0000","last_peered":"2023-07-06T01:08:52.552092+0000","last_clean":"2023-07-06T01:08:52.552092+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:52.552092+0000","last_undegraded":"2023-07-06T01:08:52.552092+0000","last_fullsized":"2023-07-06T01:08:52.552092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085320+0000","last_change":"2023-07-06T01:08:51.557675+0000","last_active":"2023-07-06T01:08:53.085320+0000","last_peered":"2023-07-06T01:08:53.085320+0000","last_clean":"2023-07-06T01:08:53.085320+0000","last_became_active":"2023-07-06T01:08:51.557340+0000","last_became_peered":"2023-07-06T01:08:51.557340+0000","last_unstale":"2023-07-06T01:08:53.085320+0000","last_undegraded":"2023-07-06T01:08:53.085320+0000","last_fullsized":"2023-07-06T01:08:53.085320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:02.855361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551022+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:52.551022+0000","last_peered":"2023-07-06T01:08:52.551022+0000","last_clean":"2023-07-06T01:08:52.551022+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:52.551022+0000","last_undegraded":"2023-07-06T01:08:52.551022+0000","last_fullsized":"2023-07-06T01:08:52.551022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552061+0000","last_change":"2023-07-06T01:08:51.549974+0000","last_active":"2023-07-06T01:08:52.552061+0000","last_peered":"2023-07-06T01:08:52.552061+0000","last_clean":"2023-07-06T01:08:52.552061+0000","last_became_active":"2023-07-06T01:08:51.549708+0000","last_became_peered":"2023-07-06T01:08:51.549708+0000","last_unstale":"2023-07-06T01:08:52.552061+0000","last_undegraded":"2023-07-06T01:08:52.552061+0000","last_fullsized":"2023-07-06T01:08:52.552061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085783+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:53.085783+0000","last_peered":"2023-07-06T01:08:53.085783+0000","last_clean":"2023-07-06T01:08:53.085783+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:53.085783+0000","last_undegraded":"2023-07-06T01:08:53.085783+0000","last_fullsized":"2023-07-06T01:08:53.085783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552097+0000","last_change":"2023-07-06T01:08:51.552404+0000","last_active":"2023-07-06T01:08:52.552097+0000","last_peered":"2023-07-06T01:08:52.552097+0000","last_clean":"2023-07-06T01:08:52.552097+0000","last_became_active":"2023-07-06T01:08:51.551398+0000","last_became_peered":"2023-07-06T01:08:51.551398+0000","last_unstale":"2023-07-06T01:08:52.552097+0000","last_undegraded":"2023-07-06T01:08:52.552097+0000","last_fullsized":"2023-07-06T01:08:52.552097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087253+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:53.087253+0000","last_peered":"2023-07-06T01:08:53.087253+0000","last_clean":"2023-07-06T01:08:53.087253+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:53.087253+0000","last_undegraded":"2023-07-06T01:08:53.087253+0000","last_fullsized":"2023-07-06T01:08:53.087253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:18.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084462+0000","last_change":"2023-07-06T01:08:51.553928+0000","last_active":"2023-07-06T01:08:53.084462+0000","last_peered":"2023-07-06T01:08:53.084462+0000","last_clean":"2023-07-06T01:08:53.084462+0000","last_became_active":"2023-07-06T01:08:51.553607+0000","last_became_peered":"2023-07-06T01:08:51.553607+0000","last_unstale":"2023-07-06T01:08:53.084462+0000","last_undegraded":"2023-07-06T01:08:53.084462+0000","last_fullsized":"2023-07-06T01:08:53.084462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085895+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:53.085895+0000","last_peered":"2023-07-06T01:08:53.085895+0000","last_clean":"2023-07-06T01:08:53.085895+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:53.085895+0000","last_undegraded":"2023-07-06T01:08:53.085895+0000","last_fullsized":"2023-07-06T01:08:53.085895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086082+0000","last_change":"2023-07-06T01:08:51.564390+0000","last_active":"2023-07-06T01:08:53.086082+0000","last_peered":"2023-07-06T01:08:53.086082+0000","last_clean":"2023-07-06T01:08:53.086082+0000","last_became_active":"2023-07-06T01:08:51.563606+0000","last_became_peered":"2023-07-06T01:08:51.563606+0000","last_unstale":"2023-07-06T01:08:53.086082+0000","last_undegraded":"2023-07-06T01:08:53.086082+0000","last_fullsized":"2023-07-06T01:08:53.086082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:01.040810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086960+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:53.086960+0000","last_peered":"2023-07-06T01:08:53.086960+0000","last_clean":"2023-07-06T01:08:53.086960+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:53.086960+0000","last_undegraded":"2023-07-06T01:08:53.086960+0000","last_fullsized":"2023-07-06T01:08:53.086960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552404+0000","last_change":"2023-07-06T01:08:51.548167+0000","last_active":"2023-07-06T01:08:52.552404+0000","last_peered":"2023-07-06T01:08:52.552404+0000","last_clean":"2023-07-06T01:08:52.552404+0000","last_became_active":"2023-07-06T01:08:51.547839+0000","last_became_peered":"2023-07-06T01:08:51.547839+0000","last_unstale":"2023-07-06T01:08:52.552404+0000","last_undegraded":"2023-07-06T01:08:52.552404+0000","last_fullsized":"2023-07-06T01:08:52.552404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550774+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:52.550774+0000","last_peered":"2023-07-06T01:08:52.550774+0000","last_clean":"2023-07-06T01:08:52.550774+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:52.550774+0000","last_undegraded":"2023-07-06T01:08:52.550774+0000","last_fullsized":"2023-07-06T01:08:52.550774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:23.246313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085598+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:53.085598+0000","last_peered":"2023-07-06T01:08:53.085598+0000","last_clean":"2023-07-06T01:08:53.085598+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:53.085598+0000","last_undegraded":"2023-07-06T01:08:53.085598+0000","last_fullsized":"2023-07-06T01:08:53.085598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086809+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:53.086809+0000","last_peered":"2023-07-06T01:08:53.086809+0000","last_clean":"2023-07-06T01:08:53.086809+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:53.086809+0000","last_undegraded":"2023-07-06T01:08:53.086809+0000","last_fullsized":"2023-07-06T01:08:53.086809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550847+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:52.550847+0000","last_peered":"2023-07-06T01:08:52.550847+0000","last_clean":"2023-07-06T01:08:52.550847+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:52.550847+0000","last_undegraded":"2023-07-06T01:08:52.550847+0000","last_fullsized":"2023-07-06T01:08:52.550847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084513+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:53.084513+0000","last_peered":"2023-07-06T01:08:53.084513+0000","last_clean":"2023-07-06T01:08:53.084513+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:53.084513+0000","last_undegraded":"2023-07-06T01:08:53.084513+0000","last_fullsized":"2023-07-06T01:08:53.084513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552880+0000","last_change":"2023-07-06T01:08:51.549714+0000","last_active":"2023-07-06T01:08:52.552880+0000","last_peered":"2023-07-06T01:08:52.552880+0000","last_clean":"2023-07-06T01:08:52.552880+0000","last_became_active":"2023-07-06T01:08:51.549235+0000","last_became_peered":"2023-07-06T01:08:51.549235+0000","last_unstale":"2023-07-06T01:08:52.552880+0000","last_undegraded":"2023-07-06T01:08:52.552880+0000","last_fullsized":"2023-07-06T01:08:52.552880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087586+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:53.087586+0000","last_peered":"2023-07-06T01:08:53.087586+0000","last_clean":"2023-07-06T01:08:53.087586+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:53.087586+0000","last_undegraded":"2023-07-06T01:08:53.087586+0000","last_fullsized":"2023-07-06T01:08:53.087586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:16.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084760+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:53.084760+0000","last_peered":"2023-07-06T01:08:53.084760+0000","last_clean":"2023-07-06T01:08:53.084760+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:53.084760+0000","last_undegraded":"2023-07-06T01:08:53.084760+0000","last_fullsized":"2023-07-06T01:08:53.084760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087122+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:53.087122+0000","last_peered":"2023-07-06T01:08:53.087122+0000","last_clean":"2023-07-06T01:08:53.087122+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:53.087122+0000","last_undegraded":"2023-07-06T01:08:53.087122+0000","last_fullsized":"2023-07-06T01:08:53.087122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085626+0000","last_change":"2023-07-06T01:08:51.562553+0000","last_active":"2023-07-06T01:08:53.085626+0000","last_peered":"2023-07-06T01:08:53.085626+0000","last_clean":"2023-07-06T01:08:53.085626+0000","last_became_active":"2023-07-06T01:08:51.562093+0000","last_became_peered":"2023-07-06T01:08:51.562093+0000","last_unstale":"2023-07-06T01:08:53.085626+0000","last_undegraded":"2023-07-06T01:08:53.085626+0000","last_fullsized":"2023-07-06T01:08:53.085626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087474+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:53.087474+0000","last_peered":"2023-07-06T01:08:53.087474+0000","last_clean":"2023-07-06T01:08:53.087474+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:53.087474+0000","last_undegraded":"2023-07-06T01:08:53.087474+0000","last_fullsized":"2023-07-06T01:08:53.087474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:29.179839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085394+0000","last_change":"2023-07-06T01:08:51.547190+0000","last_active":"2023-07-06T01:08:53.085394+0000","last_peered":"2023-07-06T01:08:53.085394+0000","last_clean":"2023-07-06T01:08:53.085394+0000","last_became_active":"2023-07-06T01:08:51.546880+0000","last_became_peered":"2023-07-06T01:08:51.546880+0000","last_unstale":"2023-07-06T01:08:53.085394+0000","last_undegraded":"2023-07-06T01:08:53.085394+0000","last_fullsized":"2023-07-06T01:08:53.085394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084828+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:53.084828+0000","last_peered":"2023-07-06T01:08:53.084828+0000","last_clean":"2023-07-06T01:08:53.084828+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:53.084828+0000","last_undegraded":"2023-07-06T01:08:53.084828+0000","last_fullsized":"2023-07-06T01:08:53.084828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550700+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:52.550700+0000","last_peered":"2023-07-06T01:08:52.550700+0000","last_clean":"2023-07-06T01:08:52.550700+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:52.550700+0000","last_undegraded":"2023-07-06T01:08:52.550700+0000","last_fullsized":"2023-07-06T01:08:52.550700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552785+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:52.552785+0000","last_peered":"2023-07-06T01:08:52.552785+0000","last_clean":"2023-07-06T01:08:52.552785+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:52.552785+0000","last_undegraded":"2023-07-06T01:08:52.552785+0000","last_fullsized":"2023-07-06T01:08:52.552785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085734+0000","last_change":"2023-07-06T01:08:51.564576+0000","last_active":"2023-07-06T01:08:53.085734+0000","last_peered":"2023-07-06T01:08:53.085734+0000","last_clean":"2023-07-06T01:08:53.085734+0000","last_became_active":"2023-07-06T01:08:51.563750+0000","last_became_peered":"2023-07-06T01:08:51.563750+0000","last_unstale":"2023-07-06T01:08:53.085734+0000","last_undegraded":"2023-07-06T01:08:53.085734+0000","last_fullsized":"2023-07-06T01:08:53.085734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085219+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:53.085219+0000","last_peered":"2023-07-06T01:08:53.085219+0000","last_clean":"2023-07-06T01:08:53.085219+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:53.085219+0000","last_undegraded":"2023-07-06T01:08:53.085219+0000","last_fullsized":"2023-07-06T01:08:53.085219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085774+0000","last_change":"2023-07-06T01:08:51.565749+0000","last_active":"2023-07-06T01:08:53.085774+0000","last_peered":"2023-07-06T01:08:53.085774+0000","last_clean":"2023-07-06T01:08:53.085774+0000","last_became_active":"2023-07-06T01:08:51.564882+0000","last_became_peered":"2023-07-06T01:08:51.564882+0000","last_unstale":"2023-07-06T01:08:53.085774+0000","last_undegraded":"2023-07-06T01:08:53.085774+0000","last_fullsized":"2023-07-06T01:08:53.085774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086013+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:53.086013+0000","last_peered":"2023-07-06T01:08:53.086013+0000","last_clean":"2023-07-06T01:08:53.086013+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:53.086013+0000","last_undegraded":"2023-07-06T01:08:53.086013+0000","last_fullsized":"2023-07-06T01:08:53.086013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085438+0000","last_change":"2023-07-06T01:08:51.557074+0000","last_active":"2023-07-06T01:08:53.085438+0000","last_peered":"2023-07-06T01:08:53.085438+0000","last_clean":"2023-07-06T01:08:53.085438+0000","last_became_active":"2023-07-06T01:08:51.556801+0000","last_became_peered":"2023-07-06T01:08:51.556801+0000","last_unstale":"2023-07-06T01:08:53.085438+0000","last_undegraded":"2023-07-06T01:08:53.085438+0000","last_fullsized":"2023-07-06T01:08:53.085438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551959+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:52.551959+0000","last_peered":"2023-07-06T01:08:52.551959+0000","last_clean":"2023-07-06T01:08:52.551959+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:52.551959+0000","last_undegraded":"2023-07-06T01:08:52.551959+0000","last_fullsized":"2023-07-06T01:08:52.551959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:44.334492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084747+0000","last_change":"2023-07-06T01:08:51.553184+0000","last_active":"2023-07-06T01:08:53.084747+0000","last_peered":"2023-07-06T01:08:53.084747+0000","last_clean":"2023-07-06T01:08:53.084747+0000","last_became_active":"2023-07-06T01:08:51.552931+0000","last_became_peered":"2023-07-06T01:08:51.552931+0000","last_unstale":"2023-07-06T01:08:53.084747+0000","last_undegraded":"2023-07-06T01:08:53.084747+0000","last_fullsized":"2023-07-06T01:08:53.084747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084322+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:53.084322+0000","last_peered":"2023-07-06T01:08:53.084322+0000","last_clean":"2023-07-06T01:08:53.084322+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:53.084322+0000","last_undegraded":"2023-07-06T01:08:53.084322+0000","last_fullsized":"2023-07-06T01:08:53.084322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:19.832781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085719+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:53.085719+0000","last_peered":"2023-07-06T01:08:53.085719+0000","last_clean":"2023-07-06T01:08:53.085719+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:53.085719+0000","last_undegraded":"2023-07-06T01:08:53.085719+0000","last_fullsized":"2023-07-06T01:08:53.085719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084364+0000","last_change":"2023-07-06T01:08:51.557906+0000","last_active":"2023-07-06T01:08:53.084364+0000","last_peered":"2023-07-06T01:08:53.084364+0000","last_clean":"2023-07-06T01:08:53.084364+0000","last_became_active":"2023-07-06T01:08:51.557620+0000","last_became_peered":"2023-07-06T01:08:51.557620+0000","last_unstale":"2023-07-06T01:08:53.084364+0000","last_undegraded":"2023-07-06T01:08:53.084364+0000","last_fullsized":"2023-07-06T01:08:53.084364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085188+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:53.085188+0000","last_peered":"2023-07-06T01:08:53.085188+0000","last_clean":"2023-07-06T01:08:53.085188+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:53.085188+0000","last_undegraded":"2023-07-06T01:08:53.085188+0000","last_fullsized":"2023-07-06T01:08:53.085188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086255+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:53.086255+0000","last_peered":"2023-07-06T01:08:53.086255+0000","last_clean":"2023-07-06T01:08:53.086255+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:53.086255+0000","last_undegraded":"2023-07-06T01:08:53.086255+0000","last_fullsized":"2023-07-06T01:08:53.086255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:53.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084397+0000","last_change":"2023-07-06T01:08:51.546136+0000","last_active":"2023-07-06T01:08:53.084397+0000","last_peered":"2023-07-06T01:08:53.084397+0000","last_clean":"2023-07-06T01:08:53.084397+0000","last_became_active":"2023-07-06T01:08:51.545893+0000","last_became_peered":"2023-07-06T01:08:51.545893+0000","last_unstale":"2023-07-06T01:08:53.084397+0000","last_undegraded":"2023-07-06T01:08:53.084397+0000","last_fullsized":"2023-07-06T01:08:53.084397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083722+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:53.083722+0000","last_peered":"2023-07-06T01:08:53.083722+0000","last_clean":"2023-07-06T01:08:53.083722+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:53.083722+0000","last_undegraded":"2023-07-06T01:08:53.083722+0000","last_fullsized":"2023-07-06T01:08:53.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:26.895276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084090+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:53.084090+0000","last_peered":"2023-07-06T01:08:53.084090+0000","last_clean":"2023-07-06T01:08:53.084090+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:53.084090+0000","last_undegraded":"2023-07-06T01:08:53.084090+0000","last_fullsized":"2023-07-06T01:08:53.084090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:12.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084599+0000","last_change":"2023-07-06T01:08:51.559769+0000","last_active":"2023-07-06T01:08:53.084599+0000","last_peered":"2023-07-06T01:08:53.084599+0000","last_clean":"2023-07-06T01:08:53.084599+0000","last_became_active":"2023-07-06T01:08:51.559480+0000","last_became_peered":"2023-07-06T01:08:51.559480+0000","last_unstale":"2023-07-06T01:08:53.084599+0000","last_undegraded":"2023-07-06T01:08:53.084599+0000","last_fullsized":"2023-07-06T01:08:53.084599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084736+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:53.084736+0000","last_peered":"2023-07-06T01:08:53.084736+0000","last_clean":"2023-07-06T01:08:53.084736+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:53.084736+0000","last_undegraded":"2023-07-06T01:08:53.084736+0000","last_fullsized":"2023-07-06T01:08:53.084736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:18.979186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086793+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:53.086793+0000","last_peered":"2023-07-06T01:08:53.086793+0000","last_clean":"2023-07-06T01:08:53.086793+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:53.086793+0000","last_undegraded":"2023-07-06T01:08:53.086793+0000","last_fullsized":"2023-07-06T01:08:53.086793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:07.245265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552114+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:52.552114+0000","last_peered":"2023-07-06T01:08:52.552114+0000","last_clean":"2023-07-06T01:08:52.552114+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:52.552114+0000","last_undegraded":"2023-07-06T01:08:52.552114+0000","last_fullsized":"2023-07-06T01:08:52.552114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085655+0000","last_change":"2023-07-06T01:08:51.567558+0000","last_active":"2023-07-06T01:08:53.085655+0000","last_peered":"2023-07-06T01:08:53.085655+0000","last_clean":"2023-07-06T01:08:53.085655+0000","last_became_active":"2023-07-06T01:08:51.567124+0000","last_became_peered":"2023-07-06T01:08:51.567124+0000","last_unstale":"2023-07-06T01:08:53.085655+0000","last_undegraded":"2023-07-06T01:08:53.085655+0000","last_fullsized":"2023-07-06T01:08:53.085655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087397+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:53.087397+0000","last_peered":"2023-07-06T01:08:53.087397+0000","last_clean":"2023-07-06T01:08:53.087397+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:53.087397+0000","last_undegraded":"2023-07-06T01:08:53.087397+0000","last_fullsized":"2023-07-06T01:08:53.087397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:19.934388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550560+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:52.550560+0000","last_peered":"2023-07-06T01:08:52.550560+0000","last_clean":"2023-07-06T01:08:52.550560+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:52.550560+0000","last_undegraded":"2023-07-06T01:08:52.550560+0000","last_fullsized":"2023-07-06T01:08:52.550560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:06.882770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551120+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:52.551120+0000","last_peered":"2023-07-06T01:08:52.551120+0000","last_clean":"2023-07-06T01:08:52.551120+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:52.551120+0000","last_undegraded":"2023-07-06T01:08:52.551120+0000","last_fullsized":"2023-07-06T01:08:52.551120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087298+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:53.087298+0000","last_peered":"2023-07-06T01:08:53.087298+0000","last_clean":"2023-07-06T01:08:53.087298+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:53.087298+0000","last_undegraded":"2023-07-06T01:08:53.087298+0000","last_fullsized":"2023-07-06T01:08:53.087298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:11.979401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084458+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:53.084458+0000","last_peered":"2023-07-06T01:08:53.084458+0000","last_clean":"2023-07-06T01:08:53.084458+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:53.084458+0000","last_undegraded":"2023-07-06T01:08:53.084458+0000","last_fullsized":"2023-07-06T01:08:53.084458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550966+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:52.550966+0000","last_peered":"2023-07-06T01:08:52.550966+0000","last_clean":"2023-07-06T01:08:52.550966+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:52.550966+0000","last_undegraded":"2023-07-06T01:08:52.550966+0000","last_fullsized":"2023-07-06T01:08:52.550966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552734+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:52.552734+0000","last_peered":"2023-07-06T01:08:52.552734+0000","last_clean":"2023-07-06T01:08:52.552734+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:52.552734+0000","last_undegraded":"2023-07-06T01:08:52.552734+0000","last_fullsized":"2023-07-06T01:08:52.552734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:19.629343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084587+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:53.084587+0000","last_peered":"2023-07-06T01:08:53.084587+0000","last_clean":"2023-07-06T01:08:53.084587+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:53.084587+0000","last_undegraded":"2023-07-06T01:08:53.084587+0000","last_fullsized":"2023-07-06T01:08:53.084587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551899+0000","last_change":"2023-07-06T01:08:51.545985+0000","last_active":"2023-07-06T01:08:52.551899+0000","last_peered":"2023-07-06T01:08:52.551899+0000","last_clean":"2023-07-06T01:08:52.551899+0000","last_became_active":"2023-07-06T01:08:51.545528+0000","last_became_peered":"2023-07-06T01:08:51.545528+0000","last_unstale":"2023-07-06T01:08:52.551899+0000","last_undegraded":"2023-07-06T01:08:52.551899+0000","last_fullsized":"2023-07-06T01:08:52.551899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085152+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:53.085152+0000","last_peered":"2023-07-06T01:08:53.085152+0000","last_clean":"2023-07-06T01:08:53.085152+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:53.085152+0000","last_undegraded":"2023-07-06T01:08:53.085152+0000","last_fullsized":"2023-07-06T01:08:53.085152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:36.583295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551025+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:52.551025+0000","last_peered":"2023-07-06T01:08:52.551025+0000","last_clean":"2023-07-06T01:08:52.551025+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:52.551025+0000","last_undegraded":"2023-07-06T01:08:52.551025+0000","last_fullsized":"2023-07-06T01:08:52.551025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085799+0000","last_change":"2023-07-06T01:08:51.561799+0000","last_active":"2023-07-06T01:08:53.085799+0000","last_peered":"2023-07-06T01:08:53.085799+0000","last_clean":"2023-07-06T01:08:53.085799+0000","last_became_active":"2023-07-06T01:08:51.561471+0000","last_became_peered":"2023-07-06T01:08:51.561471+0000","last_unstale":"2023-07-06T01:08:53.085799+0000","last_undegraded":"2023-07-06T01:08:53.085799+0000","last_fullsized":"2023-07-06T01:08:53.085799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551090+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:52.551090+0000","last_peered":"2023-07-06T01:08:52.551090+0000","last_clean":"2023-07-06T01:08:52.551090+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:52.551090+0000","last_undegraded":"2023-07-06T01:08:52.551090+0000","last_fullsized":"2023-07-06T01:08:52.551090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:56.760212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083970+0000","last_change":"2023-07-06T01:08:51.545591+0000","last_active":"2023-07-06T01:08:53.083970+0000","last_peered":"2023-07-06T01:08:53.083970+0000","last_clean":"2023-07-06T01:08:53.083970+0000","last_became_active":"2023-07-06T01:08:51.545275+0000","last_became_peered":"2023-07-06T01:08:51.545275+0000","last_unstale":"2023-07-06T01:08:53.083970+0000","last_undegraded":"2023-07-06T01:08:53.083970+0000","last_fullsized":"2023-07-06T01:08:53.083970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084656+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:53.084656+0000","last_peered":"2023-07-06T01:08:53.084656+0000","last_clean":"2023-07-06T01:08:53.084656+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:53.084656+0000","last_undegraded":"2023-07-06T01:08:53.084656+0000","last_fullsized":"2023-07-06T01:08:53.084656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:25.172660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086414+0000","last_change":"2023-07-06T01:08:51.564597+0000","last_active":"2023-07-06T01:08:53.086414+0000","last_peered":"2023-07-06T01:08:53.086414+0000","last_clean":"2023-07-06T01:08:53.086414+0000","last_became_active":"2023-07-06T01:08:51.564031+0000","last_became_peered":"2023-07-06T01:08:51.564031+0000","last_unstale":"2023-07-06T01:08:53.086414+0000","last_undegraded":"2023-07-06T01:08:53.086414+0000","last_fullsized":"2023-07-06T01:08:53.086414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:30.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085851+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:53.085851+0000","last_peered":"2023-07-06T01:08:53.085851+0000","last_clean":"2023-07-06T01:08:53.085851+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:53.085851+0000","last_undegraded":"2023-07-06T01:08:53.085851+0000","last_fullsized":"2023-07-06T01:08:53.085851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086339+0000","last_change":"2023-07-06T01:08:51.564862+0000","last_active":"2023-07-06T01:08:53.086339+0000","last_peered":"2023-07-06T01:08:53.086339+0000","last_clean":"2023-07-06T01:08:53.086339+0000","last_became_active":"2023-07-06T01:08:51.564536+0000","last_became_peered":"2023-07-06T01:08:51.564536+0000","last_unstale":"2023-07-06T01:08:53.086339+0000","last_undegraded":"2023-07-06T01:08:53.086339+0000","last_fullsized":"2023-07-06T01:08:53.086339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:26.281015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552320+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:52.552320+0000","last_peered":"2023-07-06T01:08:52.552320+0000","last_clean":"2023-07-06T01:08:52.552320+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:52.552320+0000","last_undegraded":"2023-07-06T01:08:52.552320+0000","last_fullsized":"2023-07-06T01:08:52.552320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551948+0000","last_change":"2023-07-06T01:08:51.550387+0000","last_active":"2023-07-06T01:08:52.551948+0000","last_peered":"2023-07-06T01:08:52.551948+0000","last_clean":"2023-07-06T01:08:52.551948+0000","last_became_active":"2023-07-06T01:08:51.550102+0000","last_became_peered":"2023-07-06T01:08:51.550102+0000","last_unstale":"2023-07-06T01:08:52.551948+0000","last_undegraded":"2023-07-06T01:08:52.551948+0000","last_fullsized":"2023-07-06T01:08:52.551948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551140+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:52.551140+0000","last_peered":"2023-07-06T01:08:52.551140+0000","last_clean":"2023-07-06T01:08:52.551140+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:52.551140+0000","last_undegraded":"2023-07-06T01:08:52.551140+0000","last_fullsized":"2023-07-06T01:08:52.551140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:38.100545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085028+0000","last_change":"2023-07-06T01:08:51.563224+0000","last_active":"2023-07-06T01:08:53.085028+0000","last_peered":"2023-07-06T01:08:53.085028+0000","last_clean":"2023-07-06T01:08:53.085028+0000","last_became_active":"2023-07-06T01:08:51.563080+0000","last_became_peered":"2023-07-06T01:08:51.563080+0000","last_unstale":"2023-07-06T01:08:53.085028+0000","last_undegraded":"2023-07-06T01:08:53.085028+0000","last_fullsized":"2023-07-06T01:08:53.085028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085052+0000","last_change":"2023-07-06T01:08:51.543670+0000","last_active":"2023-07-06T01:08:53.085052+0000","last_peered":"2023-07-06T01:08:53.085052+0000","last_clean":"2023-07-06T01:08:53.085052+0000","last_became_active":"2023-07-06T01:08:51.542701+0000","last_became_peered":"2023-07-06T01:08:51.542701+0000","last_unstale":"2023-07-06T01:08:53.085052+0000","last_undegraded":"2023-07-06T01:08:53.085052+0000","last_fullsized":"2023-07-06T01:08:53.085052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551937+0000","last_change":"2023-07-06T01:08:51.548220+0000","last_active":"2023-07-06T01:08:52.551937+0000","last_peered":"2023-07-06T01:08:52.551937+0000","last_clean":"2023-07-06T01:08:52.551937+0000","last_became_active":"2023-07-06T01:08:51.547940+0000","last_became_peered":"2023-07-06T01:08:51.547940+0000","last_unstale":"2023-07-06T01:08:52.551937+0000","last_undegraded":"2023-07-06T01:08:52.551937+0000","last_fullsized":"2023-07-06T01:08:52.551937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086197+0000","last_change":"2023-07-06T01:08:51.561978+0000","last_active":"2023-07-06T01:08:53.086197+0000","last_peered":"2023-07-06T01:08:53.086197+0000","last_clean":"2023-07-06T01:08:53.086197+0000","last_became_active":"2023-07-06T01:08:51.561567+0000","last_became_peered":"2023-07-06T01:08:51.561567+0000","last_unstale":"2023-07-06T01:08:53.086197+0000","last_undegraded":"2023-07-06T01:08:53.086197+0000","last_fullsized":"2023-07-06T01:08:53.086197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552910+0000","last_change":"2023-07-06T01:08:51.557783+0000","last_active":"2023-07-06T01:08:52.552910+0000","last_peered":"2023-07-06T01:08:52.552910+0000","last_clean":"2023-07-06T01:08:52.552910+0000","last_became_active":"2023-07-06T01:08:51.553006+0000","last_became_peered":"2023-07-06T01:08:51.553006+0000","last_unstale":"2023-07-06T01:08:52.552910+0000","last_undegraded":"2023-07-06T01:08:52.552910+0000","last_fullsized":"2023-07-06T01:08:52.552910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084259+0000","last_change":"2023-07-06T01:08:51.554515+0000","last_active":"2023-07-06T01:08:53.084259+0000","last_peered":"2023-07-06T01:08:53.084259+0000","last_clean":"2023-07-06T01:08:53.084259+0000","last_became_active":"2023-07-06T01:08:51.554231+0000","last_became_peered":"2023-07-06T01:08:51.554231+0000","last_unstale":"2023-07-06T01:08:53.084259+0000","last_undegraded":"2023-07-06T01:08:53.084259+0000","last_fullsized":"2023-07-06T01:08:53.084259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:09:01.285 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T01:09:01.285 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-06T01:09:01.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-06T01:09:01.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-06T01:09:01.287 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-06T01:09:01.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.506+0000 7f1017bff700 1 Processor -- start 2023-07-06T01:09:01.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.506+0000 7f1017bff700 1 -- start start 2023-07-06T01:09:01.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.507+0000 7f1017bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f10100b5c90 0x7f10100d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.507+0000 7f1017bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10100b6110 0x7f10100d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.507+0000 7f1017bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100cf780 con 0x7f101015fca0 2023-07-06T01:09:01.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.507+0000 7f1017bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100cd490 con 0x7f10100b6110 2023-07-06T01:09:01.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.507+0000 7f1017bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100cd770 con 0x7f10100b5c90 2023-07-06T01:09:01.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10100b6110 0x7f10100d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f10100b6110 0x7f10100d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45310/0 (socket says 172.21.15.71:45310) 2023-07-06T01:09:01.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 -- 172.21.15.71:0/1569159585 learned_addr learned my addr 172.21.15.71:0/1569159585 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:01.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101519a700 1 --2- 172.21.15.71:0/1569159585 >> v2:172.21.15.194:3300/0 conn(0x7f10100b5c90 0x7f10100d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 -- 172.21.15.71:0/1569159585 >> v2:172.21.15.194:3300/0 conn(0x7f10100b5c90 msgr2=0x7f10100d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:01.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 --2- 172.21.15.71:0/1569159585 >> v2:172.21.15.194:3300/0 conn(0x7f10100b5c90 0x7f10100d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 -- 172.21.15.71:0/1569159585 >> v1:172.21.15.194:6789/0 conn(0x7f101015fca0 legacy=0x7f10100d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:01.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 -- 172.21.15.71:0/1569159585 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100cda50 con 0x7f10100b6110 2023-07-06T01:09:01.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f101619c700 1 --2- 172.21.15.71:0/1569159585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10100b6110 0x7f10100d3280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f101006b6f0 tx=0x7f100800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e050fd69c919f539 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.508+0000 7f1014999700 1 -- 172.21.15.71:0/1569159585 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e070 con 0x7f10100b6110 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1014999700 1 -- 172.21.15.71:0/1569159585 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008003a20 con 0x7f10100b6110 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1014999700 1 -- 172.21.15.71:0/1569159585 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008003dd0 con 0x7f10100b6110 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 -- 172.21.15.71:0/1569159585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10100b6110 msgr2=0x7f10100d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 --2- 172.21.15.71:0/1569159585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10100b6110 0x7f10100d3280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f101006b6f0 tx=0x7f100800b330 comp rx=0 tx=0).stop 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 -- 172.21.15.71:0/1569159585 shutdown_connections 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 --2- 172.21.15.71:0/1569159585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10100b6110 0x7f10100d3280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 --2- 172.21.15.71:0/1569159585 >> v2:172.21.15.194:3300/0 conn(0x7f10100b5c90 0x7f10100d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 -- 172.21.15.71:0/1569159585 >> 172.21.15.71:0/1569159585 conn(0x7f101006c150 msgr2=0x7f101006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 -- 172.21.15.71:0/1569159585 shutdown_connections 2023-07-06T01:09:01.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.509+0000 7f1017bff700 1 -- 172.21.15.71:0/1569159585 wait complete. 2023-07-06T01:09:01.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.511+0000 7f1017bff700 1 Processor -- start 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.511+0000 7f1017bff700 1 -- start start 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f1017bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10100b5c90 0x7f1010156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f1017bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10100b6110 0x7f10100c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f1017bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 0x7f101015b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f1017bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010157660 con 0x7f101015fca0 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f1017bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010158150 con 0x7f10100b5c90 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f1017bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1010158430 con 0x7f10100b6110 2023-07-06T01:09:01.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f101619c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 0x7f101015b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f101619c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 0x7f101015b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45320/0 (socket says 172.21.15.71:45320) 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.512+0000 7f101619c700 1 -- 172.21.15.71:0/2241423835 learned_addr learned my addr 172.21.15.71:0/2241423835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101599b700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10100b5c90 0x7f1010156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101519a700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10100b6110 0x7f10100c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101619c700 1 -- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10100b6110 msgr2=0x7f10100c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101619c700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10100b6110 0x7f10100c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101619c700 1 -- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10100b5c90 msgr2=0x7f1010156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101619c700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10100b5c90 0x7f1010156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101619c700 1 -- 172.21.15.71:0/2241423835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009b30 con 0x7f101015fca0 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101599b700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10100b5c90 0x7f1010156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f101619c700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 0x7f101015b8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f100800b370 tx=0x7f1008004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008004440 con 0x7f101015fca0 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10080045a0 con 0x7f101015fca0 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008004950 con 0x7f101015fca0 2023-07-06T01:09:01.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1010158710 con 0x7f101015fca0 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.513+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1010158cd0 con 0x7f101015fca0 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.514+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10100008d0 con 0x7f101015fca0 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.515+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1008012430 con 0x7f101015fca0 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.516+0000 7f10067fc700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.516+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f100808a910 con 0x7f101015fca0 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.516+0000 7f101599b700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:01.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.517+0000 7f101599b700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0ff406ace0 0x7f0ff406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f100c006fd0 tx=0x7f100c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:01.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.520+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10080559b0 con 0x7f101015fca0 2023-07-06T01:09:01.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.771+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f10100b84f0 con 0x7f101015fca0 2023-07-06T01:09:01.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.774+0000 7f10067fc700 1 -- 172.21.15.71:0/2241423835 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7f1008058fd0 con 0x7f101015fca0 2023-07-06T01:09:01.779 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0ff406ace0 msgr2=0x7f0ff406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0ff406ace0 0x7f0ff406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f100c006fd0 tx=0x7f100c008040 comp rx=0 tx=0).stop 2023-07-06T01:09:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 msgr2=0x7f101015b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 0x7f101015b8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f100800b370 tx=0x7f1008004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 shutdown_connections 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f101015fca0 0x7f101015b8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10100b5c90 0x7f1010156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 --2- 172.21.15.71:0/2241423835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10100b6110 0x7f10100c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.777+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 >> 172.21.15.71:0/2241423835 conn(0x7f101006c150 msgr2=0x7f10100b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.778+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 shutdown_connections 2023-07-06T01:09:01.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.778+0000 7f1017bff700 1 -- 172.21.15.71:0/2241423835 wait complete. 2023-07-06T01:09:01.798 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3257045375},{"type":"v1","addr":"172.21.15.194:6833","nonce":3257045375}]},"active_addr":"172.21.15.194:6833/3257045375","active_change":"2023-07-06T01:08:30.807015+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3997698401}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3726139375}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":681104290}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":1780729028}]}]} 2023-07-06T01:09:01.802 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-06T01:09:01.802 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-06T01:09:01.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:01.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.994+0000 7f6c6d1ff700 1 Processor -- start 2023-07-06T01:09:01.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.994+0000 7f6c6d1ff700 1 -- start start 2023-07-06T01:09:02.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.995+0000 7f6c6d1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c680b5c90 0x7f6c680d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.995+0000 7f6c6d1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c680b60e0 0x7f6c680d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.995+0000 7f6c6d1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c680cf780 con 0x7f6c6815fca0 2023-07-06T01:09:02.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6d1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c680cd490 con 0x7f6c680b60e0 2023-07-06T01:09:02.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6d1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680cd770 con 0x7f6c680b5c90 2023-07-06T01:09:02.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c680b60e0 0x7f6c680d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c66d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6c6815fca0 0x7f6c680d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57640/0 (socket says 172.21.15.71:57640) 2023-07-06T01:09:02.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c66d9d700 1 -- 172.21.15.71:0/229559898 learned_addr learned my addr 172.21.15.71:0/229559898 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:02.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6659c700 1 --2- 172.21.15.71:0/229559898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c680b5c90 0x7f6c680d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6759e700 1 -- 172.21.15.71:0/229559898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c680b5c90 msgr2=0x7f6c680d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6759e700 1 --2- 172.21.15.71:0/229559898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c680b5c90 0x7f6c680d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6759e700 1 -- 172.21.15.71:0/229559898 >> v1:172.21.15.71:6789/0 conn(0x7f6c6815fca0 legacy=0x7f6c680d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c6759e700 1 -- 172.21.15.71:0/229559898 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680cda50 con 0x7f6c680b60e0 2023-07-06T01:09:02.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.996+0000 7f6c65d9b700 1 -- 172.21.15.71:0/229559898 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820938763 0 0) 0x7f6c680cf780 con 0x7f6c6815fca0 2023-07-06T01:09:02.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6759e700 1 --2- 172.21.15.71:0/229559898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b60e0 0x7f6c680d3280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c550f05b773a8f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:02.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c65d9b700 1 -- 172.21.15.71:0/229559898 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000e070 con 0x7f6c680b60e0 2023-07-06T01:09:02.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c65d9b700 1 -- 172.21.15.71:0/229559898 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6000bbd0 con 0x7f6c680b60e0 2023-07-06T01:09:02.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c65d9b700 1 -- 172.21.15.71:0/229559898 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60012430 con 0x7f6c680b60e0 2023-07-06T01:09:02.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/229559898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b60e0 msgr2=0x7f6c680d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/229559898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b60e0 0x7f6c680d3280 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:02.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/229559898 shutdown_connections 2023-07-06T01:09:02.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/229559898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b60e0 0x7f6c680d3280 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/229559898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c680b5c90 0x7f6c680d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/229559898 >> 172.21.15.71:0/229559898 conn(0x7f6c6806c150 msgr2=0x7f6c6806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:02.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.997+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/229559898 shutdown_connections 2023-07-06T01:09:02.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.998+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/229559898 wait complete. 2023-07-06T01:09:02.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.999+0000 7f6c6d1ff700 1 Processor -- start 2023-07-06T01:09:02.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:01.999+0000 7f6c6d1ff700 1 -- start start 2023-07-06T01:09:02.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c6d1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 0x7f6c6815a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c6d1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c680b60e0 0x7f6c68160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c6d1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c6815fca0 0x7f6c681605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c6d1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6815e400 con 0x7f6c680b5c90 2023-07-06T01:09:02.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c6d1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6815e6a0 con 0x7f6c680b60e0 2023-07-06T01:09:02.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c6d1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6815e980 con 0x7f6c6815fca0 2023-07-06T01:09:02.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c66d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 0x7f6c6815a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c66d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 0x7f6c6815a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45344/0 (socket says 172.21.15.71:45344) 2023-07-06T01:09:02.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.000+0000 7f6c66d9d700 1 -- 172.21.15.71:0/4060679116 learned_addr learned my addr 172.21.15.71:0/4060679116 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:02.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c6759e700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c6815fca0 0x7f6c681605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c6659c700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c680b60e0 0x7f6c68160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c66d9d700 1 -- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c6815fca0 msgr2=0x7f6c681605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c66d9d700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c6815fca0 0x7f6c681605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c66d9d700 1 -- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c680b60e0 msgr2=0x7f6c68160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c66d9d700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c680b60e0 0x7f6c68160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c66d9d700 1 -- 172.21.15.71:0/4060679116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009a70 con 0x7f6c680b5c90 2023-07-06T01:09:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c66d9d700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 0x7f6c6815a450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800c550 tx=0x7f6c5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:02.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58004c80 con 0x7f6c680b5c90 2023-07-06T01:09:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58004e00 con 0x7f6c680b5c90 2023-07-06T01:09:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58007310 con 0x7f6c680b5c90 2023-07-06T01:09:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.001+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6815ec60 con 0x7f6c680b5c90 2023-07-06T01:09:02.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.002+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6815f220 con 0x7f6c680b5c90 2023-07-06T01:09:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.003+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c680008d0 con 0x7f6c680b5c90 2023-07-06T01:09:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.003+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c58007470 con 0x7f6c680b5c90 2023-07-06T01:09:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.004+0000 7f6c4f7fe700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6c5406ace0 0x7f6c5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.004+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c58089150 con 0x7f6c680b5c90 2023-07-06T01:09:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.005+0000 7f6c6659c700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6c5406ace0 0x7f6c5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.005+0000 7f6c6659c700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6c5406ace0 0x7f6c5406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c6815d960 tx=0x7f6c5c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:02.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.009+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c58054200 con 0x7f6c680b5c90 2023-07-06T01:09:02.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.205+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c6815f410 con 0x7f6c680b5c90 2023-07-06T01:09:02.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.207+0000 7f6c4f7fe700 1 -- 172.21.15.71:0/4060679116 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f6c58057820 con 0x7f6c680b5c90 2023-07-06T01:09:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:02.210 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6c5406ace0 msgr2=0x7f6c5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6c5406ace0 0x7f6c5406d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c6815d960 tx=0x7f6c5c008040 comp rx=0 tx=0).stop 2023-07-06T01:09:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 msgr2=0x7f6c6815a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 0x7f6c6815a450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800c550 tx=0x7f6c5800c910 comp rx=0 tx=0).stop 2023-07-06T01:09:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 shutdown_connections 2023-07-06T01:09:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6c5406ace0 0x7f6c5406d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c6815fca0 0x7f6c681605b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c680b5c90 0x7f6c6815a450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 --2- 172.21.15.71:0/4060679116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c680b60e0 0x7f6c68160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 >> 172.21.15.71:0/4060679116 conn(0x7f6c6806c150 msgr2=0x7f6c680b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:02.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 shutdown_connections 2023-07-06T01:09:02.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.209+0000 7f6c6d1ff700 1 -- 172.21.15.71:0/4060679116 wait complete. 2023-07-06T01:09:02.230 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-06T01:09:02.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:02.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.421+0000 7f35dbfff700 1 Processor -- start 2023-07-06T01:09:02.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.421+0000 7f35dbfff700 1 -- start start 2023-07-06T01:09:02.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35dbfff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f35d415fca0 0x7f35d40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b6110 0x7f35d40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35dbfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40cf780 con 0x7f35d40b5c90 2023-07-06T01:09:02.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35dbfff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40cd490 con 0x7f35d415fca0 2023-07-06T01:09:02.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35dbfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40cd770 con 0x7f35d40b6110 2023-07-06T01:09:02.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35d959a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f35d40b5c90 0x7f35d40d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57656/0 (socket says 172.21.15.71:57656) 2023-07-06T01:09:02.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35d959a700 1 -- 172.21.15.71:0/3044392687 learned_addr learned my addr 172.21.15.71:0/3044392687 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:02.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35d9d9b700 1 --2- 172.21.15.71:0/3044392687 >> v2:172.21.15.194:3300/0 conn(0x7f35d415fca0 0x7f35d40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.422+0000 7f35da59c700 1 --2- 172.21.15.71:0/3044392687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b6110 0x7f35d40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35d8d99700 1 -- 172.21.15.71:0/3044392687 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838183804 0 0) 0x7f35d40cf780 con 0x7f35d40b5c90 2023-07-06T01:09:02.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35d8d99700 1 -- 172.21.15.71:0/3044392687 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c00035b0 con 0x7f35d40b5c90 2023-07-06T01:09:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35da59c700 1 -- 172.21.15.71:0/3044392687 >> v2:172.21.15.194:3300/0 conn(0x7f35d415fca0 msgr2=0x7f35d40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35da59c700 1 --2- 172.21.15.71:0/3044392687 >> v2:172.21.15.194:3300/0 conn(0x7f35d415fca0 0x7f35d40d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35da59c700 1 -- 172.21.15.71:0/3044392687 >> v1:172.21.15.71:6789/0 conn(0x7f35d40b5c90 legacy=0x7f35d40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35da59c700 1 -- 172.21.15.71:0/3044392687 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40cda50 con 0x7f35d40b6110 2023-07-06T01:09:02.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35d9d9b700 1 --2- 172.21.15.71:0/3044392687 >> v2:172.21.15.194:3300/0 conn(0x7f35d415fca0 0x7f35d40d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:02.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35da59c700 1 --2- 172.21.15.71:0/3044392687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b6110 0x7f35d40cfc10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009d90 tx=0x7f35cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f4e767db3511c30 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:02.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35d8d99700 1 -- 172.21.15.71:0/3044392687 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00e070 con 0x7f35d40b6110 2023-07-06T01:09:02.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35d8d99700 1 -- 172.21.15.71:0/3044392687 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc00bb20 con 0x7f35d40b6110 2023-07-06T01:09:02.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.423+0000 7f35d8d99700 1 -- 172.21.15.71:0/3044392687 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc012430 con 0x7f35d40b6110 2023-07-06T01:09:02.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 -- 172.21.15.71:0/3044392687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b6110 msgr2=0x7f35d40cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3044392687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b6110 0x7f35d40cfc10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009d90 tx=0x7f35cc00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:02.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 -- 172.21.15.71:0/3044392687 shutdown_connections 2023-07-06T01:09:02.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3044392687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b6110 0x7f35d40cfc10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3044392687 >> v2:172.21.15.194:3300/0 conn(0x7f35d415fca0 0x7f35d40d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 -- 172.21.15.71:0/3044392687 >> 172.21.15.71:0/3044392687 conn(0x7f35d406c150 msgr2=0x7f35d406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:02.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 -- 172.21.15.71:0/3044392687 shutdown_connections 2023-07-06T01:09:02.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.424+0000 7f35dbfff700 1 -- 172.21.15.71:0/3044392687 wait complete. 2023-07-06T01:09:02.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.426+0000 7f35dbfff700 1 Processor -- start 2023-07-06T01:09:02.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.426+0000 7f35dbfff700 1 -- start start 2023-07-06T01:09:02.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b5c90 0x7f35d40c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35d40b6110 0x7f35d4153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 0x7f35d40d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35dbfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40b3040 con 0x7f35d415fca0 2023-07-06T01:09:02.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35dbfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41f1c60 con 0x7f35d40b6110 2023-07-06T01:09:02.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35dbfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c8c50 con 0x7f35d40b5c90 2023-07-06T01:09:02.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35da59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 0x7f35d40d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35da59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 0x7f35d40d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:45360/0 (socket says 172.21.15.71:45360) 2023-07-06T01:09:02.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35da59c700 1 -- 172.21.15.71:0/3468628507 learned_addr learned my addr 172.21.15.71:0/3468628507 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:02.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35d9d9b700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b5c90 0x7f35d40c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35d959a700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35d40b6110 0x7f35d4153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35da59c700 1 -- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b5c90 msgr2=0x7f35d40c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35da59c700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b5c90 0x7f35d40c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.427+0000 7f35da59c700 1 -- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35d40b6110 msgr2=0x7f35d4153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35da59c700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35d40b6110 0x7f35d4153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35da59c700 1 -- 172.21.15.71:0/3468628507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00094a0 con 0x7f35d415fca0 2023-07-06T01:09:02.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35da59c700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 0x7f35d40d2b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35cc014040 tx=0x7f35cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:02.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0129f0 con 0x7f35d415fca0 2023-07-06T01:09:02.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc020070 con 0x7f35d415fca0 2023-07-06T01:09:02.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc012db0 con 0x7f35d415fca0 2023-07-06T01:09:02.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc009a70 con 0x7f35d415fca0 2023-07-06T01:09:02.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.428+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40b29f0 con 0x7f35d415fca0 2023-07-06T01:09:02.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.429+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d415ef20 con 0x7f35d415fca0 2023-07-06T01:09:02.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.430+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35cc004040 con 0x7f35d415fca0 2023-07-06T01:09:02.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.431+0000 7f35ca7fc700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f35b806ace0 0x7f35b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:02.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.431+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35cc022070 con 0x7f35d415fca0 2023-07-06T01:09:02.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.431+0000 7f35d9d9b700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f35b806ace0 0x7f35b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:02.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.432+0000 7f35d9d9b700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f35b806ace0 0x7f35b806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009b80 tx=0x7f35d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:02.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.435+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35cc056250 con 0x7f35d415fca0 2023-07-06T01:09:02.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.632+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35d4067000 con 0x7f35d415fca0 2023-07-06T01:09:02.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.633+0000 7f35ca7fc700 1 -- 172.21.15.71:0/3468628507 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f35cc02c090 con 0x7f35d415fca0 2023-07-06T01:09:02.637 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:02.637 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:02.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f35b806ace0 msgr2=0x7f35b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f35b806ace0 0x7f35b806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009b80 tx=0x7f35d0008040 comp rx=0 tx=0).stop 2023-07-06T01:09:02.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 msgr2=0x7f35d40d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:02.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 0x7f35d40d2b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35cc014040 tx=0x7f35cc004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 shutdown_connections 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f35b806ace0 0x7f35b806d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35d415fca0 0x7f35d40d2b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35d40b5c90 0x7f35d40c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 --2- 172.21.15.71:0/3468628507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35d40b6110 0x7f35d4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 >> 172.21.15.71:0/3468628507 conn(0x7f35d406c150 msgr2=0x7f35d40cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:02.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 shutdown_connections 2023-07-06T01:09:02.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:02.636+0000 7f35dbfff700 1 -- 172.21.15.71:0/3468628507 wait complete. 2023-07-06T01:09:02.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-06T01:09:02.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-06T01:09:02.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-06T01:09:02.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-06T01:09:02.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-06T01:09:02.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-06T01:09:02.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-06T01:09:02.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-06T01:09:03.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.008+0000 7f04273ff700 1 Processor -- start 2023-07-06T01:09:03.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.011+0000 7f82d81ff700 1 Processor -- start 2023-07-06T01:09:03.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.008+0000 7f04273ff700 1 -- start start 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.010+0000 7f04273ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 0x7f042006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.011+0000 7f04273ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042006feb0 con 0x7f04200b0b50 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.011+0000 7f04273ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042006c780 con 0x7f04201589e0 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.011+0000 7f04273ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042006c4a0 con 0x7f0420158610 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.011+0000 7f042519b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 0x7f042006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.012+0000 7f042519b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 0x7f042006bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:41868/0 (socket says 172.21.15.71:41868) 2023-07-06T01:09:03.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.012+0000 7f042519b700 1 -- 172.21.15.71:0/542367630 learned_addr learned my addr 172.21.15.71:0/542367630 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.011+0000 7f82d81ff700 1 -- start start 2023-07-06T01:09:03.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f82d81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d0160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f82d81ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f82d00cd3e0 0x7f82d00b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f82d81ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d00ce480 con 0x7f82d00b4810 2023-07-06T01:09:03.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f82d81ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d0161180 con 0x7f82d00cd3e0 2023-07-06T01:09:03.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f82d81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00b8b10 con 0x7f82d0160870 2023-07-06T01:09:03.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d0160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d0160c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:41878/0 (socket says 172.21.15.71:41878) 2023-07-06T01:09:03.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 -- 172.21.15.71:0/3460667619 learned_addr learned my addr 172.21.15.71:0/3460667619 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.012+0000 7f05ef1ff700 1 Processor -- start 2023-07-06T01:09:03.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.012+0000 7f05ef1ff700 1 -- start start 2023-07-06T01:09:03.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f05ef1ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05e8160900 0x7f05e806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f05ef1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8164530 0x7f05e80adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f05ef1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f05e80b0440 0x7f05e80b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f05ef1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80b0dd0 con 0x7f05e80b0440 2023-07-06T01:09:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f05ef1ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80cc3b0 con 0x7f05e8160900 2023-07-06T01:09:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f05ef1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81649f0 con 0x7f05e8164530 2023-07-06T01:09:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f05ecf9b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05e8160900 0x7f05e806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f05ecf9b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05e8160900 0x7f05e806b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60788/0 (socket says 172.21.15.71:60788) 2023-07-06T01:09:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f05ecf9b700 1 -- 172.21.15.71:0/602359343 learned_addr learned my addr 172.21.15.71:0/602359343 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f042519b700 1 -- 172.21.15.71:0/542367630 >> v1:172.21.15.194:6789/0 conn(0x7f04201589e0 legacy=0x7f04200b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f042519b700 1 -- 172.21.15.71:0/542367630 >> v1:172.21.15.71:6789/0 conn(0x7f04200b0b50 legacy=0x7f0420070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.014+0000 7f042519b700 1 -- 172.21.15.71:0/542367630 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042006f860 con 0x7f0420158610 2023-07-06T01:09:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 -- 172.21.15.71:0/3460667619 >> v2:172.21.15.194:3300/0 conn(0x7f82d00cd3e0 msgr2=0x7f82d00b5d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T01:09:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 --2- 172.21.15.71:0/3460667619 >> v2:172.21.15.194:3300/0 conn(0x7f82d00cd3e0 0x7f82d00b5d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 -- 172.21.15.71:0/3460667619 >> v1:172.21.15.194:6789/0 conn(0x7f82d00b4810 legacy=0x7f82d00d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.015+0000 7f82d5f9b700 1 -- 172.21.15.71:0/3460667619 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00b62b0 con 0x7f82d0160870 2023-07-06T01:09:03.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f82d5f9b700 1 --2- 172.21.15.71:0/3460667619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d0160c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e50 tx=0x7f82c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be42a1cf182fc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f05ecf9b700 1 -- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8164530 msgr2=0x7f05e80adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f05ecf9b700 1 --2- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8164530 0x7f05e80adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f05ecf9b700 1 -- 172.21.15.71:0/602359343 >> v2:172.21.15.71:3300/0 conn(0x7f05e80b0440 msgr2=0x7f05e80b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f05ecf9b700 1 --2- 172.21.15.71:0/602359343 >> v2:172.21.15.71:3300/0 conn(0x7f05e80b0440 0x7f05e80b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f05ecf9b700 1 -- 172.21.15.71:0/602359343 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8164cd0 con 0x7f05e8160900 2023-07-06T01:09:03.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f05ecf9b700 1 --2- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e8160900 0x7f05e806b220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05e806f2a0 tx=0x7f05e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7bdff95b6b81af7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f042519b700 1 --2- 172.21.15.71:0/542367630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 0x7f042006bc30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f041c008920 tx=0x7f041c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f8fe8044353c0d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.016+0000 7f0417fff700 1 -- 172.21.15.71:0/542367630 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c010070 con 0x7f0420158610 2023-07-06T01:09:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f0417fff700 1 -- 172.21.15.71:0/542367630 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00da40 con 0x7f0420158610 2023-07-06T01:09:03.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f0417fff700 1 -- 172.21.15.71:0/542367630 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00ddd0 con 0x7f0420158610 2023-07-06T01:09:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f05e77fe700 1 -- 172.21.15.71:0/602359343 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000e070 con 0x7f05e8160900 2023-07-06T01:09:03.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f05e77fe700 1 -- 172.21.15.71:0/602359343 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000b9c0 con 0x7f05e8160900 2023-07-06T01:09:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f05e77fe700 1 -- 172.21.15.71:0/602359343 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000bd50 con 0x7f05e8160900 2023-07-06T01:09:03.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f82d4f99700 1 -- 172.21.15.71:0/3460667619 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c800e070 con 0x7f82d0160870 2023-07-06T01:09:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f82d4f99700 1 -- 172.21.15.71:0/3460667619 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8003a20 con 0x7f82d0160870 2023-07-06T01:09:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.017+0000 7f82d4f99700 1 -- 172.21.15.71:0/3460667619 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c8003dd0 con 0x7f82d0160870 2023-07-06T01:09:03.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f82d81ff700 1 -- 172.21.15.71:0/3460667619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 msgr2=0x7f82d0160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f82d81ff700 1 --2- 172.21.15.71:0/3460667619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d0160c40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e50 tx=0x7f82c800b330 comp rx=0 tx=0).stop 2023-07-06T01:09:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 -- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e8160900 msgr2=0x7f05e806b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e8160900 0x7f05e806b220 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05e806f2a0 tx=0x7f05e000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 -- 172.21.15.71:0/602359343 shutdown_connections 2023-07-06T01:09:03.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/602359343 >> v2:172.21.15.71:3300/0 conn(0x7f05e80b0440 0x7f05e80b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e8160900 0x7f05e806b220 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/602359343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8164530 0x7f05e80adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f05ef1ff700 1 -- 172.21.15.71:0/602359343 >> 172.21.15.71:0/602359343 conn(0x7f05e80cb440 msgr2=0x7f05e80cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f04273ff700 1 -- 172.21.15.71:0/542367630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 msgr2=0x7f042006bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f04273ff700 1 --2- 172.21.15.71:0/542367630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 0x7f042006bc30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f041c008920 tx=0x7f041c00d330 comp rx=0 tx=0).stop 2023-07-06T01:09:03.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f82d81ff700 1 -- 172.21.15.71:0/3460667619 shutdown_connections 2023-07-06T01:09:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f82d81ff700 1 --2- 172.21.15.71:0/3460667619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d0160c40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.018+0000 7f82d81ff700 1 --2- 172.21.15.71:0/3460667619 >> v2:172.21.15.194:3300/0 conn(0x7f82d00cd3e0 0x7f82d00b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.019+0000 7f82d81ff700 1 -- 172.21.15.71:0/3460667619 >> 172.21.15.71:0/3460667619 conn(0x7f82d00cf810 msgr2=0x7f82d00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.019+0000 7f05ef1ff700 1 -- 172.21.15.71:0/602359343 shutdown_connections 2023-07-06T01:09:03.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.019+0000 7f05ef1ff700 1 -- 172.21.15.71:0/602359343 wait complete. 2023-07-06T01:09:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.019+0000 7f04273ff700 1 -- 172.21.15.71:0/542367630 shutdown_connections 2023-07-06T01:09:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.019+0000 7f04273ff700 1 --2- 172.21.15.71:0/542367630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0420158610 0x7f042006bc30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.019+0000 7f04273ff700 1 -- 172.21.15.71:0/542367630 >> 172.21.15.71:0/542367630 conn(0x7f04200cb440 msgr2=0x7f04200cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.020+0000 7f04273ff700 1 -- 172.21.15.71:0/542367630 shutdown_connections 2023-07-06T01:09:03.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.021+0000 7f82d81ff700 1 -- 172.21.15.71:0/3460667619 shutdown_connections 2023-07-06T01:09:03.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.021+0000 7f05ef1ff700 1 Processor -- start 2023-07-06T01:09:03.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.022+0000 7f05ef1ff700 1 -- start start 2023-07-06T01:09:03.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f05ef1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80b0440 0x7f05e81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f05ef1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8160900 0x7f05e8154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f05ef1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05e8164530 0x7f05e81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f05ef1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81523a0 con 0x7f05e8164530 2023-07-06T01:09:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f05ef1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8151720 con 0x7f05e80b0440 2023-07-06T01:09:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f05ef1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8151a00 con 0x7f05e8160900 2023-07-06T01:09:03.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.020+0000 7f04273ff700 1 -- 172.21.15.71:0/542367630 wait complete. 2023-07-06T01:09:03.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f04273ff700 1 Processor -- start 2023-07-06T01:09:03.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.021+0000 7f8d105ff700 1 Processor -- start 2023-07-06T01:09:03.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f05ecf9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80b0440 0x7f05e81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f05ecf9b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80b0440 0x7f05e81508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60802/0 (socket says 172.21.15.71:60802) 2023-07-06T01:09:03.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f05ecf9b700 1 -- 172.21.15.71:0/3627310801 learned_addr learned my addr 172.21.15.71:0/3627310801 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.021+0000 7f8d105ff700 1 -- start start 2023-07-06T01:09:03.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f8d105ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8d08160900 0x7f8d0806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f8d105ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d080cc3b0 con 0x7f8d08164530 2023-07-06T01:09:03.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f8d105ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d081649f0 con 0x7f8d080b0440 2023-07-06T01:09:03.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.023+0000 7f8d105ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08164cd0 con 0x7f8d08160900 2023-07-06T01:09:03.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.022+0000 7f82d81ff700 1 -- 172.21.15.71:0/3460667619 wait complete. 2023-07-06T01:09:03.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f05e7fff700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8160900 0x7f05e8154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f8d0eb9c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8d080b0440 0x7f8d080ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44752/0 (socket says 172.21.15.71:44752) 2023-07-06T01:09:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f8d0eb9c700 1 -- 172.21.15.71:0/2199156117 learned_addr learned my addr 172.21.15.71:0/2199156117 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.024+0000 7f05ed79c700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05e8164530 0x7f05e81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f05ecf9b700 1 -- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8160900 msgr2=0x7f05e8154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f05ecf9b700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e8160900 0x7f05e8154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f05ecf9b700 1 -- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05e8164530 msgr2=0x7f05e81551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f05ecf9b700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05e8164530 0x7f05e81551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f05ecf9b700 1 -- 172.21.15.71:0/3627310801 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0009b30 con 0x7f05e80b0440 2023-07-06T01:09:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f82d81ff700 1 Processor -- start 2023-07-06T01:09:03.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f8d0e39b700 1 --2- 172.21.15.71:0/2199156117 >> v2:172.21.15.194:3300/0 conn(0x7f8d08160900 0x7f8d0806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f05ecf9b700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80b0440 0x7f05e81508a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f80 tx=0x7f05e0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0004390 con 0x7f05e80b0440 2023-07-06T01:09:03.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29644511 0 0) 0x7f8d080cc3b0 con 0x7f8d08164530 2023-07-06T01:09:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf00035b0 con 0x7f8d08164530 2023-07-06T01:09:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589850752 0 0) 0x7f8d081649f0 con 0x7f8d080b0440 2023-07-06T01:09:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d080cc3b0 con 0x7f8d080b0440 2023-07-06T01:09:03.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e00044f0 con 0x7f05e80b0440 2023-07-06T01:09:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00048a0 con 0x7f05e80b0440 2023-07-06T01:09:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8151ce0 con 0x7f05e80b0440 2023-07-06T01:09:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e81513d0 con 0x7f05e80b0440 2023-07-06T01:09:03.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.025+0000 7f82d81ff700 1 -- start start 2023-07-06T01:09:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464166406 0 0) 0x7f8cf00035b0 con 0x7f8d08164530 2023-07-06T01:09:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 >> v2:172.21.15.194:3300/0 conn(0x7f8d08160900 msgr2=0x7f8d0806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 --2- 172.21.15.71:0/2199156117 >> v2:172.21.15.194:3300/0 conn(0x7f8d08160900 0x7f8d0806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 >> v1:172.21.15.194:6789/0 conn(0x7f8d080b0440 legacy=0x7f8d080ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08164fb0 con 0x7f8d08164530 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f8cfc0019f0 con 0x7f8d08164530 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 >> v1:172.21.15.71:6789/0 conn(0x7f8d08164530 legacy=0x7f8d080adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf0004bf0 0x7f8cf0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf00037f0 0x7f8cf0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf00041a0 0x7f8cf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08164cd0 con 0x7f8cf00041a0 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf000c060 con 0x7f8cf00037f0 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.026+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf000c220 con 0x7f8cf0004bf0 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.027+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf00037f0 0x7f8cf0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.027+0000 7f8d0e39b700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf0004bf0 0x7f8cf0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.027+0000 7f8d0eb9c700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf00041a0 0x7f8cf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f8d0db9a700 1 -- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf0004bf0 msgr2=0x7f8cf0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf0004bf0 0x7f8cf0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f8d0db9a700 1 -- 172.21.15.71:0/2199156117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf00041a0 msgr2=0x7f8cf000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf00041a0 0x7f8cf000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f8d0db9a700 1 -- 172.21.15.71:0/2199156117 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08164fb0 con 0x7f8cf00037f0 2023-07-06T01:09:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f8d0eb9c700 1 -- 172.21.15.71:0/2199156117 reap_dead start 2023-07-06T01:09:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f82d81ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00b4810 0x7f82d015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f82d81ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d00cd3e0 0x7f82d00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f82d81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d00c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f82d81ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c3630 con 0x7f82d00b4810 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f82d81ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c8ea0 con 0x7f82d00cd3e0 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f82d81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00c3880 con 0x7f82d0160870 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d00cd3e0 0x7f82d00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d00cd3e0 0x7f82d00c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60852/0 (socket says 172.21.15.71:60852) 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 -- 172.21.15.71:0/1997876328 learned_addr learned my addr 172.21.15.71:0/1997876328 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d5f9b700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00b4810 0x7f82d015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d679c700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d00c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05c4000fc0 con 0x7f05e80b0440 2023-07-06T01:09:03.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.027+0000 7f04273ff700 1 -- start start 2023-07-06T01:09:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f04273ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04200b0b50 0x7f0420201fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f04273ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420158610 0x7f04201fe250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f04273ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04201589e0 0x7f0420070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f04273ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200c6f50 con 0x7f04200b0b50 2023-07-06T01:09:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f04273ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420202500 con 0x7f0420158610 2023-07-06T01:09:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.028+0000 7f04273ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04200c6c00 con 0x7f04201589e0 2023-07-06T01:09:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f042499a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420158610 0x7f04201fe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f042499a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420158610 0x7f04201fe250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60842/0 (socket says 172.21.15.71:60842) 2023-07-06T01:09:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f042499a700 1 -- 172.21.15.71:0/2129095568 learned_addr learned my addr 172.21.15.71:0/2129095568 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.029+0000 7f042599c700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04201589e0 0x7f0420070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f042499a700 1 -- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04201589e0 msgr2=0x7f0420070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f042499a700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04201589e0 0x7f0420070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f042499a700 1 -- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04200b0b50 msgr2=0x7f0420201fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f042499a700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04200b0b50 0x7f0420201fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f042499a700 1 -- 172.21.15.71:0/2129095568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0085d0 con 0x7f0420158610 2023-07-06T01:09:03.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 -- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 msgr2=0x7f82d00c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82d0160870 0x7f82d00c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 -- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00b4810 msgr2=0x7f82d015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f82d00b4810 0x7f82d015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f82d579a700 1 -- 172.21.15.71:0/1997876328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c8009b30 con 0x7f82d00cd3e0 2023-07-06T01:09:03.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f82d579a700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d00cd3e0 0x7f82d00c4920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00b550 tx=0x7f82cc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc011830 con 0x7f82d00cd3e0 2023-07-06T01:09:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0119b0 con 0x7f82d00cd3e0 2023-07-06T01:09:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc011d60 con 0x7f82d00cd3e0 2023-07-06T01:09:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05e001c440 con 0x7f05e80b0440 2023-07-06T01:09:03.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.032+0000 7f05e57fa700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f05cc06ad80 0x7f05cc06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.032+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05e008adf0 con 0x7f05e80b0440 2023-07-06T01:09:03.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f05e57fa700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f05cc073630 0x7f05cc075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 --> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05cc0760f0 con 0x7f05cc073630 2023-07-06T01:09:03.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05e008b1a0 con 0x7f05e80b0440 2023-07-06T01:09:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f05e7fff700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f05cc06ad80 0x7f05cc06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f05ed79c700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f05cc073630 0x7f05cc075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f042499a700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420158610 0x7f04201fe250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f041000c4b0 tx=0x7f041000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100052d0 con 0x7f0420158610 2023-07-06T01:09:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410005430 con 0x7f0420158610 2023-07-06T01:09:03.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100038c0 con 0x7f0420158610 2023-07-06T01:09:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04202027a0 con 0x7f0420158610 2023-07-06T01:09:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420202d60 con 0x7f0420158610 2023-07-06T01:09:03.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0400000fc0 con 0x7f0420158610 2023-07-06T01:09:03.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf00037f0 0x7f8cf0003c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d080ae3f0 tx=0x7f8cf0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a8b6026beaadcd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012620 con 0x7f8cf00037f0 2023-07-06T01:09:03.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc012780 con 0x7f8cf00037f0 2023-07-06T01:09:03.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7f8d0d399700 1 -- 172.21.15.71:0/2199156117 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012b30 con 0x7f8cf00037f0 2023-07-06T01:09:03.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.032+0000 7f8d105ff700 1 -- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf00037f0 msgr2=0x7f8cf0003c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.032+0000 7f8d105ff700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf00037f0 0x7f8cf0003c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8d080ae3f0 tx=0x7f8cf0005880 comp rx=0 tx=0).stop 2023-07-06T01:09:03.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.030+0000 7fd57c1ff700 1 Processor -- start 2023-07-06T01:09:03.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.031+0000 7fd57c1ff700 1 -- start start 2023-07-06T01:09:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.032+0000 7fd57c1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 0x7fd5740d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7fd57c1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd574155220 con 0x7fd57406f9e0 2023-07-06T01:09:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7fd57c1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57415bce0 con 0x7fd5740d1080 2023-07-06T01:09:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7fd57c1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57406fe00 con 0x7fd574154e50 2023-07-06T01:09:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f8d105ff700 1 -- 172.21.15.71:0/2199156117 shutdown_connections 2023-07-06T01:09:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f8d105ff700 1 --2- 172.21.15.71:0/2199156117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf00037f0 0x7f8cf0003c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.033+0000 7f8d105ff700 1 -- 172.21.15.71:0/2199156117 >> 172.21.15.71:0/2199156117 conn(0x7f8d080cb440 msgr2=0x7f8d080cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d00c3b60 con 0x7f82d00cd3e0 2023-07-06T01:09:03.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7fd579f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 0x7fd5740d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7fd579f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 0x7fd5740d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:41924/0 (socket says 172.21.15.71:41924) 2023-07-06T01:09:03.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7fd579f9b700 1 -- 172.21.15.71:0/1050591941 learned_addr learned my addr 172.21.15.71:0/1050591941 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7faa09dff700 1 Processor -- start 2023-07-06T01:09:03.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d00c4120 con 0x7f82d00cd3e0 2023-07-06T01:09:03.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7f8d105ff700 1 -- 172.21.15.71:0/2199156117 shutdown_connections 2023-07-06T01:09:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7fd579f9b700 1 -- 172.21.15.71:0/1050591941 >> v1:172.21.15.194:6789/0 conn(0x7fd5740d1080 legacy=0x7fd57406f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7fd579f9b700 1 -- 172.21.15.71:0/1050591941 >> v1:172.21.15.71:6789/0 conn(0x7fd57406f9e0 legacy=0x7fd5740cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7fd579f9b700 1 -- 172.21.15.71:0/1050591941 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740ceab0 con 0x7fd574154e50 2023-07-06T01:09:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.035+0000 7fd579f9b700 1 --2- 172.21.15.71:0/1050591941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 0x7fd5740d0b40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd570009920 tx=0x7fd570009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=114b099765999faf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.035+0000 7fd578f99700 1 -- 172.21.15.71:0/1050591941 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570004230 con 0x7fd574154e50 2023-07-06T01:09:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7fd578f99700 1 -- 172.21.15.71:0/1050591941 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570004390 con 0x7fd574154e50 2023-07-06T01:09:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7fd578f99700 1 -- 172.21.15.71:0/1050591941 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570009e70 con 0x7fd574154e50 2023-07-06T01:09:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7f90c2fff700 1 Processor -- start 2023-07-06T01:09:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7faa09dff700 1 -- start start 2023-07-06T01:09:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7faa09dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa040caeb0 0x7faa04158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7faa09dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0406feb0 con 0x7faa04071350 2023-07-06T01:09:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7faa09dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0406c780 con 0x7faa040cbf50 2023-07-06T01:09:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7faa09dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0406f860 con 0x7faa040caeb0 2023-07-06T01:09:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.034+0000 7f8d105ff700 1 -- 172.21.15.71:0/2199156117 wait complete. 2023-07-06T01:09:03.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7f90c2fff700 1 -- start start 2023-07-06T01:09:03.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7faa037fe700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7faa040cbf50 0x7faa0415cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44772/0 (socket says 172.21.15.71:44772) 2023-07-06T01:09:03.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7faa037fe700 1 -- 172.21.15.71:0/1787790860 learned_addr learned my addr 172.21.15.71:0/1787790860 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:03.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82d00cdb50 con 0x7f82d00cd3e0 2023-07-06T01:09:03.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7faa03fff700 1 --2- 172.21.15.71:0/1787790860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa040caeb0 0x7faa04158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.038+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82cc01a400 con 0x7f82d00cd3e0 2023-07-06T01:09:03.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.035+0000 7f05ed79c700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f05cc073630 0x7f05cc075a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.036+0000 7f05e7fff700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f05cc06ad80 0x7f05cc06d230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05e80cae00 tx=0x7f05dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== osd.1 v2:172.21.15.71:6816/714374974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f05cc0760f0 con 0x7f05cc073630 2023-07-06T01:09:03.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7f8d105ff700 1 Processor -- start 2023-07-06T01:09:03.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7f8d105ff700 1 -- start start 2023-07-06T01:09:03.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f8d105ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf00037f0 0x7f8d0815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f8d105ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d0815d8f0 0x7f8d0815d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f8d105ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d080c2490 0x7f8d080c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f8d105ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0815d6c0 con 0x7f8d080c2490 2023-07-06T01:09:03.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f8d105ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08163980 con 0x7f8d0815d8f0 2023-07-06T01:09:03.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f8d105ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08162ac0 con 0x7f8cf00037f0 2023-07-06T01:09:03.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.038+0000 7f90c2fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc160900 0x7f90bc06b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c2fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f90bc164530 0x7f90bc0adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c2fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f90bc0b0440 0x7f90bc0b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c2fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc0b0dd0 con 0x7f90bc164530 2023-07-06T01:09:03.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c2fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc0cc3b0 con 0x7f90bc0b0440 2023-07-06T01:09:03.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c2fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1649f0 con 0x7f90bc160900 2023-07-06T01:09:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c0d9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc160900 0x7f90bc06b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c0d9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc160900 0x7f90bc06b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:41940/0 (socket says 172.21.15.71:41940) 2023-07-06T01:09:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90c0d9b700 1 -- 172.21.15.71:0/1740627877 learned_addr learned my addr 172.21.15.71:0/1740627877 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.039+0000 7f90bbfff700 1 --2- 172.21.15.71:0/1740627877 >> v2:172.21.15.71:3300/0 conn(0x7f90bc164530 0x7f90bc0adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f90c159c700 1 --2- 172.21.15.71:0/1740627877 >> v2:172.21.15.194:3300/0 conn(0x7f90bc0b0440 0x7f90bc0b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7faa02ffd700 1 -- 172.21.15.71:0/1787790860 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654212197 0 0) 0x7faa0406c780 con 0x7faa040cbf50 2023-07-06T01:09:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7faa02ffd700 1 -- 172.21.15.71:0/1787790860 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f00057c0 con 0x7faa040cbf50 2023-07-06T01:09:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.037+0000 7faa03fff700 1 -- 172.21.15.71:0/1787790860 >> v1:172.21.15.194:6789/0 conn(0x7faa040cbf50 legacy=0x7faa0415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.038+0000 7faa03fff700 1 -- 172.21.15.71:0/1787790860 >> v1:172.21.15.71:6789/0 conn(0x7faa04071350 legacy=0x7faa0406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.038+0000 7faa03fff700 1 -- 172.21.15.71:0/1787790860 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0406fb40 con 0x7faa040caeb0 2023-07-06T01:09:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.038+0000 7faa03fff700 1 --2- 172.21.15.71:0/1787790860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa040caeb0 0x7faa04158610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00aa10 tx=0x7fa9fc00ad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a8f3792b6d957c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1050591941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 msgr2=0x7fd5740d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7fd57c1ff700 1 --2- 172.21.15.71:0/1050591941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 0x7fd5740d0b40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd570009920 tx=0x7fd570009c30 comp rx=0 tx=0).stop 2023-07-06T01:09:03.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f82c67fc700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82b406adb0 0x7f82b406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82cc0895a0 con 0x7f82d00cd3e0 2023-07-06T01:09:03.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f82c67fc700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7f82b40735e0 0x7f82b40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f90bbfff700 1 -- 172.21.15.71:0/1740627877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc160900 msgr2=0x7f90bc06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f90bbfff700 1 --2- 172.21.15.71:0/1740627877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc160900 0x7f90bc06b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f90bbfff700 1 -- 172.21.15.71:0/1740627877 >> v2:172.21.15.194:3300/0 conn(0x7f90bc0b0440 msgr2=0x7f90bc0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f90bbfff700 1 --2- 172.21.15.71:0/1740627877 >> v2:172.21.15.194:3300/0 conn(0x7f90bc0b0440 0x7f90bc0b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f90bbfff700 1 -- 172.21.15.71:0/1740627877 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc164cd0 con 0x7f90bc164530 2023-07-06T01:09:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.040+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 --> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82b40760a0 con 0x7f82b40735e0 2023-07-06T01:09:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f8d0eb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d080c2490 0x7f8d080c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f8d0eb9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d080c2490 0x7f8d080c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42884/0 (socket says 172.21.15.71:42884) 2023-07-06T01:09:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f8d0eb9c700 1 -- 172.21.15.71:0/2311008568 learned_addr learned my addr 172.21.15.71:0/2311008568 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f90bbfff700 1 --2- 172.21.15.71:0/1740627877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc164530 0x7f90bc0adb70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f90bc06f520 tx=0x7f90a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3230f50e0f8db6d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82cc009340 con 0x7f82d00cd3e0 2023-07-06T01:09:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1050591941 shutdown_connections 2023-07-06T01:09:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7fd57c1ff700 1 --2- 172.21.15.71:0/1050591941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd574154e50 0x7fd5740d0b40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1050591941 >> 172.21.15.71:0/1050591941 conn(0x7fd57406db20 msgr2=0x7fd57406df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7faa02ffd700 1 -- 172.21.15.71:0/1787790860 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00cb70 con 0x7faa040caeb0 2023-07-06T01:09:03.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7faa02ffd700 1 -- 172.21.15.71:0/1787790860 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00ccd0 con 0x7faa040caeb0 2023-07-06T01:09:03.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7faa02ffd700 1 -- 172.21.15.71:0/1787790860 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc010620 con 0x7faa040caeb0 2023-07-06T01:09:03.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0410003a20 con 0x7f0420158610 2023-07-06T01:09:03.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f90bb7fe700 1 -- 172.21.15.71:0/1740627877 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8011830 con 0x7f90bc164530 2023-07-06T01:09:03.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f90bb7fe700 1 -- 172.21.15.71:0/1740627877 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a8011990 con 0x7f90bc164530 2023-07-06T01:09:03.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f90bb7fe700 1 -- 172.21.15.71:0/1740627877 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8011d00 con 0x7f90bc164530 2023-07-06T01:09:03.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d0815d8f0 0x7f8d0815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.041+0000 7f82d679c700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7f82b40735e0 0x7f82b40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1050591941 shutdown_connections 2023-07-06T01:09:03.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f82d5f9b700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82b406adb0 0x7f82b406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f0415ffb700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f040406adb0 0x7f040406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f90c2fff700 1 -- 172.21.15.71:0/1740627877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc164530 msgr2=0x7f90bc0adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1740627877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc164530 0x7f90bc0adb70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f90bc06f520 tx=0x7f90a8009b20 comp rx=0 tx=0).stop 2023-07-06T01:09:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7faa09dff700 1 -- 172.21.15.71:0/1787790860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa040caeb0 msgr2=0x7faa04158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7faa09dff700 1 --2- 172.21.15.71:0/1787790860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa040caeb0 0x7faa04158610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00aa10 tx=0x7fa9fc00ad20 comp rx=0 tx=0).stop 2023-07-06T01:09:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0e39b700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf00037f0 0x7f8d0815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0db9a700 1 -- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf00037f0 msgr2=0x7f8d0815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf00037f0 0x7f8d0815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0db9a700 1 -- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d080c2490 msgr2=0x7f8d080c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d080c2490 0x7f8d080c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0db9a700 1 -- 172.21.15.71:0/2311008568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08162d70 con 0x7f8d0815d8f0 2023-07-06T01:09:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f8d0db9a700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d0815d8f0 0x7f8d0815d180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc002230 tx=0x7f8cfc001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc003e10 con 0x7f8d0815d8f0 2023-07-06T01:09:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc0128f0 con 0x7f8d0815d8f0 2023-07-06T01:09:03.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f8d0eb9c700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d080c2490 0x7f8d080c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012ca0 con 0x7f8d0815d8f0 2023-07-06T01:09:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d08163050 con 0x7f8d0815d8f0 2023-07-06T01:09:03.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.044+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d08163610 con 0x7f8d0815d8f0 2023-07-06T01:09:03.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1050591941 wait complete. 2023-07-06T01:09:03.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f90c2fff700 1 -- 172.21.15.71:0/1740627877 shutdown_connections 2023-07-06T01:09:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1740627877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc160900 0x7f90bc06b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1740627877 >> v2:172.21.15.194:3300/0 conn(0x7f90bc0b0440 0x7f90bc0b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1740627877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc164530 0x7f90bc0adb70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f90c2fff700 1 -- 172.21.15.71:0/1740627877 >> 172.21.15.71:0/1740627877 conn(0x7f90bc0cb440 msgr2=0x7f90bc0cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f90c2fff700 1 -- 172.21.15.71:0/1740627877 shutdown_connections 2023-07-06T01:09:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7faa09dff700 1 -- 172.21.15.71:0/1787790860 shutdown_connections 2023-07-06T01:09:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7faa09dff700 1 --2- 172.21.15.71:0/1787790860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa040caeb0 0x7faa04158610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7faa09dff700 1 -- 172.21.15.71:0/1787790860 >> 172.21.15.71:0/1787790860 conn(0x7faa040cb440 msgr2=0x7faa040cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0410088ff0 con 0x7f0420158610 2023-07-06T01:09:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f0415ffb700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7f0404073660 0x7f0404075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 --> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0404076120 con 0x7f0404073660 2023-07-06T01:09:03.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04100893a0 con 0x7f0420158610 2023-07-06T01:09:03.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f042519b700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f040406adb0 0x7f040406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.043+0000 7f042599c700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7f0404073660 0x7f0404075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.042+0000 7f82d679c700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7f82b40735e0 0x7f82b40759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.044+0000 7f042599c700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7f0404073660 0x7f0404075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.045+0000 7fd57c1ff700 1 Processor -- start 2023-07-06T01:09:03.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.044+0000 7f90c2fff700 1 -- 172.21.15.71:0/1740627877 wait complete. 2023-07-06T01:09:03.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.045+0000 7f82d5f9b700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82b406adb0 0x7f82b406d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82c8000f80 tx=0x7f82c8009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.045+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d080ca050 con 0x7f8d0815d8f0 2023-07-06T01:09:03.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.045+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== osd.0 v2:172.21.15.71:6800/945460712 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f82b40760a0 con 0x7f82b40735e0 2023-07-06T01:09:03.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== osd.2 v2:172.21.15.71:6808/2164673014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0404076120 con 0x7f0404073660 2023-07-06T01:09:03.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.045+0000 7faa09dff700 1 -- 172.21.15.71:0/1787790860 shutdown_connections 2023-07-06T01:09:03.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.045+0000 7fd57c1ff700 1 -- start start 2023-07-06T01:09:03.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7fd57c1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd57406f9e0 0x7fd5740b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7fd57c1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5740d1080 0x7fd57414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7fd57c1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd574154e50 0x7fd5740b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7fd57c1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b1bd0 con 0x7fd574154e50 2023-07-06T01:09:03.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7fd57c1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574150500 con 0x7fd5740d1080 2023-07-06T01:09:03.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7fd57c1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740cd170 con 0x7fd57406f9e0 2023-07-06T01:09:03.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7fd579f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd57406f9e0 0x7fd5740b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7fd57a79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd574154e50 0x7fd5740b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7fd57a79c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd574154e50 0x7fd5740b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42892/0 (socket says 172.21.15.71:42892) 2023-07-06T01:09:03.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7fd57a79c700 1 -- 172.21.15.71:0/1065873081 learned_addr learned my addr 172.21.15.71:0/1065873081 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7fd57a79c700 1 -- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd57406f9e0 msgr2=0x7fd5740b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7fd57a79c700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd57406f9e0 0x7fd5740b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7fd57a79c700 1 -- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5740d1080 msgr2=0x7fd57414c000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7fd57a79c700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5740d1080 0x7fd57414c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7fd57a79c700 1 -- 172.21.15.71:0/1065873081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009550 con 0x7fd574154e50 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7fd57a79c700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd574154e50 0x7fd5740b4a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00cc10 tx=0x7fd56c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c00ab10 con 0x7fd574154e50 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c00ac70 con 0x7fd574154e50 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c012420 con 0x7fd574154e50 2023-07-06T01:09:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5740cce90 con 0x7fd574154e50 2023-07-06T01:09:03.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd574150190 con 0x7fd574154e50 2023-07-06T01:09:03.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7f90c2fff700 1 Processor -- start 2023-07-06T01:09:03.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.047+0000 7f90c2fff700 1 -- start start 2023-07-06T01:09:03.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7f90c2fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc0b0440 0x7f90bc159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.048+0000 7f90c2fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90bc160900 0x7f90bc0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.049+0000 7f90c2fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc0c4380 0x7f90bc0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.049+0000 7f90c2fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc159dd0 con 0x7f90bc0b0440 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.049+0000 7f90c2fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1f6390 con 0x7f90bc160900 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.049+0000 7f90c2fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc15a1e0 con 0x7f90bc0c4380 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc0b0440 0x7f90bc159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc0b0440 0x7f90bc159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42904/0 (socket says 172.21.15.71:42904) 2023-07-06T01:09:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 -- 172.21.15.71:0/1048319555 learned_addr learned my addr 172.21.15.71:0/1048319555 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 -- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc0c4380 msgr2=0x7f90bc0cec40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90bc0c4380 0x7f90bc0cec40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 -- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90bc160900 msgr2=0x7f90bc0c3e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90bc160900 0x7f90bc0c3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.050+0000 7f90c0d9b700 1 -- 172.21.15.71:0/1048319555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80094a0 con 0x7f90bc0b0440 2023-07-06T01:09:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.046+0000 7faa09dff700 1 -- 172.21.15.71:0/1787790860 wait complete. 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.049+0000 7faa09dff700 1 Processor -- start 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.049+0000 7faa09dff700 1 -- start start 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7faa09dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa04071350 0x7faa040b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7faa09dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa040caeb0 0x7faa041ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7faa09dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa040cbf50 0x7faa041ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7faa09dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa04156c40 con 0x7faa040caeb0 2023-07-06T01:09:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7faa09dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa04159120 con 0x7faa040cbf50 2023-07-06T01:09:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7faa09dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa040c4a70 con 0x7faa04071350 2023-07-06T01:09:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.051+0000 7f90c0d9b700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc0b0440 0x7f90bc159890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e7e0 tx=0x7f90b000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0013610 con 0x7f90bc0b0440 2023-07-06T01:09:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b0013770 con 0x7f90bc0b0440 2023-07-06T01:09:03.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0013b00 con 0x7f90bc0b0440 2023-07-06T01:09:03.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc0b1890 con 0x7f90bc0b0440 2023-07-06T01:09:03.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc0b1e50 con 0x7f90bc0b0440 2023-07-06T01:09:03.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7faa03fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa040cbf50 0x7faa041ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7faa03fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa040cbf50 0x7faa041ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60896/0 (socket says 172.21.15.71:60896) 2023-07-06T01:09:03.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.052+0000 7faa03fff700 1 -- 172.21.15.71:0/3217785821 learned_addr learned my addr 172.21.15.71:0/3217785821 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd55c000fc0 con 0x7fd574154e50 2023-07-06T01:09:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7faa03fff700 1 -- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa04071350 msgr2=0x7faa040b3f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T01:09:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7faa03fff700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa04071350 0x7faa040b3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7faa03fff700 1 -- 172.21.15.71:0/3217785821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa040caeb0 msgr2=0x7faa041ed1a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T01:09:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7faa03fff700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa040caeb0 0x7faa041ed1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7faa03fff700 1 -- 172.21.15.71:0/3217785821 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc00a640 con 0x7faa040cbf50 2023-07-06T01:09:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.053+0000 7faa03fff700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa040cbf50 0x7faa041ed6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ad60 tx=0x7fa9fc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.054+0000 7fb845bff700 1 Processor -- start 2023-07-06T01:09:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.054+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd56c012580 con 0x7fd574154e50 2023-07-06T01:09:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.055+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f909c000fc0 con 0x7f90bc0b0440 2023-07-06T01:09:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.054+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc01e070 con 0x7faa040cbf50 2023-07-06T01:09:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.054+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc00ce40 con 0x7faa040cbf50 2023-07-06T01:09:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.054+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004480 con 0x7faa040cbf50 2023-07-06T01:09:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.055+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa04158cd0 con 0x7faa040cbf50 2023-07-06T01:09:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.055+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa040c4fc0 con 0x7faa040cbf50 2023-07-06T01:09:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa04158b50 con 0x7faa040cbf50 2023-07-06T01:09:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7f042519b700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f040406adb0 0x7f040406d260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f041c00d370 tx=0x7f041c014000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.055+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cfc0050c0 con 0x7f8d0815d8f0 2023-07-06T01:09:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7f8d06ffd700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8cf406adb0 0x7f8cf406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8cfc08b3e0 con 0x7f8d0815d8f0 2023-07-06T01:09:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7f8d06ffd700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f8cf4073660 0x7f8cf4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 --> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8cf4076120 con 0x7f8cf4073660 2023-07-06T01:09:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cfc08b790 con 0x7f8d0815d8f0 2023-07-06T01:09:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7f8d0e39b700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8cf406adb0 0x7f8cf406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fd56a7fc700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd55806adb0 0x7fd55806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd56c089760 con 0x7fd574154e50 2023-07-06T01:09:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fd56a7fc700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7fd558073660 0x7fd558075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 --> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd558076120 con 0x7fd558073660 2023-07-06T01:09:03.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd56c08bd80 con 0x7fd574154e50 2023-07-06T01:09:03.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7fd57979a700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7fd558073660 0x7fd558075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7fd57979a700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7fd558073660 0x7fd558075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.054+0000 7fb845bff700 1 -- start start 2023-07-06T01:09:03.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fb845bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b8660 0x7fb8400ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fb845bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb8400b2180 0x7fb8400cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fb845bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400d0130 con 0x7fb8400cfcb0 2023-07-06T01:09:03.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fb845bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400cda40 con 0x7fb8400b2180 2023-07-06T01:09:03.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7fb845bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400cd480 con 0x7fb8400b8660 2023-07-06T01:09:03.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7fb83ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb8400cfcb0 0x7fb840160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34542/0 (socket says 172.21.15.71:34542) 2023-07-06T01:09:03.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7fb83ffff700 1 -- 172.21.15.71:0/3923141652 learned_addr learned my addr 172.21.15.71:0/3923141652 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:03.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.057+0000 7fb83f7fe700 1 --2- 172.21.15.71:0/3923141652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b8660 0x7fb8400ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7fb83f7fe700 1 -- 172.21.15.71:0/3923141652 >> v2:172.21.15.71:3300/0 conn(0x7fb8400b2180 msgr2=0x7fb8400cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7fb83f7fe700 1 --2- 172.21.15.71:0/3923141652 >> v2:172.21.15.71:3300/0 conn(0x7fb8400b2180 0x7fb8400cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7fb83f7fe700 1 -- 172.21.15.71:0/3923141652 >> v1:172.21.15.71:6789/0 conn(0x7fb8400cfcb0 legacy=0x7fb840160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.058+0000 7fb83f7fe700 1 -- 172.21.15.71:0/3923141652 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400cd760 con 0x7fb8400b8660 2023-07-06T01:09:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7fb83f7fe700 1 --2- 172.21.15.71:0/3923141652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b8660 0x7fb8400ceed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb834009840 tx=0x7fb834009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdd683bca56e9b8d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7fb83e7fc700 1 -- 172.21.15.71:0/3923141652 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834011830 con 0x7fb8400b8660 2023-07-06T01:09:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7fb83e7fc700 1 -- 172.21.15.71:0/3923141652 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834011990 con 0x7fb8400b8660 2023-07-06T01:09:03.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7fb83e7fc700 1 -- 172.21.15.71:0/3923141652 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834011d20 con 0x7fb8400b8660 2023-07-06T01:09:03.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.056+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90b0013c60 con 0x7f90bc0b0440 2023-07-06T01:09:03.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7f90b97fa700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f90a006adb0 0x7f90a006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90b0089030 con 0x7f90bc0b0440 2023-07-06T01:09:03.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7f90b97fa700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f90a00735e0 0x7f90a00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 --> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90a00760a0 con 0x7f90a00735e0 2023-07-06T01:09:03.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7f8d0e39b700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8cf406adb0 0x7f8cf406d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d08069890 tx=0x7f8d00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7fd579f9b700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd55806adb0 0x7fd55806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.059+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9fc019860 con 0x7faa040cbf50 2023-07-06T01:09:03.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7f8d0eb9c700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f8cf4073660 0x7f8cf4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== osd.4 v2:172.21.15.194:6800/654779018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd558076120 con 0x7fd558073660 2023-07-06T01:09:03.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90b000c490 con 0x7f90bc0b0440 2023-07-06T01:09:03.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7fb845bff700 1 -- 172.21.15.71:0/3923141652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b8660 msgr2=0x7fb8400ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7fb845bff700 1 --2- 172.21.15.71:0/3923141652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b8660 0x7fb8400ceed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb834009840 tx=0x7fb834009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:03.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7fb845bff700 1 -- 172.21.15.71:0/3923141652 shutdown_connections 2023-07-06T01:09:03.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7fb845bff700 1 --2- 172.21.15.71:0/3923141652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b8660 0x7fb8400ceed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7fb845bff700 1 --2- 172.21.15.71:0/3923141652 >> v2:172.21.15.71:3300/0 conn(0x7fb8400b2180 0x7fb8400cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7fb845bff700 1 -- 172.21.15.71:0/3923141652 >> 172.21.15.71:0/3923141652 conn(0x7fb840071690 msgr2=0x7fb840071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7fd579f9b700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd55806adb0 0x7fd55806d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd570009870 tx=0x7fd570008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.060+0000 7faa00ff9700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9e406adb0 0x7fa9e406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa9fc08aab0 con 0x7faa040cbf50 2023-07-06T01:09:03.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7faa00ff9700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7fa9e4073660 0x7fa9e4075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 --> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9e4076120 con 0x7fa9e4073660 2023-07-06T01:09:03.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9fc08ae60 con 0x7faa040cbf50 2023-07-06T01:09:03.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7f90bbfff700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f90a006adb0 0x7f90a006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7f8d0eb9c700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f8cf4073660 0x7f8cf4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7faa037fe700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9e406adb0 0x7fa9e406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7f90c159c700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f90a00735e0 0x7f90a00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.061+0000 7fa9faffd700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7fa9e4073660 0x7fa9e4075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.062+0000 7faa037fe700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9e406adb0 0x7fa9e406d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001f80 tx=0x7fa9f40015b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.062+0000 7f90c159c700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f90a00735e0 0x7f90a00759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.063+0000 7f90bbfff700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f90a006adb0 0x7f90a006d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90bc164920 tx=0x7f90a8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.063+0000 7fa9faffd700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7fa9e4073660 0x7fa9e4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.063+0000 7fb845bff700 1 -- 172.21.15.71:0/3923141652 shutdown_connections 2023-07-06T01:09:03.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.063+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== osd.3 v2:172.21.15.71:6824/1769601539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8cf4076120 con 0x7f8cf4073660 2023-07-06T01:09:03.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.063+0000 7fb845bff700 1 -- 172.21.15.71:0/3923141652 wait complete. 2023-07-06T01:09:03.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.063+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== osd.5 v2:172.21.15.194:6808/2313076380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f90a00760a0 con 0x7f90a00735e0 2023-07-06T01:09:03.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.064+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== osd.6 v2:172.21.15.194:6816/3534579584 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa9e4076120 con 0x7fa9e4073660 2023-07-06T01:09:03.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.066+0000 7fb845bff700 1 Processor -- start 2023-07-06T01:09:03.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.068+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 --> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f05c4002d40 con 0x7f05cc073630 2023-07-06T01:09:03.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.068+0000 7fb845bff700 1 -- start start 2023-07-06T01:09:03.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.069+0000 7f05e57fa700 1 -- 172.21.15.71:0/3627310801 <== osd.1 v2:172.21.15.71:6816/714374974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f05c4002d40 con 0x7f05cc073630 2023-07-06T01:09:03.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb845bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b2180 0x7fb8400ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb845bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8400b8660 0x7fb840158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb845bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8400cfcb0 0x7fb840158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb845bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c9f60 con 0x7fb8400b8660 2023-07-06T01:09:03.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb845bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84015a2e0 con 0x7fb8400cfcb0 2023-07-06T01:09:03.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb845bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84015a5c0 con 0x7fb8400b2180 2023-07-06T01:09:03.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b2180 0x7fb8400ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b2180 0x7fb8400ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:41990/0 (socket says 172.21.15.71:41990) 2023-07-06T01:09:03.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.070+0000 7fb83f7fe700 1 -- 172.21.15.71:0/2048256242 learned_addr learned my addr 172.21.15.71:0/2048256242 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f05cc073630 msgr2=0x7f05cc075a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f05cc073630 0x7f05cc075a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7fb83f7fe700 1 -- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8400cfcb0 msgr2=0x7fb840158a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7fb83f7fe700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8400cfcb0 0x7fb840158a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7fb83f7fe700 1 -- 172.21.15.71:0/2048256242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8400b8660 msgr2=0x7fb840158540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7fb83f7fe700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb8400b8660 0x7fb840158540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7fb83f7fe700 1 -- 172.21.15.71:0/2048256242 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340094a0 con 0x7fb8400b2180 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.071+0000 7fb83f7fe700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b2180 0x7fb8400ccb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb834014040 tx=0x7fb834004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.072+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83401a860 con 0x7fb8400b2180 2023-07-06T01:09:03.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.072+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83401a9c0 con 0x7fb8400b2180 2023-07-06T01:09:03.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.072+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84015a8a0 con 0x7fb8400b2180 2023-07-06T01:09:03.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.072+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83401ad50 con 0x7fb8400b2180 2023-07-06T01:09:03.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.072+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400cd050 con 0x7fb8400b2180 2023-07-06T01:09:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.076+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f05cc06ad80 msgr2=0x7f05cc06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.076+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f05cc06ad80 0x7f05cc06d230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05e80cae00 tx=0x7f05dc008040 comp rx=0 tx=0).stop 2023-07-06T01:09:03.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.076+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80b0440 msgr2=0x7f05e81508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.076+0000 7f05ef1ff700 1 --2- 172.21.15.71:0/3627310801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80b0440 0x7f05e81508a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000f80 tx=0x7f05e0004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.076+0000 7f05ed79c700 1 -- 172.21.15.71:0/3627310801 reap_dead start 2023-07-06T01:09:03.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.076+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb834022070 con 0x7fb8400b2180 2023-07-06T01:09:03.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.077+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 --> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82d00cd870 con 0x7f82b40735e0 2023-07-06T01:09:03.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.078+0000 7f82c67fc700 1 -- 172.21.15.71:0/1997876328 <== osd.0 v2:172.21.15.71:6800/945460712 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f82c0003a10 con 0x7f82b40735e0 2023-07-06T01:09:03.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.077+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb820000fc0 con 0x7fb8400b2180 2023-07-06T01:09:03.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.077+0000 7fb827fff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb82c06ace0 0x7fb82c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.078+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb83408a160 con 0x7fb8400b2180 2023-07-06T01:09:03.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.078+0000 7fb827fff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7fb82c073590 0x7fb82c0759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.078+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 --> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb82c076050 con 0x7fb82c073590 2023-07-06T01:09:03.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.078+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83408c6c0 con 0x7fb8400b2180 2023-07-06T01:09:03.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7fb83effd700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb82c06ace0 0x7fb82c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 shutdown_connections 2023-07-06T01:09:03.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 >> 172.21.15.71:0/3627310801 conn(0x7f05e80cb440 msgr2=0x7f05e80ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7fb83ffff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7fb82c073590 0x7fb82c0759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 shutdown_connections 2023-07-06T01:09:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7f05ef1ff700 1 -- 172.21.15.71:0/3627310801 wait complete. 2023-07-06T01:09:03.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.080+0000 7fb83effd700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb82c06ace0 0x7fb82c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb8400b3fd0 tx=0x7fb838009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.080+0000 7fb83ffff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7fb82c073590 0x7fb82c0759a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.081+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== osd.7 v2:172.21.15.194:6820/1393064559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb82c076050 con 0x7fb82c073590 2023-07-06T01:09:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7f82b40735e0 msgr2=0x7f82b40759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7f82b40735e0 0x7f82b40759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82b406adb0 msgr2=0x7f82b406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82b406adb0 0x7f82b406d260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82c8000f80 tx=0x7f82c8009000 comp rx=0 tx=0).stop 2023-07-06T01:09:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d00cd3e0 msgr2=0x7f82d00c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 --2- 172.21.15.71:0/1997876328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82d00cd3e0 0x7f82d00c4920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00b550 tx=0x7f82cc00b910 comp rx=0 tx=0).stop 2023-07-06T01:09:03.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d679c700 1 -- 172.21.15.71:0/1997876328 reap_dead start 2023-07-06T01:09:03.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 shutdown_connections 2023-07-06T01:09:03.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.083+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 >> 172.21.15.71:0/1997876328 conn(0x7f82d00cf810 msgr2=0x7f82d00b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.079+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 --> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0400002d40 con 0x7f0404073660 2023-07-06T01:09:03.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.084+0000 7f0415ffb700 1 -- 172.21.15.71:0/2129095568 <== osd.2 v2:172.21.15.71:6808/2164673014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0400002d40 con 0x7f0404073660 2023-07-06T01:09:03.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.085+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 shutdown_connections 2023-07-06T01:09:03.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.085+0000 7f82d81ff700 1 -- 172.21.15.71:0/1997876328 wait complete. 2023-07-06T01:09:03.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.085+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7f0404073660 msgr2=0x7f0404075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.085+0000 7f04273ff700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7f0404073660 0x7f0404075a70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f040406adb0 msgr2=0x7f040406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f04273ff700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f040406adb0 0x7f040406d260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f041c00d370 tx=0x7f041c014000 comp rx=0 tx=0).stop 2023-07-06T01:09:03.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420158610 msgr2=0x7f04201fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f04273ff700 1 --2- 172.21.15.71:0/2129095568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420158610 0x7f04201fe250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f041000c4b0 tx=0x7f041000c7c0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f042599c700 1 -- 172.21.15.71:0/2129095568 reap_dead start 2023-07-06T01:09:03.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 shutdown_connections 2023-07-06T01:09:03.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.086+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 >> 172.21.15.71:0/2129095568 conn(0x7f04200cb440 msgr2=0x7f04200ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.091+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 shutdown_connections 2023-07-06T01:09:03.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.091+0000 7f04273ff700 1 -- 172.21.15.71:0/2129095568 wait complete. 2023-07-06T01:09:03.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.093+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 --> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa040ae190 con 0x7fa9e4073660 2023-07-06T01:09:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.094+0000 7faa00ff9700 1 -- 172.21.15.71:0/3217785821 <== osd.6 v2:172.21.15.194:6816/3534579584 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9ec0012e0 con 0x7fa9e4073660 2023-07-06T01:09:03.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.094+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 --> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f909c002d40 con 0x7f90a00735e0 2023-07-06T01:09:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.094+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7fa9e4073660 msgr2=0x7fa9e4075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.094+0000 7faa09dff700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7fa9e4073660 0x7fa9e4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9e406adb0 msgr2=0x7fa9e406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa09dff700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9e406adb0 0x7fa9e406d260 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001f80 tx=0x7fa9f40015b0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa040cbf50 msgr2=0x7faa041ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa09dff700 1 --2- 172.21.15.71:0/3217785821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa040cbf50 0x7faa041ed6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ad60 tx=0x7fa9fc004750 comp rx=0 tx=0).stop 2023-07-06T01:09:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa03fff700 1 -- 172.21.15.71:0/3217785821 reap_dead start 2023-07-06T01:09:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7f90b97fa700 1 -- 172.21.15.71:0/1048319555 <== osd.5 v2:172.21.15.194:6808/2313076380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f909c002d40 con 0x7f90a00735e0 2023-07-06T01:09:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 shutdown_connections 2023-07-06T01:09:03.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.095+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 >> 172.21.15.71:0/3217785821 conn(0x7faa040cb440 msgr2=0x7faa040ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.096+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 shutdown_connections 2023-07-06T01:09:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.096+0000 7faa09dff700 1 -- 172.21.15.71:0/3217785821 wait complete. 2023-07-06T01:09:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.096+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f90a00735e0 msgr2=0x7f90a00759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.096+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f90a00735e0 0x7f90a00759f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f90a006adb0 msgr2=0x7f90a006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f90a006adb0 0x7f90a006d260 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f90bc164920 tx=0x7f90a8008030 comp rx=0 tx=0).stop 2023-07-06T01:09:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc0b0440 msgr2=0x7f90bc159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c2fff700 1 --2- 172.21.15.71:0/1048319555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f90bc0b0440 0x7f90bc159890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e7e0 tx=0x7f90b000eba0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c159c700 1 -- 172.21.15.71:0/1048319555 reap_dead start 2023-07-06T01:09:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 --> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d08165290 con 0x7f8cf4073660 2023-07-06T01:09:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 shutdown_connections 2023-07-06T01:09:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.097+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 >> 172.21.15.71:0/1048319555 conn(0x7f90bc0cb440 msgr2=0x7f90bc0ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.098+0000 7f8d06ffd700 1 -- 172.21.15.71:0/2311008568 <== osd.3 v2:172.21.15.71:6824/1769601539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8cf80017a0 con 0x7f8cf4073660 2023-07-06T01:09:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.099+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 --> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd55c002d40 con 0x7fd558073660 2023-07-06T01:09:03.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 shutdown_connections 2023-07-06T01:09:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7f90c2fff700 1 -- 172.21.15.71:0/1048319555 wait complete. 2023-07-06T01:09:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7fd56a7fc700 1 -- 172.21.15.71:0/1065873081 <== osd.4 v2:172.21.15.194:6800/654779018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd55c002d40 con 0x7fd558073660 2023-07-06T01:09:03.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f8cf4073660 msgr2=0x7f8cf4075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7f8d105ff700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f8cf4073660 0x7f8cf4075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8cf406adb0 msgr2=0x7f8cf406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.100+0000 7f8d105ff700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8cf406adb0 0x7f8cf406d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d08069890 tx=0x7f8d00008040 comp rx=0 tx=0).stop 2023-07-06T01:09:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.101+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d0815d8f0 msgr2=0x7f8d0815d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.101+0000 7f8d105ff700 1 --2- 172.21.15.71:0/2311008568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d0815d8f0 0x7f8d0815d180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc002230 tx=0x7f8cfc001cb0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.101+0000 7f8d0eb9c700 1 -- 172.21.15.71:0/2311008568 reap_dead start 2023-07-06T01:09:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.101+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 shutdown_connections 2023-07-06T01:09:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.101+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 >> 172.21.15.71:0/2311008568 conn(0x7f8d080cb440 msgr2=0x7f8d080af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.102+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 shutdown_connections 2023-07-06T01:09:03.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.102+0000 7f8d105ff700 1 -- 172.21.15.71:0/2311008568 wait complete. 2023-07-06T01:09:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.103+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7fd558073660 msgr2=0x7fd558075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7fd558073660 0x7fd558075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd55806adb0 msgr2=0x7fd55806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd55806adb0 0x7fd55806d260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd570009870 tx=0x7fd570008030 comp rx=0 tx=0).stop 2023-07-06T01:09:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd574154e50 msgr2=0x7fd5740b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 --2- 172.21.15.71:0/1065873081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd574154e50 0x7fd5740b4a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd56c00cc10 tx=0x7fd56c00cf20 comp rx=0 tx=0).stop 2023-07-06T01:09:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57a79c700 1 -- 172.21.15.71:0/1065873081 reap_dead start 2023-07-06T01:09:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 shutdown_connections 2023-07-06T01:09:03.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.104+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 >> 172.21.15.71:0/1065873081 conn(0x7fd57406db20 msgr2=0x7fd5740cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.176 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:03.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-06T01:09:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.106+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 shutdown_connections 2023-07-06T01:09:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.106+0000 7fd57c1ff700 1 -- 172.21.15.71:0/1065873081 wait complete. 2023-07-06T01:09:03.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.111+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 --> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb820002d40 con 0x7fb82c073590 2023-07-06T01:09:03.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.112+0000 7fb827fff700 1 -- 172.21.15.71:0/2048256242 <== osd.7 v2:172.21.15.194:6820/1393064559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb820002d40 con 0x7fb82c073590 2023-07-06T01:09:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.113+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7fb82c073590 msgr2=0x7fb82c0759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.113+0000 7fb845bff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7fb82c073590 0x7fb82c0759a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.113+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb82c06ace0 msgr2=0x7fb82c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.113+0000 7fb845bff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb82c06ace0 0x7fb82c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb8400b3fd0 tx=0x7fb838009250 comp rx=0 tx=0).stop 2023-07-06T01:09:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.113+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b2180 msgr2=0x7fb8400ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.113+0000 7fb845bff700 1 --2- 172.21.15.71:0/2048256242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8400b2180 0x7fb8400ccb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb834014040 tx=0x7fb834004750 comp rx=0 tx=0).stop 2023-07-06T01:09:03.181 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:03.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.114+0000 7fb83ffff700 1 -- 172.21.15.71:0/2048256242 reap_dead start 2023-07-06T01:09:03.182 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-06T01:09:03.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.114+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 shutdown_connections 2023-07-06T01:09:03.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.114+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 >> 172.21.15.71:0/2048256242 conn(0x7fb840071690 msgr2=0x7fb8400b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.114+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 shutdown_connections 2023-07-06T01:09:03.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.114+0000 7fb845bff700 1 -- 172.21.15.71:0/2048256242 wait complete. 2023-07-06T01:09:03.185 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-07-06T01:09:03.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-06T01:09:03.187 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:03.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-06T01:09:03.188 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:03.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-06T01:09:03.189 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:03.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-06T01:09:03.191 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-07-06T01:09:03.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-06T01:09:03.192 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:03.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-06T01:09:03.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.575+0000 7fc00a1ff700 1 Processor -- start 2023-07-06T01:09:03.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.573+0000 7f5b3c3ff700 1 Processor -- start 2023-07-06T01:09:03.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.574+0000 7f5b3c3ff700 1 -- start start 2023-07-06T01:09:03.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.576+0000 7f5b3c3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b34165290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.576+0000 7f5b3c3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340cdec0 con 0x7f5b340c1870 2023-07-06T01:09:03.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.576+0000 7f5b3c3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340ce120 con 0x7f5b340ad8f0 2023-07-06T01:09:03.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.576+0000 7f5b3c3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b341647b0 con 0x7f5b34160bc0 2023-07-06T01:09:03.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.577+0000 7f5b3a19b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b34165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.577+0000 7f5b3999a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5b340c1870 0x7f5b340cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34550/0 (socket says 172.21.15.71:34550) 2023-07-06T01:09:03.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.577+0000 7f5b3999a700 1 -- 172.21.15.71:0/3626686258 learned_addr learned my addr 172.21.15.71:0/3626686258 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:03.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7f5b39199700 1 -- 172.21.15.71:0/3626686258 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452014021 0 0) 0x7f5b340cdec0 con 0x7f5b340c1870 2023-07-06T01:09:03.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7f5b39199700 1 -- 172.21.15.71:0/3626686258 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b200035b0 con 0x7f5b340c1870 2023-07-06T01:09:03.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7f5b3a19b700 1 -- 172.21.15.71:0/3626686258 >> v1:172.21.15.194:6789/0 conn(0x7f5b340ad8f0 legacy=0x7f5b340ca050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T01:09:03.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7f5b3a19b700 1 -- 172.21.15.71:0/3626686258 >> v1:172.21.15.71:6789/0 conn(0x7f5b340c1870 legacy=0x7f5b340cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7f5b3a19b700 1 -- 172.21.15.71:0/3626686258 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34164a90 con 0x7f5b34160bc0 2023-07-06T01:09:03.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.576+0000 7fc00a1ff700 1 -- start start 2023-07-06T01:09:03.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7fc00a1ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc004164530 0x7fc00406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7fc00a1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc0040b0440 0x7fc0040b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7fc00a1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0040b0de0 con 0x7fc004160900 2023-07-06T01:09:03.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7fc00a1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0040cc3b0 con 0x7fc0040b0440 2023-07-06T01:09:03.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.578+0000 7fc00a1ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0041649f0 con 0x7fc004164530 2023-07-06T01:09:03.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.579+0000 7f5b3a19b700 1 --2- 172.21.15.71:0/3626686258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b34165290 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009870 tx=0x7f5b24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dbd473f742c7703 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.579+0000 7fc0037fe700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc004160900 0x7fc0040adb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44788/0 (socket says 172.21.15.71:44788) 2023-07-06T01:09:03.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.579+0000 7fc0037fe700 1 -- 172.21.15.71:0/4184684772 learned_addr learned my addr 172.21.15.71:0/4184684772 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:03.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.579+0000 7fc003fff700 1 --2- 172.21.15.71:0/4184684772 >> v2:172.21.15.71:3300/0 conn(0x7fc0040b0440 0x7fc0040b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.580+0000 7fc003fff700 1 -- 172.21.15.71:0/4184684772 >> v2:172.21.15.194:3300/0 conn(0x7fc004164530 msgr2=0x7fc00406b220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T01:09:03.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.580+0000 7fc003fff700 1 --2- 172.21.15.71:0/4184684772 >> v2:172.21.15.194:3300/0 conn(0x7fc004164530 0x7fc00406b220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.580+0000 7fc003fff700 1 -- 172.21.15.71:0/4184684772 >> v1:172.21.15.194:6789/0 conn(0x7fc004160900 legacy=0x7fc0040adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.580+0000 7fc003fff700 1 -- 172.21.15.71:0/4184684772 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004164cd0 con 0x7fc0040b0440 2023-07-06T01:09:03.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.580+0000 7fc003fff700 1 --2- 172.21.15.71:0/4184684772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040b0440 0x7fc0040b08a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc0040ae280 tx=0x7fbffc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c9ff7a4a21fe83 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7fb4ccbff700 1 Processor -- start 2023-07-06T01:09:03.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7f5b39199700 1 -- 172.21.15.71:0/3626686258 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24004230 con 0x7f5b34160bc0 2023-07-06T01:09:03.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7f5b39199700 1 -- 172.21.15.71:0/3626686258 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b24004390 con 0x7f5b34160bc0 2023-07-06T01:09:03.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7f5b39199700 1 -- 172.21.15.71:0/3626686258 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240036a0 con 0x7f5b34160bc0 2023-07-06T01:09:03.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7fc0027fc700 1 -- 172.21.15.71:0/4184684772 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00e070 con 0x7fc0040b0440 2023-07-06T01:09:03.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7fc0027fc700 1 -- 172.21.15.71:0/4184684772 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc00bad0 con 0x7fc0040b0440 2023-07-06T01:09:03.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.581+0000 7fc0027fc700 1 -- 172.21.15.71:0/4184684772 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00be80 con 0x7fc0040b0440 2023-07-06T01:09:03.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.582+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/3626686258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 msgr2=0x7f5b34165290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.582+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/3626686258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b34165290 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009870 tx=0x7f5b24009b80 comp rx=0 tx=0).stop 2023-07-06T01:09:03.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.582+0000 7fc00a1ff700 1 -- 172.21.15.71:0/4184684772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040b0440 msgr2=0x7fc0040b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.582+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/4184684772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040b0440 0x7fc0040b08a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc0040ae280 tx=0x7fbffc00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:03.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7fc00a1ff700 1 -- 172.21.15.71:0/4184684772 shutdown_connections 2023-07-06T01:09:03.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/4184684772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040b0440 0x7fc0040b08a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/4184684772 >> v2:172.21.15.194:3300/0 conn(0x7fc004164530 0x7fc00406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7fc00a1ff700 1 -- 172.21.15.71:0/4184684772 >> 172.21.15.71:0/4184684772 conn(0x7fc0040cb440 msgr2=0x7fc0040cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.582+0000 7fb4ccbff700 1 -- start start 2023-07-06T01:09:03.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/3626686258 shutdown_connections 2023-07-06T01:09:03.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/3626686258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b34165290 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/3626686258 >> 172.21.15.71:0/3626686258 conn(0x7f5b340cb440 msgr2=0x7f5b340cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/3626686258 shutdown_connections 2023-07-06T01:09:03.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.583+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/3626686258 wait complete. 2023-07-06T01:09:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.584+0000 7fc00a1ff700 1 -- 172.21.15.71:0/4184684772 shutdown_connections 2023-07-06T01:09:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.585+0000 7fb4ccbff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c8164530 0x7fb4c806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.585+0000 7fb4ccbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c80cc3b0 con 0x7fb4c8160900 2023-07-06T01:09:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.585+0000 7fb4ccbff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c81649f0 con 0x7fb4c80b0440 2023-07-06T01:09:03.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.585+0000 7fb4ccbff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8164cd0 con 0x7fb4c8164530 2023-07-06T01:09:03.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.584+0000 7fc00a1ff700 1 -- 172.21.15.71:0/4184684772 wait complete. 2023-07-06T01:09:03.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.586+0000 7fb4c659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb4c8160900 0x7fb4c80adb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34562/0 (socket says 172.21.15.71:34562) 2023-07-06T01:09:03.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.586+0000 7fb4c659c700 1 -- 172.21.15.71:0/1895512048 learned_addr learned my addr 172.21.15.71:0/1895512048 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.586+0000 7f5b3c3ff700 1 Processor -- start 2023-07-06T01:09:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.586+0000 7f5b3c3ff700 1 -- start start 2023-07-06T01:09:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.587+0000 7fc00a1ff700 1 Processor -- start 2023-07-06T01:09:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.587+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403842472 0 0) 0x7fb4c80cc3b0 con 0x7fb4c8160900 2023-07-06T01:09:03.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.587+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b40035b0 con 0x7fb4c8160900 2023-07-06T01:09:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.587+0000 7fb4bdd9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c8164530 0x7fb4c806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.587+0000 7fc00a1ff700 1 -- start start 2023-07-06T01:09:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7f5b3c3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b340ad8f0 0x7f5b340b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7f5b3c3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b340c1870 0x7f5b340b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7f5b3c3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b341509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7f5b3c3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340b3530 con 0x7f5b340c1870 2023-07-06T01:09:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7f5b3c3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340b1d30 con 0x7f5b340ad8f0 2023-07-06T01:09:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7f5b3c3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34163dd0 con 0x7f5b34160bc0 2023-07-06T01:09:03.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fe9b0bff700 1 Processor -- start 2023-07-06T01:09:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722556310 0 0) 0x7fb4b40035b0 con 0x7fb4c8160900 2023-07-06T01:09:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c8164530 msgr2=0x7fb4c806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7fb4c5d9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c8164530 0x7fb4c806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.588+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 >> v1:172.21.15.194:6789/0 conn(0x7fb4c80b0440 legacy=0x7fb4c80ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8164fb0 con 0x7fb4c8160900 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fb4b0001670 con 0x7fb4c8160900 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 >> v1:172.21.15.71:6789/0 conn(0x7fb4c8160900 legacy=0x7fb4c80adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4b4003a30 0x7fb4b4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b4004850 0x7fb4b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4005200 0x7fb4b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8164cd0 con 0x7fb4b4005200 2023-07-06T01:09:03.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b400c0e0 con 0x7fb4b4004850 2023-07-06T01:09:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b400c2a0 con 0x7fb4b4003a30 2023-07-06T01:09:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc00a1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 0x7fc0040ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc00a1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc004160900 0x7fc0040c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc00a1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040aeb40 0x7fc0040c2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc00a1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0040b3a10 con 0x7fc0040aeb40 2023-07-06T01:09:03.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc00a1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0040b2d90 con 0x7fc0040b0440 2023-07-06T01:09:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc00a1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0040b3070 con 0x7fc004160900 2023-07-06T01:09:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fc0037fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 0x7fc0040ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7fc0037fe700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 0x7fc0040ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60908/0 (socket says 172.21.15.71:60908) 2023-07-06T01:09:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7fc0037fe700 1 -- 172.21.15.71:0/1517288314 learned_addr learned my addr 172.21.15.71:0/1517288314 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7fc002ffd700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc004160900 0x7fc0040c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7f3d86fff700 1 Processor -- start 2023-07-06T01:09:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7f3d86fff700 1 -- start start 2023-07-06T01:09:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7fb4bdd9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b4004850 0x7fb4b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7fb4c659c700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4b4003a30 0x7fb4b4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7fc003fff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040aeb40 0x7fc0040c2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.589+0000 7fe9b0bff700 1 -- start start 2023-07-06T01:09:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7f5b3a19b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b340ad8f0 0x7f5b340b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7f5b3a99c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b341509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7f5b3a99c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b341509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42014/0 (socket says 172.21.15.71:42014) 2023-07-06T01:09:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.590+0000 7f5b3a99c700 1 -- 172.21.15.71:0/1976406904 learned_addr learned my addr 172.21.15.71:0/1976406904 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7f5b3a99c700 1 -- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b340ad8f0 msgr2=0x7f5b340b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7f5b3a99c700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b340ad8f0 0x7f5b340b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7f5b3a99c700 1 -- 172.21.15.71:0/1976406904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b340c1870 msgr2=0x7f5b340b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7f5b3a99c700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b340c1870 0x7f5b340b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7f5b3a99c700 1 -- 172.21.15.71:0/1976406904 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240094a0 con 0x7f5b34160bc0 2023-07-06T01:09:03.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc0037fe700 1 -- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc004160900 msgr2=0x7fc0040c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc0037fe700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc004160900 0x7fc0040c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc0037fe700 1 -- 172.21.15.71:0/1517288314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040aeb40 msgr2=0x7fc0040c2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc0037fe700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040aeb40 0x7fc0040c2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc0037fe700 1 -- 172.21.15.71:0/1517288314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc009a70 con 0x7fc0040b0440 2023-07-06T01:09:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc0037fe700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 0x7fc0040ae600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c780 tx=0x7fbff800ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fc003fff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040aeb40 0x7fc0040c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fe9b0bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 0x7fe9ac0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fe9b0bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ac0cf780 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fe9b0bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ac0cd490 con 0x7fe9ac0b6100 2023-07-06T01:09:03.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fe9b0bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0cd770 con 0x7fe9ac15fca0 2023-07-06T01:09:03.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7f5b3a99c700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b341509e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b990 tx=0x7f5b2c00bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 0x7fe9ac0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fe9aa59c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 0x7fe9ac0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42032/0 (socket says 172.21.15.71:42032) 2023-07-06T01:09:03.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2082670396 learned_addr learned my addr 172.21.15.71:0/2082670396 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00c930 con 0x7f5b34160bc0 2023-07-06T01:09:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c00ca90 con 0x7f5b34160bc0 2023-07-06T01:09:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00ce40 con 0x7f5b34160bc0 2023-07-06T01:09:03.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8004c80 con 0x7fc0040b0440 2023-07-06T01:09:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8004de0 con 0x7fc0040b0440 2023-07-06T01:09:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.592+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80072f0 con 0x7fc0040b0440 2023-07-06T01:09:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0040b3350 con 0x7fc0040b0440 2023-07-06T01:09:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2082670396 >> v1:172.21.15.194:6789/0 conn(0x7fe9ac0b6100 legacy=0x7fe9ac0cfc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T01:09:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2082670396 >> v1:172.21.15.71:6789/0 conn(0x7fe9ac0b5c90 legacy=0x7fe9ac0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2082670396 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac0cda50 con 0x7fe9ac15fca0 2023-07-06T01:09:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fb4bdd9b700 1 -- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4b4003a30 msgr2=0x7fb4b4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fb4bdd9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4b4003a30 0x7fb4b4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fb4bdd9b700 1 -- 172.21.15.71:0/1895512048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4005200 msgr2=0x7fb4b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fb4bdd9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4005200 0x7fb4b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.591+0000 7fb4bdd9b700 1 -- 172.21.15.71:0/1895512048 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40035b0 con 0x7fb4b4004850 2023-07-06T01:09:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fb4bdd9b700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b4004850 0x7fb4b4004cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8164920 tx=0x7fb4b4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2735c0a5d7562e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f3d86fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d800b8660 0x7f3d800ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f3d86fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d800cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f3d86fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800d0130 con 0x7f3d800cfcb0 2023-07-06T01:09:03.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f3d86fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800cda40 con 0x7f3d800b8660 2023-07-06T01:09:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7f3d86fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800cd480 con 0x7f3d800b2180 2023-07-06T01:09:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800c070 con 0x7fb4b4004850 2023-07-06T01:09:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8013630 con 0x7fb4b4004850 2023-07-06T01:09:03.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fb4c5d9b700 1 -- 172.21.15.71:0/1895512048 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80139c0 con 0x7fb4b4004850 2023-07-06T01:09:03.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.593+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004160320 con 0x7fc0040b0440 2023-07-06T01:09:03.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d800cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d800cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42034/0 (socket says 172.21.15.71:42034) 2023-07-06T01:09:03.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f3d7ffff700 1 -- 172.21.15.71:0/3780561423 learned_addr learned my addr 172.21.15.71:0/3780561423 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b341634a0 con 0x7f5b34160bc0 2023-07-06T01:09:03.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b34163a60 con 0x7f5b34160bc0 2023-07-06T01:09:03.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f6893dff700 1 Processor -- start 2023-07-06T01:09:03.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f3d84d9b700 1 --2- 172.21.15.71:0/3780561423 >> v2:172.21.15.71:3300/0 conn(0x7f3d800b8660 0x7f3d800ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7fb4ccbff700 1 -- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b4004850 msgr2=0x7fb4b4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/1895512048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b4004850 0x7fb4b4004cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8164920 tx=0x7fb4b4005880 comp rx=0 tx=0).stop 2023-07-06T01:09:03.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7fb4c6d9d700 1 -- 172.21.15.71:0/1895512048 reap_dead start 2023-07-06T01:09:03.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f3d7ffff700 1 -- 172.21.15.71:0/3780561423 >> v2:172.21.15.71:3300/0 conn(0x7f3d800b8660 msgr2=0x7f3d800ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7f3d7ffff700 1 --2- 172.21.15.71:0/3780561423 >> v2:172.21.15.71:3300/0 conn(0x7f3d800b8660 0x7f3d800ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7f3d7ffff700 1 -- 172.21.15.71:0/3780561423 >> v1:172.21.15.194:6789/0 conn(0x7f3d800cfcb0 legacy=0x7f3d80160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7f3d7ffff700 1 -- 172.21.15.71:0/3780561423 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800cd760 con 0x7f3d800b2180 2023-07-06T01:09:03.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7f3d7ffff700 1 --2- 172.21.15.71:0/3780561423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d800cf770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098f0 tx=0x7f3d70009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff342d097835a60 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7f6893dff700 1 -- start start 2023-07-06T01:09:03.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0040008d0 con 0x7fc0040b0440 2023-07-06T01:09:03.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7fc1ee1ff700 1 Processor -- start 2023-07-06T01:09:03.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.595+0000 7fc1ee1ff700 1 -- start start 2023-07-06T01:09:03.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7fb4ccbff700 1 -- 172.21.15.71:0/1895512048 shutdown_connections 2023-07-06T01:09:03.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7fb4ccbff700 1 -- 172.21.15.71:0/1895512048 >> 172.21.15.71:0/1895512048 conn(0x7fb4c80cb440 msgr2=0x7fb4c80cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7f3d7f7fe700 1 -- 172.21.15.71:0/3780561423 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70004230 con 0x7f3d800b2180 2023-07-06T01:09:03.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7f3d7f7fe700 1 -- 172.21.15.71:0/3780561423 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70004390 con 0x7f3d800b2180 2023-07-06T01:09:03.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7f3d7f7fe700 1 -- 172.21.15.71:0/3780561423 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d700036a0 con 0x7f3d800b2180 2023-07-06T01:09:03.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbff8007450 con 0x7fc0040b0440 2023-07-06T01:09:03.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7fbfebfff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbff006adb0 0x7fbff006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbff80891b0 con 0x7fc0040b0440 2023-07-06T01:09:03.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7fb4ccbff700 1 -- 172.21.15.71:0/1895512048 shutdown_connections 2023-07-06T01:09:03.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7fb4ccbff700 1 -- 172.21.15.71:0/1895512048 wait complete. 2023-07-06T01:09:03.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7fb4ccbff700 1 Processor -- start 2023-07-06T01:09:03.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f3d86fff700 1 -- 172.21.15.71:0/3780561423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 msgr2=0x7f3d800cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f3d86fff700 1 --2- 172.21.15.71:0/3780561423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d800cf770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098f0 tx=0x7f3d70009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:03.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7fc1ee1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e806fd00 0x7fc1e815c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7fc1ee1ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1e815cac0 0x7fc1e815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7fc1ee1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e8072030 con 0x7fc1e8067000 2023-07-06T01:09:03.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7fc1ee1ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e8070170 con 0x7fc1e815cac0 2023-07-06T01:09:03.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7fc1ee1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8071860 con 0x7fc1e806fd00 2023-07-06T01:09:03.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7fc1e7fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1e815cac0 0x7fc1e815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7f6893dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7f6893dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f688c0b5c90 0x7f688c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6893dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f688c0b6100 0x7f688c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6893dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0cf780 con 0x7f688c0b6100 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6893dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0cd490 con 0x7f688c0b5c90 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6893dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0cd770 con 0x7f688c15fca0 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6891b9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6891b9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42046/0 (socket says 172.21.15.71:42046) 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f6891b9b700 1 -- 172.21.15.71:0/2303962751 learned_addr learned my addr 172.21.15.71:0/2303962751 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f689139a700 1 --2- 172.21.15.71:0/2303962751 >> v2:172.21.15.194:3300/0 conn(0x7f688c0b5c90 0x7f688c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f689139a700 1 -- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 msgr2=0x7f688c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f689139a700 1 --2- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f689139a700 1 -- 172.21.15.71:0/2303962751 >> v2:172.21.15.71:3300/0 conn(0x7f688c0b6100 msgr2=0x7f688c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f689139a700 1 --2- 172.21.15.71:0/2303962751 >> v2:172.21.15.71:3300/0 conn(0x7f688c0b6100 0x7f688c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.598+0000 7f689139a700 1 -- 172.21.15.71:0/2303962751 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0cda50 con 0x7f688c0b5c90 2023-07-06T01:09:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.594+0000 7fe9aa59c700 1 --2- 172.21.15.71:0/2082670396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 0x7fe9ac0d1420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009e80 tx=0x7fe99c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df10c1ce0e0a756 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.596+0000 7fe9a9d9b700 1 -- 172.21.15.71:0/2082670396 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00e070 con 0x7fe9ac15fca0 2023-07-06T01:09:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7f3d86fff700 1 -- 172.21.15.71:0/3780561423 shutdown_connections 2023-07-06T01:09:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7f3d86fff700 1 --2- 172.21.15.71:0/3780561423 >> v2:172.21.15.71:3300/0 conn(0x7f3d800b8660 0x7f3d800ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7f3d86fff700 1 --2- 172.21.15.71:0/3780561423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d800cf770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7f3d86fff700 1 -- 172.21.15.71:0/3780561423 >> 172.21.15.71:0/3780561423 conn(0x7f3d80071690 msgr2=0x7f3d80071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7f3d86fff700 1 -- 172.21.15.71:0/3780561423 shutdown_connections 2023-07-06T01:09:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7f3d86fff700 1 -- 172.21.15.71:0/3780561423 wait complete. 2023-07-06T01:09:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7fc1e7fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1e815cac0 0x7fc1e815cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60946/0 (socket says 172.21.15.71:60946) 2023-07-06T01:09:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.599+0000 7fc1e7fff700 1 -- 172.21.15.71:0/1872467830 learned_addr learned my addr 172.21.15.71:0/1872467830 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.597+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c0052f0 con 0x7f5b34160bc0 2023-07-06T01:09:03.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b2c006d50 con 0x7f5b34160bc0 2023-07-06T01:09:03.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fc002ffd700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbff006adb0 0x7fbff006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fb4ccbff700 1 -- start start 2023-07-06T01:09:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fc1e7fff700 1 -- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e806fd00 msgr2=0x7fc1e815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fc1e7fff700 1 --2- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e806fd00 0x7fc1e815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fc1e7fff700 1 -- 172.21.15.71:0/1872467830 >> v1:172.21.15.194:6789/0 conn(0x7fc1e8067000 legacy=0x7fc1e80ae1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T01:09:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fc1e7fff700 1 -- 172.21.15.71:0/1872467830 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8071d50 con 0x7fc1e815cac0 2023-07-06T01:09:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fe9a9d9b700 1 -- 172.21.15.71:0/2082670396 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c003a20 con 0x7fe9ac15fca0 2023-07-06T01:09:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.600+0000 7fe9a9d9b700 1 -- 172.21.15.71:0/2082670396 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c003dd0 con 0x7fe9ac15fca0 2023-07-06T01:09:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fc1e7fff700 1 --2- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e815cac0 0x7fc1e815cf40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009e50 tx=0x7fc1e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279ef677cc1310fb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fb4ccbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4004850 0x7fb4c815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fb4ccbff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c815fa60 0x7fb4c8163190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fb4ccbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 0x7fb4c81636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fb4ccbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80b27b0 con 0x7fb4b4004850 2023-07-06T01:09:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fb4ccbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c81f3340 con 0x7fb4c815ff90 2023-07-06T01:09:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7fb4ccbff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c81f3620 con 0x7fb4c815fa60 2023-07-06T01:09:03.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.601+0000 7f689139a700 1 --2- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b5c90 0x7f688c0d2d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f688c06cda0 tx=0x7f6888009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eefd9a675b555fb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7f5b2affd700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5b1806adb0 0x7f5b1806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 0x7fb4c81636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c6d9d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 0x7fb4c81636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:60962/0 (socket says 172.21.15.71:60962) 2023-07-06T01:09:03.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c6d9d700 1 -- 172.21.15.71:0/3048411999 learned_addr learned my addr 172.21.15.71:0/3048411999 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7f3d86fff700 1 Processor -- start 2023-07-06T01:09:03.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c659c700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4004850 0x7fb4c815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b2c088f20 con 0x7f5b34160bc0 2023-07-06T01:09:03.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2082670396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 msgr2=0x7fe9ac0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2082670396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 0x7fe9ac0d1420 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009e80 tx=0x7fe99c00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:03.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4bdd9b700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c815fa60 0x7fb4c8163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7f3d86fff700 1 -- start start 2023-07-06T01:09:03.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7f5b3a19b700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5b1806adb0 0x7f5b1806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c6d9d700 1 -- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c815fa60 msgr2=0x7fb4c8163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c6d9d700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c815fa60 0x7fb4c8163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fb4c6d9d700 1 -- 172.21.15.71:0/3048411999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4004850 msgr2=0x7fb4c815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fb4c6d9d700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4004850 0x7fb4c815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fb4c6d9d700 1 -- 172.21.15.71:0/3048411999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80b2a00 con 0x7fb4c815ff90 2023-07-06T01:09:03.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fc002ffd700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbff006adb0 0x7fbff006d260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0040c15a0 tx=0x7fbff4006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2082670396 shutdown_connections 2023-07-06T01:09:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.602+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2082670396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac15fca0 0x7fe9ac0d1420 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2082670396 >> 172.21.15.71:0/2082670396 conn(0x7fe9ac06c150 msgr2=0x7fe9ac06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2082670396 shutdown_connections 2023-07-06T01:09:03.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fb4c6d9d700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 0x7fb4c81636d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806ede0 tx=0x7fb4c000cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2082670396 wait complete. 2023-07-06T01:09:03.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7f5b3a19b700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5b1806adb0 0x7f5b1806d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b240097c0 tx=0x7f5b2401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7f3d86fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d801e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.603+0000 7f3d86fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d800b8660 0x7f3d8015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d86fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d800cfcb0 0x7f3d800d2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d86fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801e83d0 con 0x7f3d800cfcb0 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d86fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801e86b0 con 0x7f3d800b8660 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d86fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d801e8990 con 0x7f3d800b2180 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d801e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d800b8660 0x7f3d8015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d801e7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42074/0 (socket says 172.21.15.71:42074) 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 -- 172.21.15.71:0/1653451750 learned_addr learned my addr 172.21.15.71:0/1653451750 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d8559c700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d800cfcb0 0x7f3d800d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 -- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d800b8660 msgr2=0x7f3d8015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d800b8660 0x7f3d8015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 -- 172.21.15.71:0/1653451750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d800cfcb0 msgr2=0x7f3d800d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d800cfcb0 0x7f3d800d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.604+0000 7f3d84d9b700 1 -- 172.21.15.71:0/1653451750 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009550 con 0x7f3d800b2180 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.605+0000 7f3d7ffff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d800b8660 0x7f3d8015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:03.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.605+0000 7f3d84d9b700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d801e7b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800efc0 tx=0x7f3d7800c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.605+0000 7fe9b0bff700 1 Processor -- start 2023-07-06T01:09:03.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbff80542d0 con 0x7fc0040b0440 2023-07-06T01:09:03.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000a520 con 0x7fb4c815ff90 2023-07-06T01:09:03.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c000a680 con 0x7fb4c815ff90 2023-07-06T01:09:03.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000aa10 con 0x7fb4c815ff90 2023-07-06T01:09:03.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fe9b0bff700 1 -- start start 2023-07-06T01:09:03.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fc1e67fc700 1 -- 172.21.15.71:0/1872467830 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000e070 con 0x7fc1e815cac0 2023-07-06T01:09:03.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fc1e67fc700 1 -- 172.21.15.71:0/1872467830 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0003a20 con 0x7fc1e815cac0 2023-07-06T01:09:03.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fc1e67fc700 1 -- 172.21.15.71:0/1872467830 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0003dd0 con 0x7fc1e815cac0 2023-07-06T01:09:03.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.606+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c80b2ce0 con 0x7fb4c815ff90 2023-07-06T01:09:03.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e815cac0 msgr2=0x7fc1e815cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e815cac0 0x7fc1e815cf40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009e50 tx=0x7fc1e000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:03.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c81f2ff0 con 0x7fb4c815ff90 2023-07-06T01:09:03.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b2c053fc0 con 0x7f5b34160bc0 2023-07-06T01:09:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fe9b0bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9ac0b5c90 0x7fe9ac157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fe9b0bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac0b6100 0x7fe9ac15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fe9b0bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9ac15fca0 0x7fe9ac158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fe9b0bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac15ccc0 con 0x7fe9ac15fca0 2023-07-06T01:09:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fe9b0bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac15cfa0 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.607+0000 7fe9b0bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac15d280 con 0x7fe9ac0b6100 2023-07-06T01:09:03.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fe9aad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9ac15fca0 0x7fe9ac158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fe9aad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9ac15fca0 0x7fe9ac158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42980/0 (socket says 172.21.15.71:42980) 2023-07-06T01:09:03.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fe9aad9d700 1 -- 172.21.15.71:0/2805473037 learned_addr learned my addr 172.21.15.71:0/2805473037 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fe9aa59c700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9ac0b5c90 0x7fe9ac157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c80008d0 con 0x7fb4c815ff90 2023-07-06T01:09:03.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.609+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac0b6100 msgr2=0x7fe9ac15c1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:03.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800cb50 con 0x7f3d800b2180 2023-07-06T01:09:03.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800f040 con 0x7f3d800b2180 2023-07-06T01:09:03.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78014480 con 0x7f3d800b2180 2023-07-06T01:09:03.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d801e5dd0 con 0x7f3d800b2180 2023-07-06T01:09:03.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/1872467830 shutdown_connections 2023-07-06T01:09:03.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e815cac0 0x7fc1e815cf40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/1872467830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e806fd00 0x7fc1e815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/1872467830 >> 172.21.15.71:0/1872467830 conn(0x7fc1e80cc600 msgr2=0x7fc1e80ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f6890b99700 1 -- 172.21.15.71:0/2303962751 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888011830 con 0x7f688c0b5c90 2023-07-06T01:09:03.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f6890b99700 1 -- 172.21.15.71:0/2303962751 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888011990 con 0x7f688c0b5c90 2023-07-06T01:09:03.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.608+0000 7f6890b99700 1 -- 172.21.15.71:0/2303962751 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888011d20 con 0x7f688c0b5c90 2023-07-06T01:09:03.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fe9a1d9b700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac0b6100 0x7fe9ac15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fe9aa59c700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac0b6100 0x7fe9ac15c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2805473037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9ac15fca0 msgr2=0x7fe9ac158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fe9aa59c700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9ac15fca0 0x7fe9ac158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fe9aa59c700 1 -- 172.21.15.71:0/2805473037 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c009b30 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4c000ab70 con 0x7fb4c815ff90 2023-07-06T01:09:03.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.609+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d801e8c70 con 0x7f3d800b2180 2023-07-06T01:09:03.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7fe9aa59c700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9ac0b5c90 0x7fe9ac157590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe99c014000 tx=0x7fe99c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.611+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d800008d0 con 0x7f3d800b2180 2023-07-06T01:09:03.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.609+0000 7f6893dff700 1 -- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b5c90 msgr2=0x7f688c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.609+0000 7f6893dff700 1 --2- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b5c90 0x7f688c0d2d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f688c06cda0 tx=0x7f6888009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:03.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7f6893dff700 1 -- 172.21.15.71:0/2303962751 shutdown_connections 2023-07-06T01:09:03.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7f6893dff700 1 --2- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7f6893dff700 1 --2- 172.21.15.71:0/2303962751 >> v2:172.21.15.71:3300/0 conn(0x7f688c0b6100 0x7f688c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7f6893dff700 1 --2- 172.21.15.71:0/2303962751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b5c90 0x7f688c0d2d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.610+0000 7f6893dff700 1 -- 172.21.15.71:0/2303962751 >> 172.21.15.71:0/2303962751 conn(0x7f688c06c150 msgr2=0x7f688c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.613+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/1872467830 shutdown_connections 2023-07-06T01:09:03.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.613+0000 7f6893dff700 1 -- 172.21.15.71:0/2303962751 shutdown_connections 2023-07-06T01:09:03.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.611+0000 7fb4bf7fe700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ace0 0x7fb4a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.612+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4c0088cc0 con 0x7fb4c815ff90 2023-07-06T01:09:03.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.612+0000 7fb4c659c700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ace0 0x7fb4a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.612+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d780145e0 con 0x7f3d800b2180 2023-07-06T01:09:03.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.613+0000 7fb4c659c700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ace0 0x7fb4a806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001050 tx=0x7fb4b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.614+0000 7f3d7d7fa700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3d6c06adb0 0x7f3d6c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.614+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d7808a460 con 0x7f3d800b2180 2023-07-06T01:09:03.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.614+0000 7f3d7ffff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3d6c06adb0 0x7f3d6c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.615+0000 7f3d7ffff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3d6c06adb0 0x7f3d6c06d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000c00 tx=0x7f3d70008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.616+0000 7f58987ff700 1 Processor -- start 2023-07-06T01:09:03.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.616+0000 7f58987ff700 1 -- start start 2023-07-06T01:09:03.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d780554f0 con 0x7f3d800b2180 2023-07-06T01:09:03.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4c008f080 con 0x7fb4c815ff90 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.613+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/1872467830 wait complete. 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.616+0000 7fc1ee1ff700 1 Processor -- start 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.616+0000 7fc1ee1ff700 1 -- start start 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7fc1ee1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 0x7fc1e80afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7fc1ee1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e806fd00 0x7fc1e80af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7fc1ee1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e815cac0 0x7fc1e815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7fc1ee1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80af910 con 0x7fc1e815cac0 2023-07-06T01:09:03.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7fc1ee1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80b0350 con 0x7fc1e806fd00 2023-07-06T01:09:03.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7fc1ee1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80b0630 con 0x7fc1e8067000 2023-07-06T01:09:03.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7fc1e77fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 0x7fc1e80afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7fc1e77fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 0x7fc1e80afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42086/0 (socket says 172.21.15.71:42086) 2023-07-06T01:09:03.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7fc1e77fe700 1 -- 172.21.15.71:0/633910991 learned_addr learned my addr 172.21.15.71:0/633910991 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7fc1e6ffd700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e806fd00 0x7fc1e80af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f58987ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 0x7f58900d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f58987ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900cf780 con 0x7f58900b5c90 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f58987ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900cd490 con 0x7f58900b6100 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f58987ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900cd770 con 0x7f589015fca0 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f589659b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 0x7f58900d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f589659b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 0x7f58900d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42092/0 (socket says 172.21.15.71:42092) 2023-07-06T01:09:03.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f589659b700 1 -- 172.21.15.71:0/3802352286 learned_addr learned my addr 172.21.15.71:0/3802352286 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.613+0000 7f6893dff700 1 -- 172.21.15.71:0/2303962751 wait complete. 2023-07-06T01:09:03.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.615+0000 7f6893dff700 1 Processor -- start 2023-07-06T01:09:03.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.616+0000 7f6893dff700 1 -- start start 2023-07-06T01:09:03.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f6893dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 0x7f688c13d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f6893dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b6100 0x7f688c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f6893dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f6893dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c152360 con 0x7f688c0b5c90 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f6893dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c13d8e0 con 0x7f688c0b6100 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f6893dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c14f910 con 0x7f688c15fca0 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.617+0000 7f689139a700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b6100 0x7f688c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 0x7f688c13d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 0x7f688c13d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42994/0 (socket says 172.21.15.71:42994) 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 -- 172.21.15.71:0/2611846069 learned_addr learned my addr 172.21.15.71:0/2611846069 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 -- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 msgr2=0x7f688c0b76a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0b76a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 -- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b6100 msgr2=0x7f688c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b6100 0x7f688c0cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.618+0000 7f6891b9b700 1 -- 172.21.15.71:0/2611846069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880094a0 con 0x7f688c0b5c90 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f6891b9b700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 0x7f688c13d3a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f688400efc0 tx=0x7f688400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.620+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400cbb0 con 0x7f688c0b5c90 2023-07-06T01:09:03.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.620+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c0cb830 con 0x7f688c0b5c90 2023-07-06T01:09:03.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.621+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c004440 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.621+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99c0045a0 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.621+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ac15d560 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f589659b700 1 -- 172.21.15.71:0/3802352286 >> v1:172.21.15.194:6789/0 conn(0x7f58900b6100 legacy=0x7f58900cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:03.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f589659b700 1 -- 172.21.15.71:0/3802352286 >> v1:172.21.15.71:6789/0 conn(0x7f58900b5c90 legacy=0x7f58900d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.619+0000 7f589659b700 1 -- 172.21.15.71:0/3802352286 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900cda50 con 0x7f589015fca0 2023-07-06T01:09:03.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.620+0000 7f589659b700 1 --2- 172.21.15.71:0/3802352286 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 0x7f58900d1420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f588c009920 tx=0x7f588c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3cdbf700273101f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.620+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400f040 con 0x7f688c0b5c90 2023-07-06T01:09:03.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.620+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c0ca7b0 con 0x7f688c0b5c90 2023-07-06T01:09:03.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.620+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6884009e90 con 0x7f688c0b5c90 2023-07-06T01:09:03.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.622+0000 7fc1e77fe700 1 -- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e806fd00 msgr2=0x7fc1e80af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.622+0000 7fc1e77fe700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e806fd00 0x7fc1e80af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.622+0000 7fc1e77fe700 1 -- 172.21.15.71:0/633910991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e815cac0 msgr2=0x7fc1e815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.622+0000 7fc1e77fe700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e815cac0 0x7fc1e815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.622+0000 7fc1e77fe700 1 -- 172.21.15.71:0/633910991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0009b30 con 0x7fc1e8067000 2023-07-06T01:09:03.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.621+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99c004950 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.621+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac0b4bc0 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.622+0000 7fc1e77fe700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 0x7fc1e80afc90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b450 tx=0x7fc1d800b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.623+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6884014480 con 0x7f688c0b5c90 2023-07-06T01:09:03.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.624+0000 7f68827fc700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f687006ace0 0x7f687006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.625+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6884089a00 con 0x7f688c0b5c90 2023-07-06T01:09:03.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.623+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8011830 con 0x7fc1e8067000 2023-07-06T01:09:03.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.623+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80119b0 con 0x7fc1e8067000 2023-07-06T01:09:03.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.623+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8011d60 con 0x7fc1e8067000 2023-07-06T01:09:03.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.624+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e80b0910 con 0x7fc1e8067000 2023-07-06T01:09:03.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.624+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e8149580 con 0x7fc1e8067000 2023-07-06T01:09:03.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.625+0000 7f689139a700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f687006ace0 0x7f687006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.626+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e8068270 con 0x7fc1e8067000 2023-07-06T01:09:03.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.623+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac15d3c0 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.625+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe99c026450 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.627+0000 7fe9a37fe700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe98c06adb0 0x7fe98c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.627+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe99c08b020 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.626+0000 7f5895599700 1 -- 172.21.15.71:0/3802352286 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c004230 con 0x7f589015fca0 2023-07-06T01:09:03.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.626+0000 7f5895599700 1 -- 172.21.15.71:0/3802352286 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c004390 con 0x7f589015fca0 2023-07-06T01:09:03.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.626+0000 7f5895599700 1 -- 172.21.15.71:0/3802352286 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c009e70 con 0x7f589015fca0 2023-07-06T01:09:03.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7f58987ff700 1 -- 172.21.15.71:0/3802352286 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 msgr2=0x7f58900d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:03.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7f58987ff700 1 --2- 172.21.15.71:0/3802352286 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 0x7f58900d1420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f588c009920 tx=0x7f588c009c30 comp rx=0 tx=0).stop 2023-07-06T01:09:03.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68740052f0 con 0x7f688c0b5c90 2023-07-06T01:09:03.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7f58987ff700 1 -- 172.21.15.71:0/3802352286 shutdown_connections 2023-07-06T01:09:03.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7f58987ff700 1 --2- 172.21.15.71:0/3802352286 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f589015fca0 0x7f58900d1420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7f58987ff700 1 -- 172.21.15.71:0/3802352286 >> 172.21.15.71:0/3802352286 conn(0x7f589006c150 msgr2=0x7f589006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:03.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.628+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1d801a400 con 0x7fc1e8067000 2023-07-06T01:09:03.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.629+0000 7fe9a1d9b700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe98c06adb0 0x7fe98c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.631+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe99c056260 con 0x7fe9ac0b5c90 2023-07-06T01:09:03.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.631+0000 7fe9a1d9b700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe98c06adb0 0x7fe98c06d260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0b8d50 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.629+0000 7fc1cffff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc1d406adb0 0x7fc1d406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.630+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1d80899e0 con 0x7fc1e8067000 2023-07-06T01:09:03.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.630+0000 7fc1e6ffd700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc1d406adb0 0x7fc1d406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.631+0000 7fc1e6ffd700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc1d406adb0 0x7fc1d406d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc006fd0 tx=0x7fc1dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.629+0000 7f689139a700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f687006ace0 0x7f687006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f688c0b3c80 tx=0x7f6888010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.629+0000 7f58987ff700 1 -- 172.21.15.71:0/3802352286 shutdown_connections 2023-07-06T01:09:03.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.629+0000 7f58987ff700 1 -- 172.21.15.71:0/3802352286 wait complete. 2023-07-06T01:09:03.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.632+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1d8054b00 con 0x7fc1e8067000 2023-07-06T01:09:03.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.632+0000 7f58987ff700 1 Processor -- start 2023-07-06T01:09:03.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.633+0000 7f58987ff700 1 -- start start 2023-07-06T01:09:03.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.634+0000 7f58987ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 0x7f58900b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.634+0000 7f58987ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58900b6100 0x7f58900d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.634+0000 7f58987ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f589015fca0 0x7f58900d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.634+0000 7f58987ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b50b0 con 0x7f58900b5c90 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.634+0000 7f58987ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b5390 con 0x7f589015fca0 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.634+0000 7f58987ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900b5670 con 0x7f58900b6100 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.636+0000 7f589659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 0x7f58900b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.636+0000 7f589659b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 0x7f58900b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43018/0 (socket says 172.21.15.71:43018) 2023-07-06T01:09:03.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.636+0000 7f589659b700 1 -- 172.21.15.71:0/1874353531 learned_addr learned my addr 172.21.15.71:0/1874353531 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:03.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.636+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6884054a10 con 0x7f688c0b5c90 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.637+0000 7f589659b700 1 -- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58900b6100 msgr2=0x7f58900d2b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.637+0000 7f589659b700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58900b6100 0x7f58900d2b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.637+0000 7f589659b700 1 -- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f589015fca0 msgr2=0x7f58900d30a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.637+0000 7f589659b700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f589015fca0 0x7f58900d30a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.637+0000 7f589659b700 1 -- 172.21.15.71:0/1874353531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c009550 con 0x7f58900b5c90 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.637+0000 7f589659b700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 0x7f58900b47b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f588c000c00 tx=0x7f588c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:03.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.638+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0036a0 con 0x7f58900b5c90 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.638+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c003800 con 0x7f58900b5c90 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.638+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c003bb0 con 0x7f58900b5c90 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.638+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589015b830 con 0x7f58900b5c90 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.638+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58900b4cf0 con 0x7f58900b5c90 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.642+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f588c021070 con 0x7f58900b5c90 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.644+0000 7f5886ffd700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f587406adb0 0x7f587406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:03.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.644+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f588c08acd0 con 0x7f58900b5c90 2023-07-06T01:09:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.645+0000 7f5895d9a700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f587406adb0 0x7f587406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.645+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58780052f0 con 0x7f58900b5c90 2023-07-06T01:09:03.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.656+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f588c055df0 con 0x7f58900b5c90 2023-07-06T01:09:03.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:03.691+0000 7f5895d9a700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f587406adb0 0x7f587406d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5880000f60 tx=0x7f5880007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:04.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.057+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0041604b0 con 0x7fc0040b0440 2023-07-06T01:09:04.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.059+0000 7fbfebfff700 1 -- 172.21.15.71:0/1517288314 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbff80578f0 con 0x7fc0040b0440 2023-07-06T01:09:04.064 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:04.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b1c0055a0 con 0x7f5b34160bc0 2023-07-06T01:09:04.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbff006adb0 msgr2=0x7fbff006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbff006adb0 0x7fbff006d260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0040c15a0 tx=0x7fbff4006f90 comp rx=0 tx=0).stop 2023-07-06T01:09:04.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 msgr2=0x7fc0040ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 0x7fc0040ae600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c780 tx=0x7fbff800ca90 comp rx=0 tx=0).stop 2023-07-06T01:09:04.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.064+0000 7f5b2affd700 1 -- 172.21.15.71:0/1976406904 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b2c019020 con 0x7f5b34160bc0 2023-07-06T01:09:04.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 shutdown_connections 2023-07-06T01:09:04.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbff006adb0 0x7fbff006d260 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0040aeb40 0x7fc0040c2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0040b0440 0x7fc0040ae600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 --2- 172.21.15.71:0/1517288314 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc004160900 0x7fc0040c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.063+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 >> 172.21.15.71:0/1517288314 conn(0x7fc0040cb440 msgr2=0x7fc004070830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.064+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 shutdown_connections 2023-07-06T01:09:04.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.064+0000 7fc00a1ff700 1 -- 172.21.15.71:0/1517288314 wait complete. 2023-07-06T01:09:04.070 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:04.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5b1806adb0 msgr2=0x7f5b1806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5b1806adb0 0x7f5b1806d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b240097c0 tx=0x7f5b2401c040 comp rx=0 tx=0).stop 2023-07-06T01:09:04.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 msgr2=0x7f5b341509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b341509e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b990 tx=0x7f5b2c00bca0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 shutdown_connections 2023-07-06T01:09:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5b1806adb0 0x7f5b1806d260 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b240097c0 tx=0x7f5b2401c040 comp rx=0 tx=0).stop 2023-07-06T01:09:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b34160bc0 0x7f5b341509e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b340ad8f0 0x7f5b340b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 --2- 172.21.15.71:0/1976406904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5b340c1870 0x7f5b340b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.069+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 >> 172.21.15.71:0/1976406904 conn(0x7f5b340cb440 msgr2=0x7f5b34070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.070+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d801e8ad0 con 0x7f3d800b2180 2023-07-06T01:09:04.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.070+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 shutdown_connections 2023-07-06T01:09:04.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.070+0000 7f5b3c3ff700 1 -- 172.21.15.71:0/1976406904 wait complete. 2023-07-06T01:09:04.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.071+0000 7f3d7d7fa700 1 -- 172.21.15.71:0/1653451750 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d801e8ad0 con 0x7f3d800b2180 2023-07-06T01:09:04.075 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3d6c06adb0 msgr2=0x7f3d6c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3d6c06adb0 0x7f3d6c06d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000c00 tx=0x7f3d70008030 comp rx=0 tx=0).stop 2023-07-06T01:09:04.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 msgr2=0x7f3d801e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d801e7b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800efc0 tx=0x7f3d7800c0c0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 shutdown_connections 2023-07-06T01:09:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3d6c06adb0 0x7f3d6c06d260 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000c00 tx=0x7f3d70008030 comp rx=0 tx=0).stop 2023-07-06T01:09:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d800cfcb0 0x7f3d800d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d800b2180 0x7f3d801e7b40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 --2- 172.21.15.71:0/1653451750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d800b8660 0x7f3d8015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.075+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 >> 172.21.15.71:0/1653451750 conn(0x7f3d80071690 msgr2=0x7f3d800b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.077+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 shutdown_connections 2023-07-06T01:09:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.080+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb4c80b4940 con 0x7fb4c815ff90 2023-07-06T01:09:04.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.081+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9ac15d3c0 con 0x7fe9ac0b5c90 2023-07-06T01:09:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.081+0000 7f3d86fff700 1 -- 172.21.15.71:0/1653451750 wait complete. 2023-07-06T01:09:04.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.082+0000 7fe9a37fe700 1 -- 172.21.15.71:0/2805473037 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9ac15d3c0 con 0x7fe9ac0b5c90 2023-07-06T01:09:04.086 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-07-06T01:09:04.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.082+0000 7fb4bf7fe700 1 -- 172.21.15.71:0/3048411999 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4c0017090 con 0x7fb4c815ff90 2023-07-06T01:09:04.088 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-07-06T01:09:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.085+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc1e80008d0 con 0x7fc1e8067000 2023-07-06T01:09:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.085+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f68740055a0 con 0x7f688c0b5c90 2023-07-06T01:09:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.086+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ace0 msgr2=0x7fb4a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.086+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ace0 0x7fb4a806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001050 tx=0x7fb4b0009040 comp rx=0 tx=0).stop 2023-07-06T01:09:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.086+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 msgr2=0x7fb4c81636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.086+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 0x7fb4c81636d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806ede0 tx=0x7fb4c000cd80 comp rx=0 tx=0).stop 2023-07-06T01:09:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 shutdown_connections 2023-07-06T01:09:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ace0 0x7fb4a806d190 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0001050 tx=0x7fb4b0009040 comp rx=0 tx=0).stop 2023-07-06T01:09:04.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4c815ff90 0x7fb4c81636d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4b4004850 0x7fb4c815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 --2- 172.21.15.71:0/3048411999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4c815fa60 0x7fb4c8163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 >> 172.21.15.71:0/3048411999 conn(0x7fb4c80cb440 msgr2=0x7fb4c806f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fc1cffff700 1 -- 172.21.15.71:0/633910991 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1d8058120 con 0x7fc1e8067000 2023-07-06T01:09:04.091 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-07-06T01:09:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7f68827fc700 1 -- 172.21.15.71:0/2611846069 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6884058030 con 0x7f688c0b5c90 2023-07-06T01:09:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 shutdown_connections 2023-07-06T01:09:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.087+0000 7fb4ccbff700 1 -- 172.21.15.71:0/3048411999 wait complete. 2023-07-06T01:09:04.093 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2023-07-06T01:09:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.090+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe98c06adb0 msgr2=0x7fe98c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe98c06adb0 0x7fe98c06d260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0b8d50 tx=0x7fe994009040 comp rx=0 tx=0).stop 2023-07-06T01:09:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9ac0b5c90 msgr2=0x7fe9ac157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9ac0b5c90 0x7fe9ac157590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe99c014000 tx=0x7fe99c004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 shutdown_connections 2023-07-06T01:09:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe98c06adb0 0x7fe98c06d260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9ac15fca0 0x7fe9ac158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9ac0b5c90 0x7fe9ac157590 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe99c014000 tx=0x7fe99c004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 --2- 172.21.15.71:0/2805473037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9ac0b6100 0x7fe9ac15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 >> 172.21.15.71:0/2805473037 conn(0x7fe9ac06c150 msgr2=0x7fe9ac06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc1d406adb0 msgr2=0x7fc1d406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc1d406adb0 0x7fc1d406d260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc006fd0 tx=0x7fc1dc008040 comp rx=0 tx=0).stop 2023-07-06T01:09:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 msgr2=0x7fc1e80afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 0x7fc1e80afc90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800b450 tx=0x7fc1d800b810 comp rx=0 tx=0).stop 2023-07-06T01:09:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 shutdown_connections 2023-07-06T01:09:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc1d406adb0 0x7fc1d406d260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1e815cac0 0x7fc1e815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc1e8067000 0x7fc1e80afc90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 --2- 172.21.15.71:0/633910991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e806fd00 0x7fc1e80af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 >> 172.21.15.71:0/633910991 conn(0x7fc1e80cc600 msgr2=0x7fc1e806c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 shutdown_connections 2023-07-06T01:09:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7fc1ee1ff700 1 -- 172.21.15.71:0/633910991 wait complete. 2023-07-06T01:09:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.091+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f687006ace0 msgr2=0x7f687006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f687006ace0 0x7f687006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f688c0b3c80 tx=0x7f6888010000 comp rx=0 tx=0).stop 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 msgr2=0x7f688c13d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 0x7f688c13d3a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f688400efc0 tx=0x7f688400c3a0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 shutdown_connections 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f687006ace0 0x7f687006d190 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f688c0b3c80 tx=0x7f6888010000 comp rx=0 tx=0).stop 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f688c15fca0 0x7f688c0b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f688c0b5c90 0x7f688c13d3a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 --2- 172.21.15.71:0/2611846069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f688c0b6100 0x7f688c0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.092+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 >> 172.21.15.71:0/2611846069 conn(0x7f688c06c150 msgr2=0x7f688c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.094+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 shutdown_connections 2023-07-06T01:09:04.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-07-06T01:09:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.094+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 shutdown_connections 2023-07-06T01:09:04.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.095+0000 7f6893dff700 1 -- 172.21.15.71:0/2611846069 wait complete. 2023-07-06T01:09:04.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.095+0000 7fe9b0bff700 1 -- 172.21.15.71:0/2805473037 wait complete. 2023-07-06T01:09:04.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.106+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58780055a0 con 0x7f58900b5c90 2023-07-06T01:09:04.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.106+0000 7f5886ffd700 1 -- 172.21.15.71:0/1874353531 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f588c059410 con 0x7f58900b5c90 2023-07-06T01:09:04.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-07-06T01:09:04.110 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:04.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-07-06T01:09:04.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.110+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f587406adb0 msgr2=0x7f587406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.110+0000 7f58987ff700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f587406adb0 0x7f587406d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5880000f60 tx=0x7f5880007a40 comp rx=0 tx=0).stop 2023-07-06T01:09:04.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.110+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 msgr2=0x7f58900b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:04.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.110+0000 7f58987ff700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 0x7f58900b47b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f588c000c00 tx=0x7f588c004750 comp rx=0 tx=0).stop 2023-07-06T01:09:04.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 shutdown_connections 2023-07-06T01:09:04.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f587406adb0 0x7f587406d260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f589015fca0 0x7f58900d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58900b5c90 0x7f58900b47b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 --2- 172.21.15.71:0/1874353531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58900b6100 0x7f58900d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 >> 172.21.15.71:0/1874353531 conn(0x7f589006c150 msgr2=0x7f58900b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 shutdown_connections 2023-07-06T01:09:04.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:04.111+0000 7f58987ff700 1 -- 172.21.15.71:0/1874353531 wait complete. 2023-07-06T01:09:04.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-07-06T01:09:04.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-07-06T01:09:04.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-07-06T01:09:04.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-07-06T01:09:04.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-07-06T01:09:05.102 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-06T01:09:05.111 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-06T01:09:05.114 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-06T01:09:05.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-06T01:09:05.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-06T01:09:05.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-06T01:09:05.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-06T01:09:05.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-06T01:09:05.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.450+0000 7f941b1ff700 1 Processor -- start 2023-07-06T01:09:05.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.451+0000 7f941b1ff700 1 -- start start 2023-07-06T01:09:05.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.453+0000 7f941b1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 0x7f9414165290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.453+0000 7f941b1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94140cdec0 con 0x7f94140c1870 2023-07-06T01:09:05.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.453+0000 7f941b1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94140ce120 con 0x7f94140ad8f0 2023-07-06T01:09:05.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.453+0000 7f941b1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94141647b0 con 0x7f9414160bc0 2023-07-06T01:09:05.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.454+0000 7f9418f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 0x7f9414165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.454+0000 7f9418f9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 0x7f9414165290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42102/0 (socket says 172.21.15.71:42102) 2023-07-06T01:09:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.454+0000 7f9418f9b700 1 -- 172.21.15.71:0/4126644658 learned_addr learned my addr 172.21.15.71:0/4126644658 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.454+0000 7f9418f9b700 1 -- 172.21.15.71:0/4126644658 >> v1:172.21.15.194:6789/0 conn(0x7f94140ad8f0 legacy=0x7f94140ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.455+0000 7f9418f9b700 1 -- 172.21.15.71:0/4126644658 >> v1:172.21.15.71:6789/0 conn(0x7f94140c1870 legacy=0x7f94140cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.455+0000 7f9418f9b700 1 -- 172.21.15.71:0/4126644658 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414164a90 con 0x7f9414160bc0 2023-07-06T01:09:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.456+0000 7f9418f9b700 1 --2- 172.21.15.71:0/4126644658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 0x7f9414165290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9404009920 tx=0x7f9404009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec088f769c1b305 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.456+0000 7f94137fe700 1 -- 172.21.15.71:0/4126644658 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404004230 con 0x7f9414160bc0 2023-07-06T01:09:05.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.456+0000 7f94137fe700 1 -- 172.21.15.71:0/4126644658 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404004390 con 0x7f9414160bc0 2023-07-06T01:09:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.456+0000 7f94137fe700 1 -- 172.21.15.71:0/4126644658 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404009e70 con 0x7f9414160bc0 2023-07-06T01:09:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.457+0000 7f941b1ff700 1 -- 172.21.15.71:0/4126644658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 msgr2=0x7f9414165290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.457+0000 7f941b1ff700 1 --2- 172.21.15.71:0/4126644658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 0x7f9414165290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9404009920 tx=0x7f9404009c30 comp rx=0 tx=0).stop 2023-07-06T01:09:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.458+0000 7f941b1ff700 1 -- 172.21.15.71:0/4126644658 shutdown_connections 2023-07-06T01:09:05.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.458+0000 7f941b1ff700 1 --2- 172.21.15.71:0/4126644658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9414160bc0 0x7f9414165290 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.458+0000 7f941b1ff700 1 -- 172.21.15.71:0/4126644658 >> 172.21.15.71:0/4126644658 conn(0x7f94140cb440 msgr2=0x7f94140cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.458+0000 7f941b1ff700 1 -- 172.21.15.71:0/4126644658 shutdown_connections 2023-07-06T01:09:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.459+0000 7f941b1ff700 1 -- 172.21.15.71:0/4126644658 wait complete. 2023-07-06T01:09:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.461+0000 7f941b1ff700 1 Processor -- start 2023-07-06T01:09:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.462+0000 7f941b1ff700 1 -- start start 2023-07-06T01:09:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.463+0000 7f941b1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94140ad8f0 0x7f94141429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.463+0000 7f941b1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94140c1870 0x7f94140aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.463+0000 7f941b1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 0x7f94141466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.463+0000 7f941b1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140aff70 con 0x7f94140ad8f0 2023-07-06T01:09:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.463+0000 7f941b1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414150010 con 0x7f9414160bc0 2023-07-06T01:09:05.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.463+0000 7f941b1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140af3f0 con 0x7f94140c1870 2023-07-06T01:09:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.464+0000 7f941979c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 0x7f94141466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.464+0000 7f941979c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 0x7f94141466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:32768/0 (socket says 172.21.15.71:32768) 2023-07-06T01:09:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.464+0000 7f941979c700 1 -- 172.21.15.71:0/3210434793 learned_addr learned my addr 172.21.15.71:0/3210434793 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.464+0000 7f9413fff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94140c1870 0x7f94140aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.465+0000 7f941979c700 1 -- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94140c1870 msgr2=0x7f94140aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.465+0000 7f941979c700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94140c1870 0x7f94140aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.465+0000 7f941979c700 1 -- 172.21.15.71:0/3210434793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94140ad8f0 msgr2=0x7f94141429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.465+0000 7f941979c700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94140ad8f0 0x7f94141429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.465+0000 7f941979c700 1 -- 172.21.15.71:0/3210434793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404009550 con 0x7f9414160bc0 2023-07-06T01:09:05.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.466+0000 7f941979c700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 0x7f94141466f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f940c00cba0 tx=0x7f940c00ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.470+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c003c00 con 0x7f9414160bc0 2023-07-06T01:09:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.470+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c003d60 con 0x7f9414160bc0 2023-07-06T01:09:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.470+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00ab10 con 0x7f9414160bc0 2023-07-06T01:09:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.470+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94140af6d0 con 0x7f9414160bc0 2023-07-06T01:09:05.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.470+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140afc90 con 0x7f9414160bc0 2023-07-06T01:09:05.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.474+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f940c00ac70 con 0x7f9414160bc0 2023-07-06T01:09:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.476+0000 7f94117fa700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f940006adb0 0x7f940006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.477+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f940c089300 con 0x7f9414160bc0 2023-07-06T01:09:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.478+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f40052f0 con 0x7f9414160bc0 2023-07-06T01:09:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.478+0000 7f9418f9b700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f940006adb0 0x7f940006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.479+0000 7f9418f9b700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f940006adb0 0x7f940006d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9404000c00 tx=0x7f9404010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.484+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f940c054420 con 0x7f9414160bc0 2023-07-06T01:09:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.485+0000 7f79b79ff700 1 Processor -- start 2023-07-06T01:09:05.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.486+0000 7f79b79ff700 1 -- start start 2023-07-06T01:09:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.488+0000 7f79b79ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f79b00d1250 0x7f79b006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.488+0000 7f79b79ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b0155220 con 0x7f79b0154e50 2023-07-06T01:09:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.488+0000 7f79b79ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b015bce0 con 0x7f79b006f810 2023-07-06T01:09:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.488+0000 7f79b79ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00ceab0 con 0x7f79b00d1250 2023-07-06T01:09:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.489+0000 7f79b5f9c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f79b006f810 0x7f79b00cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44822/0 (socket says 172.21.15.71:44822) 2023-07-06T01:09:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.489+0000 7f79b5f9c700 1 -- 172.21.15.71:0/93625792 learned_addr learned my addr 172.21.15.71:0/93625792 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:05.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.490+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438171039 0 0) 0x7f79b015bce0 con 0x7f79b006f810 2023-07-06T01:09:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.490+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f799c0035b0 con 0x7f79b006f810 2023-07-06T01:09:05.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 11494485 0 0) 0x7f799c0035b0 con 0x7f79b006f810 2023-07-06T01:09:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 >> v2:172.21.15.71:3300/0 conn(0x7f79b00d1250 msgr2=0x7f79b006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 --2- 172.21.15.71:0/93625792 >> v2:172.21.15.71:3300/0 conn(0x7f79b00d1250 0x7f79b006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 >> v1:172.21.15.71:6789/0 conn(0x7f79b0154e50 legacy=0x7f79b00d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0070000 con 0x7f79b006f810 2023-07-06T01:09:05.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f79a0001670 con 0x7f79b006f810 2023-07-06T01:09:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 >> v1:172.21.15.194:6789/0 conn(0x7f79b006f810 legacy=0x7f79b00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c003a00 0x7f799c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c004850 0x7f799c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799c005320 0x7f799c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00ceab0 con 0x7f799c004850 2023-07-06T01:09:05.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00c1e0 con 0x7f799c003a00 2023-07-06T01:09:05.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.491+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c00c3a0 con 0x7f799c005320 2023-07-06T01:09:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.492+0000 7f79b579b700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c003a00 0x7f799c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.492+0000 7f79b5f9c700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799c005320 0x7f799c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.492+0000 7f79b4f9a700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c004850 0x7f799c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.493+0000 7f79b5f9c700 1 -- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c003a00 msgr2=0x7f799c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.493+0000 7f79b5f9c700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f799c003a00 0x7f799c003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.493+0000 7f79b5f9c700 1 -- 172.21.15.71:0/93625792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c004850 msgr2=0x7f799c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.493+0000 7f79b5f9c700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c004850 0x7f799c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.493+0000 7f79b5f9c700 1 -- 172.21.15.71:0/93625792 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0070000 con 0x7f799c005320 2023-07-06T01:09:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.493+0000 7f79b5f9c700 1 -- 172.21.15.71:0/93625792 reap_dead start 2023-07-06T01:09:05.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.494+0000 7f79b5f9c700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799c005320 0x7f799c00ba10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f79a0010700 tx=0x7f799c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df9f89e447b13f6c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.497+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0005960 con 0x7f799c005320 2023-07-06T01:09:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.497+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0005ac0 con 0x7f799c005320 2023-07-06T01:09:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.497+0000 7f79a7fff700 1 -- 172.21.15.71:0/93625792 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0005e70 con 0x7f799c005320 2023-07-06T01:09:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.498+0000 7f79b79ff700 1 -- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799c005320 msgr2=0x7f799c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.498+0000 7f79b79ff700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799c005320 0x7f799c00ba10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f79a0010700 tx=0x7f799c005880 comp rx=0 tx=0).stop 2023-07-06T01:09:05.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.498+0000 7f79b79ff700 1 -- 172.21.15.71:0/93625792 shutdown_connections 2023-07-06T01:09:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.498+0000 7f79b79ff700 1 --2- 172.21.15.71:0/93625792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f799c005320 0x7f799c00ba10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.498+0000 7f79b79ff700 1 -- 172.21.15.71:0/93625792 >> 172.21.15.71:0/93625792 conn(0x7f79b006db20 msgr2=0x7f79b006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.499+0000 7f79b79ff700 1 -- 172.21.15.71:0/93625792 shutdown_connections 2023-07-06T01:09:05.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.499+0000 7f79b79ff700 1 -- 172.21.15.71:0/93625792 wait complete. 2023-07-06T01:09:05.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.502+0000 7f79b79ff700 1 Processor -- start 2023-07-06T01:09:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.502+0000 7f79b79ff700 1 -- start start 2023-07-06T01:09:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.504+0000 7f79b79ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c005320 0x7f79b01f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.504+0000 7f79b79ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 0x7f79b01f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.504+0000 7f79b79ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79b01e4140 0x7f79b01e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.504+0000 7f79b79ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01e4af0 con 0x7f799c005320 2023-07-06T01:09:05.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.504+0000 7f79b79ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b015d1d0 con 0x7f79b01e4140 2023-07-06T01:09:05.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.504+0000 7f79b79ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b015c5c0 con 0x7f79b015c020 2023-07-06T01:09:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.503+0000 7fbf607ff700 1 Processor -- start 2023-07-06T01:09:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.503+0000 7fbf607ff700 1 -- start start 2023-07-06T01:09:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.505+0000 7fbf607ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbf58160900 0x7fbf5806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.505+0000 7fbf607ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf580b0440 0x7fbf580b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.505+0000 7fbf607ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf580b0de0 con 0x7fbf58164530 2023-07-06T01:09:05.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.505+0000 7fbf607ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf580cc3b0 con 0x7fbf58160900 2023-07-06T01:09:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.505+0000 7fbf607ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf581649f0 con 0x7fbf580b0440 2023-07-06T01:09:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.506+0000 7fbf5dd9a700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fbf58164530 0x7fbf580adb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44826/0 (socket says 172.21.15.71:44826) 2023-07-06T01:09:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.506+0000 7fbf5dd9a700 1 -- 172.21.15.71:0/3371345893 learned_addr learned my addr 172.21.15.71:0/3371345893 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:05.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.506+0000 7fbf5ed9c700 1 --2- 172.21.15.71:0/3371345893 >> v2:172.21.15.194:3300/0 conn(0x7fbf580b0440 0x7fbf580b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7f79b4f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 0x7f79b01f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7f79b4f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 0x7f79b01f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42128/0 (socket says 172.21.15.71:42128) 2023-07-06T01:09:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7f79b4f9a700 1 -- 172.21.15.71:0/325237805 learned_addr learned my addr 172.21.15.71:0/325237805 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5e59b700 1 --2- 172.21.15.71:0/3371345893 >> v2:172.21.15.71:3300/0 conn(0x7fbf58160900 0x7fbf5806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5d599700 1 -- 172.21.15.71:0/3371345893 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488296683 0 0) 0x7fbf580b0de0 con 0x7fbf58164530 2023-07-06T01:09:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5d599700 1 -- 172.21.15.71:0/3371345893 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf440035b0 con 0x7fbf58164530 2023-07-06T01:09:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/3371345893 >> v2:172.21.15.71:3300/0 conn(0x7fbf58160900 msgr2=0x7fbf5806b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7f79b579b700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c005320 0x7f79b01f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5ed9c700 1 --2- 172.21.15.71:0/3371345893 >> v2:172.21.15.71:3300/0 conn(0x7fbf58160900 0x7fbf5806b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/3371345893 >> v1:172.21.15.194:6789/0 conn(0x7fbf58164530 legacy=0x7fbf580adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.507+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/3371345893 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf58164cd0 con 0x7fbf580b0440 2023-07-06T01:09:05.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7f79b5f9c700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79b01e4140 0x7f79b01e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7fbf5e59b700 1 --2- 172.21.15.71:0/3371345893 >> v2:172.21.15.71:3300/0 conn(0x7fbf58160900 0x7fbf5806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7fbf5ed9c700 1 --2- 172.21.15.71:0/3371345893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf580b0440 0x7fbf580b08a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf580c98b0 tx=0x7fbf5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7423e63871313535 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7f79b4f9a700 1 -- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79b01e4140 msgr2=0x7f79b01e45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7f79b4f9a700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79b01e4140 0x7f79b01e45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7f79b4f9a700 1 -- 172.21.15.71:0/325237805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c005320 msgr2=0x7f79b01f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7f79b4f9a700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c005320 0x7f79b01f26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7f79b4f9a700 1 -- 172.21.15.71:0/325237805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b015c8a0 con 0x7f79b015c020 2023-07-06T01:09:05.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7fbf5d599700 1 -- 172.21.15.71:0/3371345893 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000e070 con 0x7fbf580b0440 2023-07-06T01:09:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7fbf5d599700 1 -- 172.21.15.71:0/3371345893 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5000bae0 con 0x7fbf580b0440 2023-07-06T01:09:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.508+0000 7fbf5d599700 1 -- 172.21.15.71:0/3371345893 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000be70 con 0x7fbf580b0440 2023-07-06T01:09:05.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.509+0000 7f79b4f9a700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 0x7f79b01f5180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00d500 tx=0x7f79ac00d810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.509+0000 7fbf607ff700 1 -- 172.21.15.71:0/3371345893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf580b0440 msgr2=0x7fbf580b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.509+0000 7fbf607ff700 1 --2- 172.21.15.71:0/3371345893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf580b0440 0x7fbf580b08a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf580c98b0 tx=0x7fbf5000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.511+0000 7fbf607ff700 1 -- 172.21.15.71:0/3371345893 shutdown_connections 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.511+0000 7fbf607ff700 1 --2- 172.21.15.71:0/3371345893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf580b0440 0x7fbf580b08a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.511+0000 7fbf607ff700 1 --2- 172.21.15.71:0/3371345893 >> v2:172.21.15.71:3300/0 conn(0x7fbf58160900 0x7fbf5806b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.511+0000 7fbf607ff700 1 -- 172.21.15.71:0/3371345893 >> 172.21.15.71:0/3371345893 conn(0x7fbf580cb440 msgr2=0x7fbf580cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.511+0000 7fbf607ff700 1 -- 172.21.15.71:0/3371345893 shutdown_connections 2023-07-06T01:09:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.511+0000 7fbf607ff700 1 -- 172.21.15.71:0/3371345893 wait complete. 2023-07-06T01:09:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.514+0000 7fbf607ff700 1 Processor -- start 2023-07-06T01:09:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac018070 con 0x7f79b015c020 2023-07-06T01:09:05.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac004020 con 0x7f79b015c020 2023-07-06T01:09:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0041d0 con 0x7f79b015c020 2023-07-06T01:09:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b015cb80 con 0x7f79b015c020 2023-07-06T01:09:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b01f56c0 con 0x7f79b015c020 2023-07-06T01:09:05.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.514+0000 7fbf607ff700 1 -- start start 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.516+0000 7fbf607ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf580b0440 0x7fbf581f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.516+0000 7fbf607ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf58160900 0x7fbf5815fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.516+0000 7fbf607ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 0x7fbf580c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.516+0000 7fbf607ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf581fa6b0 con 0x7fbf58164530 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.516+0000 7fbf607ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580b2280 con 0x7fbf58160900 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.516+0000 7fbf607ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580b2520 con 0x7fbf580b0440 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7fbf5ed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 0x7fbf580c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7fbf5ed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 0x7fbf580c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43058/0 (socket says 172.21.15.71:43058) 2023-07-06T01:09:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/4110354666 learned_addr learned my addr 172.21.15.71:0/4110354666 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf580b0440 msgr2=0x7fbf581f9df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7fbf5ed9c700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf580b0440 0x7fbf581f9df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf58160900 msgr2=0x7fbf5815fcd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7fbf5ed9c700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf58160900 0x7fbf5815fcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7fbf5ed9c700 1 -- 172.21.15.71:0/4110354666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50009a70 con 0x7fbf58164530 2023-07-06T01:09:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f499a3ff700 1 Processor -- start 2023-07-06T01:09:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.515+0000 7f499a3ff700 1 -- start start 2023-07-06T01:09:05.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7f499a3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4994160bc0 0x7f4994165290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7f499a3ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f49940c1870 0x7f49940cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7f499a3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49940ce120 con 0x7f49940ad8f0 2023-07-06T01:09:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7f499a3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49941647b0 con 0x7f4994160bc0 2023-07-06T01:09:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.517+0000 7f499a3ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4994164a90 con 0x7f49940c1870 2023-07-06T01:09:05.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7f3e347ff700 1 Processor -- start 2023-07-06T01:09:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.518+0000 7f3e347ff700 1 -- start start 2023-07-06T01:09:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7fbf5ed9c700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 0x7fbf580c4290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf58164b30 tx=0x7fbf50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7f11f61ff700 1 Processor -- start 2023-07-06T01:09:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7f499899c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f49940ad8f0 0x7f49940cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44830/0 (socket says 172.21.15.71:44830) 2023-07-06T01:09:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7f499899c700 1 -- 172.21.15.71:0/1394918315 learned_addr learned my addr 172.21.15.71:0/1394918315 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:05.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7f49937fe700 1 --2- 172.21.15.71:0/1394918315 >> v2:172.21.15.194:3300/0 conn(0x7f49940c1870 0x7f49940cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500047e0 con 0x7fbf58164530 2023-07-06T01:09:05.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50004960 con 0x7fbf58164530 2023-07-06T01:09:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50012670 con 0x7fbf58164530 2023-07-06T01:09:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7fbf607ff700 1 -- 172.21.15.71:0/4110354666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf580b2800 con 0x7fbf58164530 2023-07-06T01:09:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79ac004330 con 0x7f79b015c020 2023-07-06T01:09:05.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79900052f0 con 0x7f79b015c020 2023-07-06T01:09:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f79a5ffb700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f799406ad30 0x7f799406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79ac088e20 con 0x7f79b015c020 2023-07-06T01:09:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f79b579b700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f799406ad30 0x7f799406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7fbf607ff700 1 -- 172.21.15.71:0/4110354666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf581fa330 con 0x7fbf58164530 2023-07-06T01:09:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.519+0000 7f4993fff700 1 --2- 172.21.15.71:0/1394918315 >> v2:172.21.15.71:3300/0 conn(0x7f4994160bc0 0x7f4994165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860056269 0 0) 0x7f49940ce120 con 0x7f49940ad8f0 2023-07-06T01:09:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c0035b0 con 0x7f49940ad8f0 2023-07-06T01:09:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3396208579 0 0) 0x7f497c0035b0 con 0x7f49940ad8f0 2023-07-06T01:09:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 >> v2:172.21.15.194:3300/0 conn(0x7f49940c1870 msgr2=0x7f49940cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 --2- 172.21.15.71:0/1394918315 >> v2:172.21.15.194:3300/0 conn(0x7f49940c1870 0x7f49940cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 >> v2:172.21.15.71:3300/0 conn(0x7f4994160bc0 msgr2=0x7f4994165290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 --2- 172.21.15.71:0/1394918315 >> v2:172.21.15.71:3300/0 conn(0x7f4994160bc0 0x7f4994165290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994164d70 con 0x7f49940ad8f0 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f498c0019f0 con 0x7f49940ad8f0 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 >> v1:172.21.15.194:6789/0 conn(0x7f49940ad8f0 legacy=0x7f49940cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.520+0000 7f4992ffd700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c003a00 0x7f497c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.521+0000 7f4992ffd700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c004850 0x7f497c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.521+0000 7f4992ffd700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c005200 0x7f497c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.521+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49941647b0 con 0x7f497c005200 2023-07-06T01:09:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.521+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4994164a90 con 0x7f497c003a00 2023-07-06T01:09:05.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.521+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c00bf80 con 0x7f497c004850 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f4993fff700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c003a00 0x7f497c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f49937fe700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c004850 0x7f497c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f499899c700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c005200 0x7f497c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f4993fff700 1 -- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c004850 msgr2=0x7f497c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f4993fff700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f497c004850 0x7f497c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f4993fff700 1 -- 172.21.15.71:0/1394918315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c005200 msgr2=0x7f497c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f4993fff700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c005200 0x7f497c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f4993fff700 1 -- 172.21.15.71:0/1394918315 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4994164d70 con 0x7f497c003a00 2023-07-06T01:09:05.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f4993fff700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c003a00 0x7f497c003e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4984009b60 tx=0x7f497c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad9b190a8cdf7e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f3e347ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3e2c160900 0x7f3e2c06b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f3e347ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3e2c164530 0x7f3e2c0adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f3e347ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e2c0cc3b0 con 0x7f3e2c0b0440 2023-07-06T01:09:05.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f3e347ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c1649f0 con 0x7f3e2c164530 2023-07-06T01:09:05.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.522+0000 7f3e347ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2c164cd0 con 0x7f3e2c160900 2023-07-06T01:09:05.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3e2c160900 0x7f3e2c06b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3e2c160900 0x7f3e2c06b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:32838/0 (socket says 172.21.15.71:32838) 2023-07-06T01:09:05.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 -- 172.21.15.71:0/3175881032 learned_addr learned my addr 172.21.15.71:0/3175881032 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 -- 172.21.15.71:0/3175881032 >> v2:172.21.15.71:3300/0 conn(0x7f3e2c164530 msgr2=0x7f3e2c0adb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T01:09:05.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 --2- 172.21.15.71:0/3175881032 >> v2:172.21.15.71:3300/0 conn(0x7f3e2c164530 0x7f3e2c0adb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 -- 172.21.15.71:0/3175881032 >> v1:172.21.15.194:6789/0 conn(0x7f3e2c0b0440 legacy=0x7f3e2c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f3e3259b700 1 -- 172.21.15.71:0/3175881032 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c164fb0 con 0x7f3e2c160900 2023-07-06T01:09:05.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.521+0000 7f11f61ff700 1 -- start start 2023-07-06T01:09:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f11f61ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f11f01589e0 0x7f11f00b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f11f61ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f00caeb0 0x7f11f00b0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f11f61ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f006feb0 con 0x7f11f0158610 2023-07-06T01:09:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f11f61ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f006c780 con 0x7f11f01589e0 2023-07-06T01:09:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f11f61ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f006c4a0 con 0x7f11f00caeb0 2023-07-06T01:09:05.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f3e3259b700 1 --2- 172.21.15.71:0/3175881032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c160900 0x7f3e2c06b220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c06f2a0 tx=0x7f3e2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b938ede62c348350 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f11ef7fe700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f11f0158610 0x7f11f006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44852/0 (socket says 172.21.15.71:44852) 2023-07-06T01:09:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f11ef7fe700 1 -- 172.21.15.71:0/941247786 learned_addr learned my addr 172.21.15.71:0/941247786 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:05.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f11effff700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f00caeb0 0x7f11f00b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f79b579b700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f799406ad30 0x7f799406d1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79b0069890 tx=0x7f79a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498400e6c0 con 0x7f497c003a00 2023-07-06T01:09:05.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498400e820 con 0x7f497c003a00 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7f4992ffd700 1 -- 172.21.15.71:0/1394918315 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498400eb90 con 0x7f497c003a00 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f499a3ff700 1 -- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c003a00 msgr2=0x7f497c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f499a3ff700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f497c003a00 0x7f497c003e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4984009b60 tx=0x7f497c005880 comp rx=0 tx=0).stop 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f499899c700 1 --2- 172.21.15.71:0/1394918315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f497c005200 0x7f497c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f499899c700 1 -- 172.21.15.71:0/1394918315 reap_dead start 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f499899c700 1 -- 172.21.15.71:0/1394918315 reap_dead start 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f499a3ff700 1 -- 172.21.15.71:0/1394918315 shutdown_connections 2023-07-06T01:09:05.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f499a3ff700 1 -- 172.21.15.71:0/1394918315 >> 172.21.15.71:0/1394918315 conn(0x7f49940cb440 msgr2=0x7f49940cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f499a3ff700 1 -- 172.21.15.71:0/1394918315 shutdown_connections 2023-07-06T01:09:05.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f3e31599700 1 -- 172.21.15.71:0/3175881032 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400e070 con 0x7f3e2c160900 2023-07-06T01:09:05.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f3e31599700 1 -- 172.21.15.71:0/3175881032 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400b9c0 con 0x7f3e2c160900 2023-07-06T01:09:05.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f3e31599700 1 -- 172.21.15.71:0/3175881032 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2400bd70 con 0x7f3e2c160900 2023-07-06T01:09:05.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f3e347ff700 1 -- 172.21.15.71:0/3175881032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c160900 msgr2=0x7f3e2c06b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f3e347ff700 1 --2- 172.21.15.71:0/3175881032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c160900 0x7f3e2c06b220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c06f2a0 tx=0x7f3e2400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f3e347ff700 1 -- 172.21.15.71:0/3175881032 shutdown_connections 2023-07-06T01:09:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f3e347ff700 1 --2- 172.21.15.71:0/3175881032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c160900 0x7f3e2c06b220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f3e347ff700 1 --2- 172.21.15.71:0/3175881032 >> v2:172.21.15.71:3300/0 conn(0x7f3e2c164530 0x7f3e2c0adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f3e347ff700 1 -- 172.21.15.71:0/3175881032 >> 172.21.15.71:0/3175881032 conn(0x7f3e2c0cb440 msgr2=0x7f3e2c0cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f11eeffd700 1 --2- 172.21.15.71:0/941247786 >> v2:172.21.15.194:3300/0 conn(0x7f11f01589e0 0x7f11f00b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126890267 0 0) 0x7f11f006feb0 con 0x7f11f0158610 2023-07-06T01:09:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.524+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11d80035b0 con 0x7f11f0158610 2023-07-06T01:09:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2046040192 0 0) 0x7f11d80035b0 con 0x7f11f0158610 2023-07-06T01:09:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f00caeb0 msgr2=0x7f11f00b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f00caeb0 0x7f11f00b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 >> v2:172.21.15.194:3300/0 conn(0x7f11f01589e0 msgr2=0x7f11f00b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 --2- 172.21.15.71:0/941247786 >> v2:172.21.15.194:3300/0 conn(0x7f11f01589e0 0x7f11f00b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f006f860 con 0x7f11f0158610 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f11e0001670 con 0x7f11f0158610 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 >> v1:172.21.15.194:6789/0 conn(0x7f11f0158610 legacy=0x7f11f006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8003a00 0x7f11d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d8004850 0x7f11d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11d8009a00 0x7f11d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f006c780 con 0x7f11d8003a00 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f006c4a0 con 0x7f11d8004850 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8014820 con 0x7f11d8009a00 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11ef7fe700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8003a00 0x7f11d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11effff700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11d8009a00 0x7f11d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f3a65dff700 1 Processor -- start 2023-07-06T01:09:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.525+0000 7f3a65dff700 1 -- start start 2023-07-06T01:09:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.523+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf580b2d20 con 0x7fbf58164530 2023-07-06T01:09:05.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf500127d0 con 0x7fbf58164530 2023-07-06T01:09:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f3e347ff700 1 -- 172.21.15.71:0/3175881032 shutdown_connections 2023-07-06T01:09:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11eeffd700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d8004850 0x7f11d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11effff700 1 -- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d8004850 msgr2=0x7f11d8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11effff700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11d8004850 0x7f11d8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11effff700 1 -- 172.21.15.71:0/941247786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8003a00 msgr2=0x7f11d8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11effff700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8003a00 0x7f11d8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.526+0000 7f11effff700 1 -- 172.21.15.71:0/941247786 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f006f860 con 0x7f11d8009a00 2023-07-06T01:09:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7fbf4effd700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbf3c06adb0 0x7fbf3c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.528+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf5008b170 con 0x7fbf58164530 2023-07-06T01:09:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7f499a3ff700 1 -- 172.21.15.71:0/1394918315 wait complete. 2023-07-06T01:09:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7f3e347ff700 1 -- 172.21.15.71:0/3175881032 wait complete. 2023-07-06T01:09:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.528+0000 7f11effff700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11d8009a00 0x7f11d8005200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11f00cb280 tx=0x7f11d8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f1e4c0b7fae4c95 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7f3a65dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3a600c1870 0x7f3a60165290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7f3a65dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a600cdec0 con 0x7f3a600ad8f0 2023-07-06T01:09:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7f3a65dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a600ce120 con 0x7f3a60160bc0 2023-07-06T01:09:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.527+0000 7f3a65dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a601647b0 con 0x7f3a600c1870 2023-07-06T01:09:05.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.528+0000 7f3a5f7fe700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3a60160bc0 0x7f3a600cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44856/0 (socket says 172.21.15.71:44856) 2023-07-06T01:09:05.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.528+0000 7f3a5f7fe700 1 -- 172.21.15.71:0/3790005609 learned_addr learned my addr 172.21.15.71:0/3790005609 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:05.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.529+0000 7fbf5e59b700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbf3c06adb0 0x7fbf3c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.529+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8007dc0 con 0x7f11d8009a00 2023-07-06T01:09:05.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.529+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8014400 con 0x7f11d8009a00 2023-07-06T01:09:05.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.529+0000 7f11ee7fc700 1 -- 172.21.15.71:0/941247786 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8014790 con 0x7f11d8009a00 2023-07-06T01:09:05.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.529+0000 7f3e347ff700 1 Processor -- start 2023-07-06T01:09:05.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f499a3ff700 1 Processor -- start 2023-07-06T01:09:05.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f3a5e7fc700 1 -- 172.21.15.71:0/3790005609 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376944447 0 0) 0x7f3a600ce120 con 0x7f3a60160bc0 2023-07-06T01:09:05.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f3a5e7fc700 1 -- 172.21.15.71:0/3790005609 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a480035b0 con 0x7f3a60160bc0 2023-07-06T01:09:05.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f3a5effd700 1 --2- 172.21.15.71:0/3790005609 >> v2:172.21.15.71:3300/0 conn(0x7f3a600c1870 0x7f3a60165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f11f61ff700 1 -- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11d8009a00 msgr2=0x7f11d8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f11f61ff700 1 --2- 172.21.15.71:0/941247786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11d8009a00 0x7f11d8005200 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f11f00cb280 tx=0x7f11d8005880 comp rx=0 tx=0).stop 2023-07-06T01:09:05.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f11effff700 1 -- 172.21.15.71:0/941247786 reap_dead start 2023-07-06T01:09:05.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.530+0000 7f499a3ff700 1 -- start start 2023-07-06T01:09:05.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f11f61ff700 1 -- 172.21.15.71:0/941247786 shutdown_connections 2023-07-06T01:09:05.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f11f61ff700 1 -- 172.21.15.71:0/941247786 >> 172.21.15.71:0/941247786 conn(0x7f11f00cb440 msgr2=0x7f11f00cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f3a5effd700 1 -- 172.21.15.71:0/3790005609 >> v1:172.21.15.194:6789/0 conn(0x7f3a60160bc0 legacy=0x7f3a600cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f3a5effd700 1 -- 172.21.15.71:0/3790005609 >> v1:172.21.15.71:6789/0 conn(0x7f3a600ad8f0 legacy=0x7f3a600ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f3a5effd700 1 -- 172.21.15.71:0/3790005609 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60164a90 con 0x7f3a600c1870 2023-07-06T01:09:05.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f499a3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4994143730 0x7f499414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f499a3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 0x7f499414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f499a3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f499414c1d0 0x7f4994149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f3a5effd700 1 --2- 172.21.15.71:0/3790005609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a600c1870 0x7f3a60165290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009840 tx=0x7f3a50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5352df207e237cf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f499a3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940b45f0 con 0x7f499414ac70 2023-07-06T01:09:05.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f499a3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499414c650 con 0x7f499414c1d0 2023-07-06T01:09:05.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f499a3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940b17f0 con 0x7f4994143730 2023-07-06T01:09:05.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 0x7f499414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 0x7f499414bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43104/0 (socket says 172.21.15.71:43104) 2023-07-06T01:09:05.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 -- 172.21.15.71:0/4083621890 learned_addr learned my addr 172.21.15.71:0/4083621890 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7fbf5e59b700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbf3c06adb0 0x7fbf3c06d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009910 tx=0x7fbf54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79ac053f40 con 0x7f79b015c020 2023-07-06T01:09:05.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 -- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4994143730 msgr2=0x7f499414a730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4994143730 0x7f499414a730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 -- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f499414c1d0 msgr2=0x7f4994149590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f499414c1d0 0x7f4994149590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.532+0000 7f49937fe700 1 -- 172.21.15.71:0/4083621890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499414b1f0 con 0x7f499414ac70 2023-07-06T01:09:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.531+0000 7f3e347ff700 1 -- start start 2023-07-06T01:09:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e347ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e2c0b0440 0x7f3e2c1ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e347ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e2c160900 0x7f3e2c0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e347ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c164530 0x7f3e2c0b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e347ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c162db0 con 0x7f3e2c160900 2023-07-06T01:09:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e347ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1ea7c0 con 0x7f3e2c164530 2023-07-06T01:09:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e347ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1626e0 con 0x7f3e2c0b0440 2023-07-06T01:09:05.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f49937fe700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 0x7f499414bc90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4988011a20 tx=0x7f4988011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e32d9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c164530 0x7f3e2c0b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e31d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e2c160900 0x7f3e2c0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e32d9c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c164530 0x7f3e2c0b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:32882/0 (socket says 172.21.15.71:32882) 2023-07-06T01:09:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.533+0000 7f3e32d9c700 1 -- 172.21.15.71:0/2465778052 learned_addr learned my addr 172.21.15.71:0/2465778052 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.534+0000 7f3e31d9a700 1 -- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e2c0b0440 msgr2=0x7f3e2c1ea280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T01:09:05.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.534+0000 7f3e31d9a700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e2c0b0440 0x7f3e2c1ea280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.534+0000 7f3e31d9a700 1 -- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c164530 msgr2=0x7f3e2c0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.534+0000 7f3e31d9a700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c164530 0x7f3e2c0b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.534+0000 7f3e31d9a700 1 -- 172.21.15.71:0/2465778052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24009b30 con 0x7f3e2c160900 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.534+0000 7f3e31d9a700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e2c160900 0x7f3e2c0c3a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800b3e0 tx=0x7f3e2800b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28011830 con 0x7f3e2c160900 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28011990 con 0x7f3e2c160900 2023-07-06T01:09:05.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28011d20 con 0x7f3e2c160900 2023-07-06T01:09:05.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f11f61ff700 1 -- 172.21.15.71:0/941247786 shutdown_connections 2023-07-06T01:09:05.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f11f61ff700 1 -- 172.21.15.71:0/941247786 wait complete. 2023-07-06T01:09:05.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf580b2d20 con 0x7fbf58164530 2023-07-06T01:09:05.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800f9a0 con 0x7f499414ac70 2023-07-06T01:09:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498800fb00 con 0x7f499414ac70 2023-07-06T01:09:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498800feb0 con 0x7f499414ac70 2023-07-06T01:09:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.536+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499414b4d0 con 0x7f499414ac70 2023-07-06T01:09:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.537+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940b1a40 con 0x7f499414ac70 2023-07-06T01:09:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499406fbf0 con 0x7f499414ac70 2023-07-06T01:09:05.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c162120 con 0x7f3e2c160900 2023-07-06T01:09:05.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.535+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c162a40 con 0x7f3e2c160900 2023-07-06T01:09:05.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.537+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c0008d0 con 0x7f3e2c160900 2023-07-06T01:09:05.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.537+0000 7f11f61ff700 1 Processor -- start 2023-07-06T01:09:05.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f3a5e7fc700 1 -- 172.21.15.71:0/3790005609 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50011830 con 0x7f3a600c1870 2023-07-06T01:09:05.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f3a5e7fc700 1 -- 172.21.15.71:0/3790005609 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a50011990 con 0x7f3a600c1870 2023-07-06T01:09:05.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f3a5e7fc700 1 -- 172.21.15.71:0/3790005609 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50011d00 con 0x7f3a600c1870 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f11f61ff700 1 -- start start 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f11f61ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8009a00 0x7f11f014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.538+0000 7f11f61ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 0x7f11f00b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f11f61ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f01580a0 0x7f11f00b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f11f61ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f014d3f0 con 0x7f11d8009a00 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f11f61ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00b2b10 con 0x7f11f01580a0 2023-07-06T01:09:05.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f11f61ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00b0650 con 0x7f11f014d610 2023-07-06T01:09:05.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7feaef9ff700 1 Processor -- start 2023-07-06T01:09:05.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f3a65dff700 1 -- 172.21.15.71:0/3790005609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a600c1870 msgr2=0x7f3a60165290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f3a65dff700 1 --2- 172.21.15.71:0/3790005609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a600c1870 0x7f3a60165290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009840 tx=0x7f3a50009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:05.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f3a65dff700 1 -- 172.21.15.71:0/3790005609 shutdown_connections 2023-07-06T01:09:05.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f3a65dff700 1 --2- 172.21.15.71:0/3790005609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a600c1870 0x7f3a60165290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f3a65dff700 1 -- 172.21.15.71:0/3790005609 >> 172.21.15.71:0/3790005609 conn(0x7f3a600cb440 msgr2=0x7f3a600cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.543+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4988014440 con 0x7f499414ac70 2023-07-06T01:09:05.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7feaef9ff700 1 -- start start 2023-07-06T01:09:05.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.542+0000 7feaef9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae815fca0 0x7feae80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.542+0000 7feaef9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feae80b5c90 0x7feae80d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.542+0000 7feaef9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80cf780 con 0x7feae80b6100 2023-07-06T01:09:05.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.542+0000 7feaef9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80cd490 con 0x7feae80b5c90 2023-07-06T01:09:05.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.542+0000 7feaef9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80cd770 con 0x7feae815fca0 2023-07-06T01:09:05.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.539+0000 7f11eeffd700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 0x7f11f00b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 0x7f11f00b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42188/0 (socket says 172.21.15.71:42188) 2023-07-06T01:09:05.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 -- 172.21.15.71:0/2155438927 learned_addr learned my addr 172.21.15.71:0/2155438927 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11effff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f01580a0 0x7f11f00b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 -- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f01580a0 msgr2=0x7f11f00b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f01580a0 0x7f11f00b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 -- 172.21.15.71:0/2155438927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8009a00 msgr2=0x7f11f014ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8009a00 0x7f11f014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.540+0000 7f11eeffd700 1 -- 172.21.15.71:0/2155438927 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f00b24c0 con 0x7f11f014d610 2023-07-06T01:09:05.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.543+0000 7f11eeffd700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 0x7f11f00b3110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11e40108c0 tx=0x7f11e4010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4004230 con 0x7f11f014d610 2023-07-06T01:09:05.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e4004390 con 0x7f11f014d610 2023-07-06T01:09:05.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e40036a0 con 0x7f11f014d610 2023-07-06T01:09:05.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f00b27a0 con 0x7f11f014d610 2023-07-06T01:09:05.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f00b0290 con 0x7f11f014d610 2023-07-06T01:09:05.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.543+0000 7feaedf9c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7feae80b6100 0x7feae80cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44868/0 (socket says 172.21.15.71:44868) 2023-07-06T01:09:05.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.543+0000 7feaedf9c700 1 -- 172.21.15.71:0/1576345684 learned_addr learned my addr 172.21.15.71:0/1576345684 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:05.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7feaed79b700 1 --2- 172.21.15.71:0/1576345684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae815fca0 0x7feae80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7feaecf9a700 1 --2- 172.21.15.71:0/1576345684 >> v2:172.21.15.194:3300/0 conn(0x7feae80b5c90 0x7feae80d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f3a65dff700 1 -- 172.21.15.71:0/3790005609 shutdown_connections 2023-07-06T01:09:05.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f4990ff9700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f498006ad30 0x7f498006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f498808a3a0 con 0x7f499414ac70 2023-07-06T01:09:05.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.545+0000 7f4993fff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f498006ad30 0x7f498006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.546+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f00b2930 con 0x7f11f014d610 2023-07-06T01:09:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.546+0000 7feaed79b700 1 -- 172.21.15.71:0/1576345684 >> v2:172.21.15.194:3300/0 conn(0x7feae80b5c90 msgr2=0x7feae80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.546+0000 7feaed79b700 1 --2- 172.21.15.71:0/1576345684 >> v2:172.21.15.194:3300/0 conn(0x7feae80b5c90 0x7feae80d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.546+0000 7feaed79b700 1 -- 172.21.15.71:0/1576345684 >> v1:172.21.15.194:6789/0 conn(0x7feae80b6100 legacy=0x7feae80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.546+0000 7feaed79b700 1 -- 172.21.15.71:0/1576345684 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80cda50 con 0x7feae815fca0 2023-07-06T01:09:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.546+0000 7feaed79b700 1 --2- 172.21.15.71:0/1576345684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae815fca0 0x7feae80d1420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feae4009840 tx=0x7feae4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473a0899492e16e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.547+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49880554e0 con 0x7f499414ac70 2023-07-06T01:09:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.544+0000 7f3a65dff700 1 -- 172.21.15.71:0/3790005609 wait complete. 2023-07-06T01:09:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.547+0000 7f3a65dff700 1 Processor -- start 2023-07-06T01:09:05.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.548+0000 7f4993fff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f498006ad30 0x7f498006d1e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f499414e740 tx=0x7f4984008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.547+0000 7feadffff700 1 -- 172.21.15.71:0/1576345684 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4004230 con 0x7feae815fca0 2023-07-06T01:09:05.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.547+0000 7feadffff700 1 -- 172.21.15.71:0/1576345684 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4004390 con 0x7feae815fca0 2023-07-06T01:09:05.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.547+0000 7feadffff700 1 -- 172.21.15.71:0/1576345684 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae40036a0 con 0x7feae815fca0 2023-07-06T01:09:05.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7feaef9ff700 1 -- 172.21.15.71:0/1576345684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae815fca0 msgr2=0x7feae80d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7feaef9ff700 1 --2- 172.21.15.71:0/1576345684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae815fca0 0x7feae80d1420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feae4009840 tx=0x7feae4009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:05.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.547+0000 7f3a65dff700 1 -- start start 2023-07-06T01:09:05.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a65dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a600ad8f0 0x7f3a6015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a65dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 0x7f3a600c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a65dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a60160bc0 0x7f3a6015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a65dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600b2cc0 con 0x7f3a60160bc0 2023-07-06T01:09:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a65dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600b29b0 con 0x7f3a600c1870 2023-07-06T01:09:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a65dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a60162780 con 0x7f3a600ad8f0 2023-07-06T01:09:05.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.549+0000 7f3a5effd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 0x7f3a600c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 0x7f3a600c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:32908/0 (socket says 172.21.15.71:32908) 2023-07-06T01:09:05.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 -- 172.21.15.71:0/471894436 learned_addr learned my addr 172.21.15.71:0/471894436 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7feaef9ff700 1 -- 172.21.15.71:0/1576345684 shutdown_connections 2023-07-06T01:09:05.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7feaef9ff700 1 --2- 172.21.15.71:0/1576345684 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae815fca0 0x7feae80d1420 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7feaef9ff700 1 --2- 172.21.15.71:0/1576345684 >> v2:172.21.15.194:3300/0 conn(0x7feae80b5c90 0x7feae80d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7feaef9ff700 1 -- 172.21.15.71:0/1576345684 >> 172.21.15.71:0/1576345684 conn(0x7feae806c150 msgr2=0x7feae806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5f7fe700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a600ad8f0 0x7f3a6015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7feaef9ff700 1 -- 172.21.15.71:0/1576345684 shutdown_connections 2023-07-06T01:09:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 -- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a600ad8f0 msgr2=0x7f3a6015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a600ad8f0 0x7f3a6015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 -- 172.21.15.71:0/471894436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a60160bc0 msgr2=0x7f3a6015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a60160bc0 0x7f3a6015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3a5effd700 1 -- 172.21.15.71:0/471894436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500094a0 con 0x7f3a600c1870 2023-07-06T01:09:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.551+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11e4003800 con 0x7f11f014d610 2023-07-06T01:09:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.552+0000 7f11d7fff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11dc06adb0 0x7f11dc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.552+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11e4089f60 con 0x7f11f014d610 2023-07-06T01:09:05.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.550+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e2801a400 con 0x7f3e2c160900 2023-07-06T01:09:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.552+0000 7f3e22ffd700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3e1006adb0 0x7f3e1006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.552+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e28089980 con 0x7f3e2c160900 2023-07-06T01:09:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.554+0000 7f11ef7fe700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11dc06adb0 0x7f11dc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.553+0000 7feaef9ff700 1 -- 172.21.15.71:0/1576345684 wait complete. 2023-07-06T01:09:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7feaef9ff700 1 Processor -- start 2023-07-06T01:09:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.553+0000 7f3e3259b700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3e1006adb0 0x7f3e1006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.553+0000 7f3e3259b700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3e1006adb0 0x7f3e1006d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400b370 tx=0x7f3e24009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7f3a5effd700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 0x7f3a600c5a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a500090b0 tx=0x7f3a50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e28054aa0 con 0x7f3e2c160900 2023-07-06T01:09:05.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.554+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f11e40b6310 con 0x7f11f014d610 2023-07-06T01:09:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500038a0 con 0x7f3a600c1870 2023-07-06T01:09:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5001f070 con 0x7f3a600c1870 2023-07-06T01:09:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50003c60 con 0x7f3a600c1870 2023-07-06T01:09:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.557+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6015b6f0 con 0x7f3a600c1870 2023-07-06T01:09:05.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.557+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a60161490 con 0x7f3a600c1870 2023-07-06T01:09:05.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7f11ef7fe700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11dc06adb0 0x7f11dc06d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11e0000fb0 tx=0x7f11e0007ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.556+0000 7feaef9ff700 1 -- start start 2023-07-06T01:09:05.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaef9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 0x7feae81fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaef9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae80b6100 0x7feae815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaef9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feae815fca0 0x7feae815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaef9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae81ff280 con 0x7feae815fca0 2023-07-06T01:09:05.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaef9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae815ceb0 con 0x7feae80b5c90 2023-07-06T01:09:05.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaef9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae815c2a0 con 0x7feae80b6100 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.558+0000 7feaed79b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 0x7feae81fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.559+0000 7feaed79b700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 0x7feae81fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:32910/0 (socket says 172.21.15.71:32910) 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.559+0000 7feaed79b700 1 -- 172.21.15.71:0/248013328 learned_addr learned my addr 172.21.15.71:0/248013328 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.559+0000 7feaecf9a700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae80b6100 0x7feae815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.560+0000 7feaed79b700 1 -- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae80b6100 msgr2=0x7feae815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.560+0000 7feaed79b700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae80b6100 0x7feae815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.560+0000 7feaed79b700 1 -- 172.21.15.71:0/248013328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feae815fca0 msgr2=0x7feae815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.560+0000 7feaed79b700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feae815fca0 0x7feae815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.560+0000 7feaed79b700 1 -- 172.21.15.71:0/248013328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094a0 con 0x7feae80b5c90 2023-07-06T01:09:05.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.560+0000 7feaed79b700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 0x7feae81fed40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feae4000c00 tx=0x7feae4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.559+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a600b2e00 con 0x7f3a600c1870 2023-07-06T01:09:05.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.561+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a50026480 con 0x7f3a600c1870 2023-07-06T01:09:05.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.562+0000 7f3a47fff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a4c06adb0 0x7f3a4c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.563+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a50021070 con 0x7f3a600c1870 2023-07-06T01:09:05.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.564+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4003db0 con 0x7feae80b5c90 2023-07-06T01:09:05.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.564+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae401f070 con 0x7feae80b5c90 2023-07-06T01:09:05.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.564+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4011830 con 0x7feae80b5c90 2023-07-06T01:09:05.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.565+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae815c580 con 0x7feae80b5c90 2023-07-06T01:09:05.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.565+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae815cb40 con 0x7feae80b5c90 2023-07-06T01:09:05.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.568+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feae4021030 con 0x7feae80b5c90 2023-07-06T01:09:05.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.570+0000 7feaddffb700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feacc06adb0 0x7feacc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:05.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.570+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feae408a8a0 con 0x7feae80b5c90 2023-07-06T01:09:05.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.564+0000 7f3a5f7fe700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a4c06adb0 0x7f3a4c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.565+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a50056370 con 0x7f3a600c1870 2023-07-06T01:09:05.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.571+0000 7f3a5f7fe700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a4c06adb0 0x7f3a4c06d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3a540011e0 tx=0x7f3a54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.572+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae815d240 con 0x7feae80b5c90 2023-07-06T01:09:05.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.573+0000 7feaecf9a700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feacc06adb0 0x7feacc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:05.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.574+0000 7feaecf9a700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feacc06adb0 0x7feacc06d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feae80b6f30 tx=0x7fead8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:05.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.578+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feae815d240 con 0x7feae80b5c90 2023-07-06T01:09:05.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.930+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93f40055a0 con 0x7f9414160bc0 2023-07-06T01:09:05.937 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.931+0000 7f94117fa700 1 -- 172.21.15.71:0/3210434793 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f940c001c60 con 0x7f9414160bc0 2023-07-06T01:09:05.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.935+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f940006adb0 msgr2=0x7f940006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.935+0000 7f941b1ff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f940006adb0 0x7f940006d260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9404000c00 tx=0x7f9404010000 comp rx=0 tx=0).stop 2023-07-06T01:09:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.935+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 msgr2=0x7f94141466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.935+0000 7f941b1ff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 0x7f94141466f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f940c00cba0 tx=0x7f940c00ceb0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 shutdown_connections 2023-07-06T01:09:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f940006adb0 0x7f940006d260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9414160bc0 0x7f94141466f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94140ad8f0 0x7f94141429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 --2- 172.21.15.71:0/3210434793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94140c1870 0x7f94140aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 >> 172.21.15.71:0/3210434793 conn(0x7f94140cb440 msgr2=0x7f9414071080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 shutdown_connections 2023-07-06T01:09:05.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.936+0000 7f941b1ff700 1 -- 172.21.15.71:0/3210434793 wait complete. 2023-07-06T01:09:05.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-07-06T01:09:05.970 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:05.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.972+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f79900055a0 con 0x7f79b015c020 2023-07-06T01:09:05.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.973+0000 7f79a5ffb700 1 -- 172.21.15.71:0/325237805 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79ac00b2e0 con 0x7f79b015c020 2023-07-06T01:09:05.976 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:05.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.975+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f799406ad30 msgr2=0x7f799406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.975+0000 7f79b79ff700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f799406ad30 0x7f799406d1e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79b0069890 tx=0x7f79a8009040 comp rx=0 tx=0).stop 2023-07-06T01:09:05.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.975+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 msgr2=0x7f79b01f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:05.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.975+0000 7f79b79ff700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 0x7f79b01f5180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00d500 tx=0x7f79ac00d810 comp rx=0 tx=0).stop 2023-07-06T01:09:05.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.975+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 shutdown_connections 2023-07-06T01:09:05.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f799406ad30 0x7f799406d1e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79b01e4140 0x7f79b01e45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f799c005320 0x7f79b01f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 --2- 172.21.15.71:0/325237805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79b015c020 0x7f79b01f5180 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 >> 172.21.15.71:0/325237805 conn(0x7f79b006db20 msgr2=0x7f79b00b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 shutdown_connections 2023-07-06T01:09:05.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.976+0000 7f79b79ff700 1 -- 172.21.15.71:0/325237805 wait complete. 2023-07-06T01:09:05.994 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:05.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.991+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf580b2d20 con 0x7fbf58164530 2023-07-06T01:09:05.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.991+0000 7fbf4effd700 1 -- 172.21.15.71:0/4110354666 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf5005f020 con 0x7fbf58164530 2023-07-06T01:09:06.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-07-06T01:09:06.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbf3c06adb0 msgr2=0x7fbf3c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbf3c06adb0 0x7fbf3c06d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009910 tx=0x7fbf54008040 comp rx=0 tx=0).stop 2023-07-06T01:09:06.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 msgr2=0x7fbf580c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 0x7fbf580c4290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf58164b30 tx=0x7fbf50004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 shutdown_connections 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbf3c06adb0 0x7fbf3c06d260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbf58164530 0x7fbf580c4290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf580b0440 0x7fbf581f9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 --2- 172.21.15.71:0/4110354666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf58160900 0x7fbf5815fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.995+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 >> 172.21.15.71:0/4110354666 conn(0x7fbf580cb440 msgr2=0x7fbf580cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.996+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 shutdown_connections 2023-07-06T01:09:06.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.996+0000 7fbf4cff9700 1 -- 172.21.15.71:0/4110354666 wait complete. 2023-07-06T01:09:06.003 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.998+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f11f00008d0 con 0x7f11f014d610 2023-07-06T01:09:06.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.999+0000 7f11d7fff700 1 -- 172.21.15.71:0/2155438927 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11e4058a80 con 0x7f11f014d610 2023-07-06T01:09:06.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.999+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f49940c5890 con 0x7f499414ac70 2023-07-06T01:09:06.005 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:06.005 INFO:teuthology.orchestra.run.smithi071.stdout:55834574856 2023-07-06T01:09:06.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:05.999+0000 7f4990ff9700 1 -- 172.21.15.71:0/4083621890 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4988058b00 con 0x7f499414ac70 2023-07-06T01:09:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.002+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11dc06adb0 msgr2=0x7f11dc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.002+0000 7f11f61ff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11dc06adb0 0x7f11dc06d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11e0000fb0 tx=0x7f11e0007ce0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 msgr2=0x7f11f00b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 0x7f11f00b3110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11e40108c0 tx=0x7f11e4010bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 shutdown_connections 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11dc06adb0 0x7f11dc06d260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11f01580a0 0x7f11f00b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11d8009a00 0x7f11f014ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 --2- 172.21.15.71:0/2155438927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11f014d610 0x7f11f00b3110 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 >> 172.21.15.71:0/2155438927 conn(0x7f11f00cb440 msgr2=0x7f11f00cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 shutdown_connections 2023-07-06T01:09:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f11f61ff700 1 -- 172.21.15.71:0/2155438927 wait complete. 2023-07-06T01:09:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f498006ad30 msgr2=0x7f498006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f498006ad30 0x7f498006d1e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f499414e740 tx=0x7f4984008030 comp rx=0 tx=0).stop 2023-07-06T01:09:06.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 msgr2=0x7f499414bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 0x7f499414bc90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4988011a20 tx=0x7f4988011de0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 shutdown_connections 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f498006ad30 0x7f498006d1e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f499414c1d0 0x7f4994149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4994143730 0x7f499414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 --2- 172.21.15.71:0/4083621890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499414ac70 0x7f499414bc90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.003+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 >> 172.21.15.71:0/4083621890 conn(0x7f49940cb440 msgr2=0x7f49940ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.004+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 shutdown_connections 2023-07-06T01:09:06.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.004+0000 7f499a3ff700 1 -- 172.21.15.71:0/4083621890 wait complete. 2023-07-06T01:09:06.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.007+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3e2c0b4940 con 0x7f3e2c160900 2023-07-06T01:09:06.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.008+0000 7f3e22ffd700 1 -- 172.21.15.71:0/2465778052 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e280580c0 con 0x7f3e2c160900 2023-07-06T01:09:06.012 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-07-06T01:09:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3e1006adb0 msgr2=0x7f3e1006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3e1006adb0 0x7f3e1006d260 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400b370 tx=0x7f3e24009000 comp rx=0 tx=0).stop 2023-07-06T01:09:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e2c160900 msgr2=0x7f3e2c0c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e2c160900 0x7f3e2c0c3a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800b3e0 tx=0x7f3e2800b7a0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 shutdown_connections 2023-07-06T01:09:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3e1006adb0 0x7f3e1006d260 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e2c164530 0x7f3e2c0b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e2c0b0440 0x7f3e2c1ea280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 --2- 172.21.15.71:0/2465778052 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e2c160900 0x7f3e2c0c3a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.012+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 >> 172.21.15.71:0/2465778052 conn(0x7f3e2c0cb440 msgr2=0x7f3e2c0afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.013+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 shutdown_connections 2023-07-06T01:09:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.013+0000 7f3e347ff700 1 -- 172.21.15.71:0/2465778052 wait complete. 2023-07-06T01:09:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.021+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3a600b2e00 con 0x7f3a600c1870 2023-07-06T01:09:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.021+0000 7f3a47fff700 1 -- 172.21.15.71:0/471894436 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a600b2e00 con 0x7f3a600c1870 2023-07-06T01:09:06.024 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-07-06T01:09:06.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.025+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7feae815d240 con 0x7feae80b5c90 2023-07-06T01:09:06.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.025+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a4c06adb0 msgr2=0x7f3a4c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.025+0000 7f3a65dff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a4c06adb0 0x7f3a4c06d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3a540011e0 tx=0x7f3a54009040 comp rx=0 tx=0).stop 2023-07-06T01:09:06.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.025+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 msgr2=0x7f3a600c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.025+0000 7f3a65dff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 0x7f3a600c5a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a500090b0 tx=0x7f3a50004750 comp rx=0 tx=0).stop 2023-07-06T01:09:06.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-07-06T01:09:06.031 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 shutdown_connections 2023-07-06T01:09:06.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a4c06adb0 0x7f3a4c06d260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a60160bc0 0x7f3a6015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a600ad8f0 0x7f3a6015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 --2- 172.21.15.71:0/471894436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a600c1870 0x7f3a600c5a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 >> 172.21.15.71:0/471894436 conn(0x7f3a600cb440 msgr2=0x7f3a6006f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 shutdown_connections 2023-07-06T01:09:06.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7f3a65dff700 1 -- 172.21.15.71:0/471894436 wait complete. 2023-07-06T01:09:06.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.026+0000 7feaddffb700 1 -- 172.21.15.71:0/248013328 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feae815d240 con 0x7feae80b5c90 2023-07-06T01:09:06.033 INFO:teuthology.orchestra.run.smithi071.stdout:55834574855 2023-07-06T01:09:06.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.029+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feacc06adb0 msgr2=0x7feacc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.029+0000 7feaef9ff700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feacc06adb0 0x7feacc06d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feae80b6f30 tx=0x7fead8008040 comp rx=0 tx=0).stop 2023-07-06T01:09:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.029+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 msgr2=0x7feae81fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.029+0000 7feaef9ff700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 0x7feae81fed40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feae4000c00 tx=0x7feae4004750 comp rx=0 tx=0).stop 2023-07-06T01:09:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 shutdown_connections 2023-07-06T01:09:06.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feacc06adb0 0x7feacc06d260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feae815fca0 0x7feae815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feae80b5c90 0x7feae81fed40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 --2- 172.21.15.71:0/248013328 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feae80b6100 0x7feae815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 >> 172.21.15.71:0/248013328 conn(0x7feae806c150 msgr2=0x7feae80b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 shutdown_connections 2023-07-06T01:09:06.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.030+0000 7feaef9ff700 1 -- 172.21.15.71:0/248013328 wait complete. 2023-07-06T01:09:06.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-07-06T01:09:06.038 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-07-06T01:09:06.039 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-07-06T01:09:06.047 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-07-06T01:09:06.055 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-07-06T01:09:06.056 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:06.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-06T01:09:06.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:09:06.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.284+0000 7f25935ff700 1 Processor -- start 2023-07-06T01:09:06.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.284+0000 7f25935ff700 1 -- start start 2023-07-06T01:09:06.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f25935ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f258c0b6110 0x7f258c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f25935ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0cf780 con 0x7f258c15fca0 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f25935ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0cd490 con 0x7f258c0b5c90 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f25935ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c0cd770 con 0x7f258c0b6110 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f2591b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f258c0b6110 0x7f258c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f259139b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f258c15fca0 0x7f258c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34626/0 (socket says 172.21.15.71:34626) 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f2591b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f258c0b6110 0x7f258c0cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43140/0 (socket says 172.21.15.71:43140) 2023-07-06T01:09:06.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.285+0000 7f259139b700 1 -- 172.21.15.71:0/3326871980 learned_addr learned my addr 172.21.15.71:0/3326871980 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:06.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2591b9c700 1 -- 172.21.15.71:0/3326871980 >> v1:172.21.15.194:6789/0 conn(0x7f258c0b5c90 legacy=0x7f258c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2591b9c700 1 -- 172.21.15.71:0/3326871980 >> v1:172.21.15.71:6789/0 conn(0x7f258c15fca0 legacy=0x7f258c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2591b9c700 1 -- 172.21.15.71:0/3326871980 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0cda50 con 0x7f258c0b6110 2023-07-06T01:09:06.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2591b9c700 1 --2- 172.21.15.71:0/3326871980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b6110 0x7f258c0cfc10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2584009d90 tx=0x7f258400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14cafd17e25ca1d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:06.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2583fff700 1 -- 172.21.15.71:0/3326871980 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258400e070 con 0x7f258c0b6110 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2583fff700 1 -- 172.21.15.71:0/3326871980 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258400bbd0 con 0x7f258c0b6110 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.286+0000 7f2583fff700 1 -- 172.21.15.71:0/3326871980 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584012430 con 0x7f258c0b6110 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 -- 172.21.15.71:0/3326871980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b6110 msgr2=0x7f258c0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 --2- 172.21.15.71:0/3326871980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b6110 0x7f258c0cfc10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2584009d90 tx=0x7f258400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 -- 172.21.15.71:0/3326871980 shutdown_connections 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 --2- 172.21.15.71:0/3326871980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b6110 0x7f258c0cfc10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 -- 172.21.15.71:0/3326871980 >> 172.21.15.71:0/3326871980 conn(0x7f258c06c150 msgr2=0x7f258c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 -- 172.21.15.71:0/3326871980 shutdown_connections 2023-07-06T01:09:06.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.287+0000 7f25935ff700 1 -- 172.21.15.71:0/3326871980 wait complete. 2023-07-06T01:09:06.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.289+0000 7f25935ff700 1 Processor -- start 2023-07-06T01:09:06.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.289+0000 7f25935ff700 1 -- start start 2023-07-06T01:09:06.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f25935ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 0x7f258c0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f25935ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0b6110 0x7f258c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f25935ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258c15fca0 0x7f258c1f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f25935ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0cc2d0 con 0x7f258c0b5c90 2023-07-06T01:09:06.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f25935ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0cb6c0 con 0x7f258c0b6110 2023-07-06T01:09:06.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f25935ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0cb9a0 con 0x7f258c15fca0 2023-07-06T01:09:06.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 0x7f258c0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 0x7f258c0ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43150/0 (socket says 172.21.15.71:43150) 2023-07-06T01:09:06.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 -- 172.21.15.71:0/1752123773 learned_addr learned my addr 172.21.15.71:0/1752123773 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f2590b9a700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0b6110 0x7f258c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f2591b9c700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258c15fca0 0x7f258c1f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 -- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258c15fca0 msgr2=0x7f258c1f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258c15fca0 0x7f258c1f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 -- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0b6110 msgr2=0x7f258c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0b6110 0x7f258c0cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f259139b700 1 -- 172.21.15.71:0/1752123773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584009a70 con 0x7f258c0b5c90 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.290+0000 7f2590b9a700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0b6110 0x7f258c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.291+0000 7f259139b700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 0x7f258c0ca940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f258800c480 tx=0x7f258800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.291+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588005d70 con 0x7f258c0b5c90 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.291+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25880070d0 con 0x7f258c0b5c90 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.291+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c0cbc80 con 0x7f258c0b5c90 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.291+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588007440 con 0x7f258c0b5c90 2023-07-06T01:09:06.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.291+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c0cb3c0 con 0x7f258c0b5c90 2023-07-06T01:09:06.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.292+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c0008d0 con 0x7f258c0b5c90 2023-07-06T01:09:06.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.293+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25880075a0 con 0x7f258c0b5c90 2023-07-06T01:09:06.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.294+0000 7f2581ffb700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f257006ace0 0x7f257006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.294+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2588088980 con 0x7f258c0b5c90 2023-07-06T01:09:06.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.295+0000 7f2590b9a700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f257006ace0 0x7f257006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.296+0000 7f2590b9a700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f257006ace0 0x7f257006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f258c1f56f0 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:06.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.299+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2588053a40 con 0x7f258c0b5c90 2023-07-06T01:09:06.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.490+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f258c06ae40 con 0x7f257006ace0 2023-07-06T01:09:06.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.499+0000 7f2581ffb700 1 -- 172.21.15.71:0/1752123773 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286631 (secure 0 0 0) 0x7f257c0014f0 con 0x7f257006ace0 2023-07-06T01:09:06.504 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f257006ace0 msgr2=0x7f257006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f257006ace0 0x7f257006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f258c1f56f0 tx=0x7f257c009040 comp rx=0 tx=0).stop 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 msgr2=0x7f258c0ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 0x7f258c0ca940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f258800c480 tx=0x7f258800c840 comp rx=0 tx=0).stop 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 shutdown_connections 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f257006ace0 0x7f257006d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258c15fca0 0x7f258c1f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c0b5c90 0x7f258c0ca940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 --2- 172.21.15.71:0/1752123773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f258c0b6110 0x7f258c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 >> 172.21.15.71:0/1752123773 conn(0x7f258c06c150 msgr2=0x7f258c0d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 shutdown_connections 2023-07-06T01:09:06.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.503+0000 7f25935ff700 1 -- 172.21.15.71:0/1752123773 wait complete. 2023-07-06T01:09:06.508 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:09:06.524 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-07-06T01:09:04.833513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218728,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755992,"statfs":{"total":773094113280,"available":772870135808,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1780,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010635"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083933+0000","last_change":"2023-07-06T01:08:51.546507+0000","last_active":"2023-07-06T01:08:53.083933+0000","last_peered":"2023-07-06T01:08:53.083933+0000","last_clean":"2023-07-06T01:08:53.083933+0000","last_became_active":"2023-07-06T01:08:51.546121+0000","last_became_peered":"2023-07-06T01:08:51.546121+0000","last_unstale":"2023-07-06T01:08:53.083933+0000","last_undegraded":"2023-07-06T01:08:53.083933+0000","last_fullsized":"2023-07-06T01:08:53.083933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:26.336987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084667+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:53.084667+0000","last_peered":"2023-07-06T01:08:53.084667+0000","last_clean":"2023-07-06T01:08:53.084667+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:53.084667+0000","last_undegraded":"2023-07-06T01:08:53.084667+0000","last_fullsized":"2023-07-06T01:08:53.084667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085333+0000","last_change":"2023-07-06T01:08:51.566075+0000","last_active":"2023-07-06T01:08:53.085333+0000","last_peered":"2023-07-06T01:08:53.085333+0000","last_clean":"2023-07-06T01:08:53.085333+0000","last_became_active":"2023-07-06T01:08:51.565537+0000","last_became_peered":"2023-07-06T01:08:51.565537+0000","last_unstale":"2023-07-06T01:08:53.085333+0000","last_undegraded":"2023-07-06T01:08:53.085333+0000","last_fullsized":"2023-07-06T01:08:53.085333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085007+0000","last_change":"2023-07-06T01:08:51.544319+0000","last_active":"2023-07-06T01:08:53.085007+0000","last_peered":"2023-07-06T01:08:53.085007+0000","last_clean":"2023-07-06T01:08:53.085007+0000","last_became_active":"2023-07-06T01:08:51.544030+0000","last_became_peered":"2023-07-06T01:08:51.544030+0000","last_unstale":"2023-07-06T01:08:53.085007+0000","last_undegraded":"2023-07-06T01:08:53.085007+0000","last_fullsized":"2023-07-06T01:08:53.085007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550847+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:52.550847+0000","last_peered":"2023-07-06T01:08:52.550847+0000","last_clean":"2023-07-06T01:08:52.550847+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:52.550847+0000","last_undegraded":"2023-07-06T01:08:52.550847+0000","last_fullsized":"2023-07-06T01:08:52.550847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086081+0000","last_change":"2023-07-06T01:08:51.562443+0000","last_active":"2023-07-06T01:08:53.086081+0000","last_peered":"2023-07-06T01:08:53.086081+0000","last_clean":"2023-07-06T01:08:53.086081+0000","last_became_active":"2023-07-06T01:08:51.561788+0000","last_became_peered":"2023-07-06T01:08:51.561788+0000","last_unstale":"2023-07-06T01:08:53.086081+0000","last_undegraded":"2023-07-06T01:08:53.086081+0000","last_fullsized":"2023-07-06T01:08:53.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086840+0000","last_change":"2023-07-06T01:08:51.548054+0000","last_active":"2023-07-06T01:08:53.086840+0000","last_peered":"2023-07-06T01:08:53.086840+0000","last_clean":"2023-07-06T01:08:53.086840+0000","last_became_active":"2023-07-06T01:08:51.547567+0000","last_became_peered":"2023-07-06T01:08:51.547567+0000","last_unstale":"2023-07-06T01:08:53.086840+0000","last_undegraded":"2023-07-06T01:08:53.086840+0000","last_fullsized":"2023-07-06T01:08:53.086840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084532+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:53.084532+0000","last_peered":"2023-07-06T01:08:53.084532+0000","last_clean":"2023-07-06T01:08:53.084532+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:53.084532+0000","last_undegraded":"2023-07-06T01:08:53.084532+0000","last_fullsized":"2023-07-06T01:08:53.084532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550700+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:52.550700+0000","last_peered":"2023-07-06T01:08:52.550700+0000","last_clean":"2023-07-06T01:08:52.550700+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:52.550700+0000","last_undegraded":"2023-07-06T01:08:52.550700+0000","last_fullsized":"2023-07-06T01:08:52.550700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:15.564746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085937+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:53.085937+0000","last_peered":"2023-07-06T01:08:53.085937+0000","last_clean":"2023-07-06T01:08:53.085937+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:53.085937+0000","last_undegraded":"2023-07-06T01:08:53.085937+0000","last_fullsized":"2023-07-06T01:08:53.085937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085511+0000","last_change":"2023-07-06T01:08:51.565857+0000","last_active":"2023-07-06T01:08:53.085511+0000","last_peered":"2023-07-06T01:08:53.085511+0000","last_clean":"2023-07-06T01:08:53.085511+0000","last_became_active":"2023-07-06T01:08:51.565237+0000","last_became_peered":"2023-07-06T01:08:51.565237+0000","last_unstale":"2023-07-06T01:08:53.085511+0000","last_undegraded":"2023-07-06T01:08:53.085511+0000","last_fullsized":"2023-07-06T01:08:53.085511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083889+0000","last_change":"2023-07-06T01:08:51.565593+0000","last_active":"2023-07-06T01:08:53.083889+0000","last_peered":"2023-07-06T01:08:53.083889+0000","last_clean":"2023-07-06T01:08:53.083889+0000","last_became_active":"2023-07-06T01:08:51.565334+0000","last_became_peered":"2023-07-06T01:08:51.565334+0000","last_unstale":"2023-07-06T01:08:53.083889+0000","last_undegraded":"2023-07-06T01:08:53.083889+0000","last_fullsized":"2023-07-06T01:08:53.083889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:48.859326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083791+0000","last_change":"2023-07-06T01:08:51.545491+0000","last_active":"2023-07-06T01:08:53.083791+0000","last_peered":"2023-07-06T01:08:53.083791+0000","last_clean":"2023-07-06T01:08:53.083791+0000","last_became_active":"2023-07-06T01:08:51.545185+0000","last_became_peered":"2023-07-06T01:08:51.545185+0000","last_unstale":"2023-07-06T01:08:53.083791+0000","last_undegraded":"2023-07-06T01:08:53.083791+0000","last_fullsized":"2023-07-06T01:08:53.083791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085059+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:53.085059+0000","last_peered":"2023-07-06T01:08:53.085059+0000","last_clean":"2023-07-06T01:08:53.085059+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:53.085059+0000","last_undegraded":"2023-07-06T01:08:53.085059+0000","last_fullsized":"2023-07-06T01:08:53.085059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086970+0000","last_change":"2023-07-06T01:08:51.547864+0000","last_active":"2023-07-06T01:08:53.086970+0000","last_peered":"2023-07-06T01:08:53.086970+0000","last_clean":"2023-07-06T01:08:53.086970+0000","last_became_active":"2023-07-06T01:08:51.547170+0000","last_became_peered":"2023-07-06T01:08:51.547170+0000","last_unstale":"2023-07-06T01:08:53.086970+0000","last_undegraded":"2023-07-06T01:08:53.086970+0000","last_fullsized":"2023-07-06T01:08:53.086970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085158+0000","last_change":"2023-07-06T01:08:51.562917+0000","last_active":"2023-07-06T01:08:53.085158+0000","last_peered":"2023-07-06T01:08:53.085158+0000","last_clean":"2023-07-06T01:08:53.085158+0000","last_became_active":"2023-07-06T01:08:51.562635+0000","last_became_peered":"2023-07-06T01:08:51.562635+0000","last_unstale":"2023-07-06T01:08:53.085158+0000","last_undegraded":"2023-07-06T01:08:53.085158+0000","last_fullsized":"2023-07-06T01:08:53.085158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550899+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:52.550899+0000","last_peered":"2023-07-06T01:08:52.550899+0000","last_clean":"2023-07-06T01:08:52.550899+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:52.550899+0000","last_undegraded":"2023-07-06T01:08:52.550899+0000","last_fullsized":"2023-07-06T01:08:52.550899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085257+0000","last_change":"2023-07-06T01:08:51.562248+0000","last_active":"2023-07-06T01:08:53.085257+0000","last_peered":"2023-07-06T01:08:53.085257+0000","last_clean":"2023-07-06T01:08:53.085257+0000","last_became_active":"2023-07-06T01:08:51.561945+0000","last_became_peered":"2023-07-06T01:08:51.561945+0000","last_unstale":"2023-07-06T01:08:53.085257+0000","last_undegraded":"2023-07-06T01:08:53.085257+0000","last_fullsized":"2023-07-06T01:08:53.085257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083937+0000","last_change":"2023-07-06T01:08:51.552763+0000","last_active":"2023-07-06T01:08:53.083937+0000","last_peered":"2023-07-06T01:08:53.083937+0000","last_clean":"2023-07-06T01:08:53.083937+0000","last_became_active":"2023-07-06T01:08:51.552507+0000","last_became_peered":"2023-07-06T01:08:51.552507+0000","last_unstale":"2023-07-06T01:08:53.083937+0000","last_undegraded":"2023-07-06T01:08:53.083937+0000","last_fullsized":"2023-07-06T01:08:53.083937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085562+0000","last_change":"2023-07-06T01:08:51.564791+0000","last_active":"2023-07-06T01:08:53.085562+0000","last_peered":"2023-07-06T01:08:53.085562+0000","last_clean":"2023-07-06T01:08:53.085562+0000","last_became_active":"2023-07-06T01:08:51.564227+0000","last_became_peered":"2023-07-06T01:08:51.564227+0000","last_unstale":"2023-07-06T01:08:53.085562+0000","last_undegraded":"2023-07-06T01:08:53.085562+0000","last_fullsized":"2023-07-06T01:08:53.085562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087254+0000","last_change":"2023-07-06T01:08:51.548812+0000","last_active":"2023-07-06T01:08:53.087254+0000","last_peered":"2023-07-06T01:08:53.087254+0000","last_clean":"2023-07-06T01:08:53.087254+0000","last_became_active":"2023-07-06T01:08:51.548481+0000","last_became_peered":"2023-07-06T01:08:51.548481+0000","last_unstale":"2023-07-06T01:08:53.087254+0000","last_undegraded":"2023-07-06T01:08:53.087254+0000","last_fullsized":"2023-07-06T01:08:53.087254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550919+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:52.550919+0000","last_peered":"2023-07-06T01:08:52.550919+0000","last_clean":"2023-07-06T01:08:52.550919+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:52.550919+0000","last_undegraded":"2023-07-06T01:08:52.550919+0000","last_fullsized":"2023-07-06T01:08:52.550919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552229+0000","last_change":"2023-07-06T01:08:51.545243+0000","last_active":"2023-07-06T01:08:52.552229+0000","last_peered":"2023-07-06T01:08:52.552229+0000","last_clean":"2023-07-06T01:08:52.552229+0000","last_became_active":"2023-07-06T01:08:51.544960+0000","last_became_peered":"2023-07-06T01:08:51.544960+0000","last_unstale":"2023-07-06T01:08:52.552229+0000","last_undegraded":"2023-07-06T01:08:52.552229+0000","last_fullsized":"2023-07-06T01:08:52.552229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086966+0000","last_change":"2023-07-06T01:08:51.546755+0000","last_active":"2023-07-06T01:08:53.086966+0000","last_peered":"2023-07-06T01:08:53.086966+0000","last_clean":"2023-07-06T01:08:53.086966+0000","last_became_active":"2023-07-06T01:08:51.546419+0000","last_became_peered":"2023-07-06T01:08:51.546419+0000","last_unstale":"2023-07-06T01:08:53.086966+0000","last_undegraded":"2023-07-06T01:08:53.086966+0000","last_fullsized":"2023-07-06T01:08:53.086966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:54.356882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084592+0000","last_change":"2023-07-06T01:08:51.552436+0000","last_active":"2023-07-06T01:08:53.084592+0000","last_peered":"2023-07-06T01:08:53.084592+0000","last_clean":"2023-07-06T01:08:53.084592+0000","last_became_active":"2023-07-06T01:08:51.552191+0000","last_became_peered":"2023-07-06T01:08:51.552191+0000","last_unstale":"2023-07-06T01:08:53.084592+0000","last_undegraded":"2023-07-06T01:08:53.084592+0000","last_fullsized":"2023-07-06T01:08:53.084592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084557+0000","last_change":"2023-07-06T01:08:51.545034+0000","last_active":"2023-07-06T01:08:53.084557+0000","last_peered":"2023-07-06T01:08:53.084557+0000","last_clean":"2023-07-06T01:08:53.084557+0000","last_became_active":"2023-07-06T01:08:51.544709+0000","last_became_peered":"2023-07-06T01:08:51.544709+0000","last_unstale":"2023-07-06T01:08:53.084557+0000","last_undegraded":"2023-07-06T01:08:53.084557+0000","last_fullsized":"2023-07-06T01:08:53.084557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085448+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:53.085448+0000","last_peered":"2023-07-06T01:08:53.085448+0000","last_clean":"2023-07-06T01:08:53.085448+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:53.085448+0000","last_undegraded":"2023-07-06T01:08:53.085448+0000","last_fullsized":"2023-07-06T01:08:53.085448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086323+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:53.086323+0000","last_peered":"2023-07-06T01:08:53.086323+0000","last_clean":"2023-07-06T01:08:53.086323+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:53.086323+0000","last_undegraded":"2023-07-06T01:08:53.086323+0000","last_fullsized":"2023-07-06T01:08:53.086323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:17.319280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.553004+0000","last_change":"2023-07-06T01:08:51.547294+0000","last_active":"2023-07-06T01:08:52.553004+0000","last_peered":"2023-07-06T01:08:52.553004+0000","last_clean":"2023-07-06T01:08:52.553004+0000","last_became_active":"2023-07-06T01:08:51.547030+0000","last_became_peered":"2023-07-06T01:08:51.547030+0000","last_unstale":"2023-07-06T01:08:52.553004+0000","last_undegraded":"2023-07-06T01:08:52.553004+0000","last_fullsized":"2023-07-06T01:08:52.553004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084281+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:53.084281+0000","last_peered":"2023-07-06T01:08:53.084281+0000","last_clean":"2023-07-06T01:08:53.084281+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:53.084281+0000","last_undegraded":"2023-07-06T01:08:53.084281+0000","last_fullsized":"2023-07-06T01:08:53.084281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:36.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551180+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:52.551180+0000","last_peered":"2023-07-06T01:08:52.551180+0000","last_clean":"2023-07-06T01:08:52.551180+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:52.551180+0000","last_undegraded":"2023-07-06T01:08:52.551180+0000","last_fullsized":"2023-07-06T01:08:52.551180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552092+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:52.552092+0000","last_peered":"2023-07-06T01:08:52.552092+0000","last_clean":"2023-07-06T01:08:52.552092+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:52.552092+0000","last_undegraded":"2023-07-06T01:08:52.552092+0000","last_fullsized":"2023-07-06T01:08:52.552092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085320+0000","last_change":"2023-07-06T01:08:51.557675+0000","last_active":"2023-07-06T01:08:53.085320+0000","last_peered":"2023-07-06T01:08:53.085320+0000","last_clean":"2023-07-06T01:08:53.085320+0000","last_became_active":"2023-07-06T01:08:51.557340+0000","last_became_peered":"2023-07-06T01:08:51.557340+0000","last_unstale":"2023-07-06T01:08:53.085320+0000","last_undegraded":"2023-07-06T01:08:53.085320+0000","last_fullsized":"2023-07-06T01:08:53.085320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:02.855361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551022+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:52.551022+0000","last_peered":"2023-07-06T01:08:52.551022+0000","last_clean":"2023-07-06T01:08:52.551022+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:52.551022+0000","last_undegraded":"2023-07-06T01:08:52.551022+0000","last_fullsized":"2023-07-06T01:08:52.551022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552061+0000","last_change":"2023-07-06T01:08:51.549974+0000","last_active":"2023-07-06T01:08:52.552061+0000","last_peered":"2023-07-06T01:08:52.552061+0000","last_clean":"2023-07-06T01:08:52.552061+0000","last_became_active":"2023-07-06T01:08:51.549708+0000","last_became_peered":"2023-07-06T01:08:51.549708+0000","last_unstale":"2023-07-06T01:08:52.552061+0000","last_undegraded":"2023-07-06T01:08:52.552061+0000","last_fullsized":"2023-07-06T01:08:52.552061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085783+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:53.085783+0000","last_peered":"2023-07-06T01:08:53.085783+0000","last_clean":"2023-07-06T01:08:53.085783+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:53.085783+0000","last_undegraded":"2023-07-06T01:08:53.085783+0000","last_fullsized":"2023-07-06T01:08:53.085783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552097+0000","last_change":"2023-07-06T01:08:51.552404+0000","last_active":"2023-07-06T01:08:52.552097+0000","last_peered":"2023-07-06T01:08:52.552097+0000","last_clean":"2023-07-06T01:08:52.552097+0000","last_became_active":"2023-07-06T01:08:51.551398+0000","last_became_peered":"2023-07-06T01:08:51.551398+0000","last_unstale":"2023-07-06T01:08:52.552097+0000","last_undegraded":"2023-07-06T01:08:52.552097+0000","last_fullsized":"2023-07-06T01:08:52.552097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087253+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:53.087253+0000","last_peered":"2023-07-06T01:08:53.087253+0000","last_clean":"2023-07-06T01:08:53.087253+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:53.087253+0000","last_undegraded":"2023-07-06T01:08:53.087253+0000","last_fullsized":"2023-07-06T01:08:53.087253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:18.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084462+0000","last_change":"2023-07-06T01:08:51.553928+0000","last_active":"2023-07-06T01:08:53.084462+0000","last_peered":"2023-07-06T01:08:53.084462+0000","last_clean":"2023-07-06T01:08:53.084462+0000","last_became_active":"2023-07-06T01:08:51.553607+0000","last_became_peered":"2023-07-06T01:08:51.553607+0000","last_unstale":"2023-07-06T01:08:53.084462+0000","last_undegraded":"2023-07-06T01:08:53.084462+0000","last_fullsized":"2023-07-06T01:08:53.084462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085895+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:53.085895+0000","last_peered":"2023-07-06T01:08:53.085895+0000","last_clean":"2023-07-06T01:08:53.085895+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:53.085895+0000","last_undegraded":"2023-07-06T01:08:53.085895+0000","last_fullsized":"2023-07-06T01:08:53.085895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086082+0000","last_change":"2023-07-06T01:08:51.564390+0000","last_active":"2023-07-06T01:08:53.086082+0000","last_peered":"2023-07-06T01:08:53.086082+0000","last_clean":"2023-07-06T01:08:53.086082+0000","last_became_active":"2023-07-06T01:08:51.563606+0000","last_became_peered":"2023-07-06T01:08:51.563606+0000","last_unstale":"2023-07-06T01:08:53.086082+0000","last_undegraded":"2023-07-06T01:08:53.086082+0000","last_fullsized":"2023-07-06T01:08:53.086082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:01.040810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086960+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:53.086960+0000","last_peered":"2023-07-06T01:08:53.086960+0000","last_clean":"2023-07-06T01:08:53.086960+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:53.086960+0000","last_undegraded":"2023-07-06T01:08:53.086960+0000","last_fullsized":"2023-07-06T01:08:53.086960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552404+0000","last_change":"2023-07-06T01:08:51.548167+0000","last_active":"2023-07-06T01:08:52.552404+0000","last_peered":"2023-07-06T01:08:52.552404+0000","last_clean":"2023-07-06T01:08:52.552404+0000","last_became_active":"2023-07-06T01:08:51.547839+0000","last_became_peered":"2023-07-06T01:08:51.547839+0000","last_unstale":"2023-07-06T01:08:52.552404+0000","last_undegraded":"2023-07-06T01:08:52.552404+0000","last_fullsized":"2023-07-06T01:08:52.552404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550774+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:52.550774+0000","last_peered":"2023-07-06T01:08:52.550774+0000","last_clean":"2023-07-06T01:08:52.550774+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:52.550774+0000","last_undegraded":"2023-07-06T01:08:52.550774+0000","last_fullsized":"2023-07-06T01:08:52.550774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:23.246313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085598+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:53.085598+0000","last_peered":"2023-07-06T01:08:53.085598+0000","last_clean":"2023-07-06T01:08:53.085598+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:53.085598+0000","last_undegraded":"2023-07-06T01:08:53.085598+0000","last_fullsized":"2023-07-06T01:08:53.085598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086809+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:53.086809+0000","last_peered":"2023-07-06T01:08:53.086809+0000","last_clean":"2023-07-06T01:08:53.086809+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:53.086809+0000","last_undegraded":"2023-07-06T01:08:53.086809+0000","last_fullsized":"2023-07-06T01:08:53.086809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550847+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:52.550847+0000","last_peered":"2023-07-06T01:08:52.550847+0000","last_clean":"2023-07-06T01:08:52.550847+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:52.550847+0000","last_undegraded":"2023-07-06T01:08:52.550847+0000","last_fullsized":"2023-07-06T01:08:52.550847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084513+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:53.084513+0000","last_peered":"2023-07-06T01:08:53.084513+0000","last_clean":"2023-07-06T01:08:53.084513+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:53.084513+0000","last_undegraded":"2023-07-06T01:08:53.084513+0000","last_fullsized":"2023-07-06T01:08:53.084513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552880+0000","last_change":"2023-07-06T01:08:51.549714+0000","last_active":"2023-07-06T01:08:52.552880+0000","last_peered":"2023-07-06T01:08:52.552880+0000","last_clean":"2023-07-06T01:08:52.552880+0000","last_became_active":"2023-07-06T01:08:51.549235+0000","last_became_peered":"2023-07-06T01:08:51.549235+0000","last_unstale":"2023-07-06T01:08:52.552880+0000","last_undegraded":"2023-07-06T01:08:52.552880+0000","last_fullsized":"2023-07-06T01:08:52.552880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087586+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:53.087586+0000","last_peered":"2023-07-06T01:08:53.087586+0000","last_clean":"2023-07-06T01:08:53.087586+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:53.087586+0000","last_undegraded":"2023-07-06T01:08:53.087586+0000","last_fullsized":"2023-07-06T01:08:53.087586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:16.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084760+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:53.084760+0000","last_peered":"2023-07-06T01:08:53.084760+0000","last_clean":"2023-07-06T01:08:53.084760+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:53.084760+0000","last_undegraded":"2023-07-06T01:08:53.084760+0000","last_fullsized":"2023-07-06T01:08:53.084760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087122+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:53.087122+0000","last_peered":"2023-07-06T01:08:53.087122+0000","last_clean":"2023-07-06T01:08:53.087122+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:53.087122+0000","last_undegraded":"2023-07-06T01:08:53.087122+0000","last_fullsized":"2023-07-06T01:08:53.087122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085626+0000","last_change":"2023-07-06T01:08:51.562553+0000","last_active":"2023-07-06T01:08:53.085626+0000","last_peered":"2023-07-06T01:08:53.085626+0000","last_clean":"2023-07-06T01:08:53.085626+0000","last_became_active":"2023-07-06T01:08:51.562093+0000","last_became_peered":"2023-07-06T01:08:51.562093+0000","last_unstale":"2023-07-06T01:08:53.085626+0000","last_undegraded":"2023-07-06T01:08:53.085626+0000","last_fullsized":"2023-07-06T01:08:53.085626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087474+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:53.087474+0000","last_peered":"2023-07-06T01:08:53.087474+0000","last_clean":"2023-07-06T01:08:53.087474+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:53.087474+0000","last_undegraded":"2023-07-06T01:08:53.087474+0000","last_fullsized":"2023-07-06T01:08:53.087474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:29.179839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085394+0000","last_change":"2023-07-06T01:08:51.547190+0000","last_active":"2023-07-06T01:08:53.085394+0000","last_peered":"2023-07-06T01:08:53.085394+0000","last_clean":"2023-07-06T01:08:53.085394+0000","last_became_active":"2023-07-06T01:08:51.546880+0000","last_became_peered":"2023-07-06T01:08:51.546880+0000","last_unstale":"2023-07-06T01:08:53.085394+0000","last_undegraded":"2023-07-06T01:08:53.085394+0000","last_fullsized":"2023-07-06T01:08:53.085394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084828+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:53.084828+0000","last_peered":"2023-07-06T01:08:53.084828+0000","last_clean":"2023-07-06T01:08:53.084828+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:53.084828+0000","last_undegraded":"2023-07-06T01:08:53.084828+0000","last_fullsized":"2023-07-06T01:08:53.084828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550700+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:52.550700+0000","last_peered":"2023-07-06T01:08:52.550700+0000","last_clean":"2023-07-06T01:08:52.550700+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:52.550700+0000","last_undegraded":"2023-07-06T01:08:52.550700+0000","last_fullsized":"2023-07-06T01:08:52.550700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552785+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:52.552785+0000","last_peered":"2023-07-06T01:08:52.552785+0000","last_clean":"2023-07-06T01:08:52.552785+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:52.552785+0000","last_undegraded":"2023-07-06T01:08:52.552785+0000","last_fullsized":"2023-07-06T01:08:52.552785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085734+0000","last_change":"2023-07-06T01:08:51.564576+0000","last_active":"2023-07-06T01:08:53.085734+0000","last_peered":"2023-07-06T01:08:53.085734+0000","last_clean":"2023-07-06T01:08:53.085734+0000","last_became_active":"2023-07-06T01:08:51.563750+0000","last_became_peered":"2023-07-06T01:08:51.563750+0000","last_unstale":"2023-07-06T01:08:53.085734+0000","last_undegraded":"2023-07-06T01:08:53.085734+0000","last_fullsized":"2023-07-06T01:08:53.085734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085219+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:53.085219+0000","last_peered":"2023-07-06T01:08:53.085219+0000","last_clean":"2023-07-06T01:08:53.085219+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:53.085219+0000","last_undegraded":"2023-07-06T01:08:53.085219+0000","last_fullsized":"2023-07-06T01:08:53.085219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085774+0000","last_change":"2023-07-06T01:08:51.565749+0000","last_active":"2023-07-06T01:08:53.085774+0000","last_peered":"2023-07-06T01:08:53.085774+0000","last_clean":"2023-07-06T01:08:53.085774+0000","last_became_active":"2023-07-06T01:08:51.564882+0000","last_became_peered":"2023-07-06T01:08:51.564882+0000","last_unstale":"2023-07-06T01:08:53.085774+0000","last_undegraded":"2023-07-06T01:08:53.085774+0000","last_fullsized":"2023-07-06T01:08:53.085774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086013+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:53.086013+0000","last_peered":"2023-07-06T01:08:53.086013+0000","last_clean":"2023-07-06T01:08:53.086013+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:53.086013+0000","last_undegraded":"2023-07-06T01:08:53.086013+0000","last_fullsized":"2023-07-06T01:08:53.086013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085438+0000","last_change":"2023-07-06T01:08:51.557074+0000","last_active":"2023-07-06T01:08:53.085438+0000","last_peered":"2023-07-06T01:08:53.085438+0000","last_clean":"2023-07-06T01:08:53.085438+0000","last_became_active":"2023-07-06T01:08:51.556801+0000","last_became_peered":"2023-07-06T01:08:51.556801+0000","last_unstale":"2023-07-06T01:08:53.085438+0000","last_undegraded":"2023-07-06T01:08:53.085438+0000","last_fullsized":"2023-07-06T01:08:53.085438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551959+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:52.551959+0000","last_peered":"2023-07-06T01:08:52.551959+0000","last_clean":"2023-07-06T01:08:52.551959+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:52.551959+0000","last_undegraded":"2023-07-06T01:08:52.551959+0000","last_fullsized":"2023-07-06T01:08:52.551959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:44.334492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084747+0000","last_change":"2023-07-06T01:08:51.553184+0000","last_active":"2023-07-06T01:08:53.084747+0000","last_peered":"2023-07-06T01:08:53.084747+0000","last_clean":"2023-07-06T01:08:53.084747+0000","last_became_active":"2023-07-06T01:08:51.552931+0000","last_became_peered":"2023-07-06T01:08:51.552931+0000","last_unstale":"2023-07-06T01:08:53.084747+0000","last_undegraded":"2023-07-06T01:08:53.084747+0000","last_fullsized":"2023-07-06T01:08:53.084747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084322+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:53.084322+0000","last_peered":"2023-07-06T01:08:53.084322+0000","last_clean":"2023-07-06T01:08:53.084322+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:53.084322+0000","last_undegraded":"2023-07-06T01:08:53.084322+0000","last_fullsized":"2023-07-06T01:08:53.084322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:19.832781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085719+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:53.085719+0000","last_peered":"2023-07-06T01:08:53.085719+0000","last_clean":"2023-07-06T01:08:53.085719+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:53.085719+0000","last_undegraded":"2023-07-06T01:08:53.085719+0000","last_fullsized":"2023-07-06T01:08:53.085719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084364+0000","last_change":"2023-07-06T01:08:51.557906+0000","last_active":"2023-07-06T01:08:53.084364+0000","last_peered":"2023-07-06T01:08:53.084364+0000","last_clean":"2023-07-06T01:08:53.084364+0000","last_became_active":"2023-07-06T01:08:51.557620+0000","last_became_peered":"2023-07-06T01:08:51.557620+0000","last_unstale":"2023-07-06T01:08:53.084364+0000","last_undegraded":"2023-07-06T01:08:53.084364+0000","last_fullsized":"2023-07-06T01:08:53.084364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085188+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:53.085188+0000","last_peered":"2023-07-06T01:08:53.085188+0000","last_clean":"2023-07-06T01:08:53.085188+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:53.085188+0000","last_undegraded":"2023-07-06T01:08:53.085188+0000","last_fullsized":"2023-07-06T01:08:53.085188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086255+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:53.086255+0000","last_peered":"2023-07-06T01:08:53.086255+0000","last_clean":"2023-07-06T01:08:53.086255+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:53.086255+0000","last_undegraded":"2023-07-06T01:08:53.086255+0000","last_fullsized":"2023-07-06T01:08:53.086255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:53.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084397+0000","last_change":"2023-07-06T01:08:51.546136+0000","last_active":"2023-07-06T01:08:53.084397+0000","last_peered":"2023-07-06T01:08:53.084397+0000","last_clean":"2023-07-06T01:08:53.084397+0000","last_became_active":"2023-07-06T01:08:51.545893+0000","last_became_peered":"2023-07-06T01:08:51.545893+0000","last_unstale":"2023-07-06T01:08:53.084397+0000","last_undegraded":"2023-07-06T01:08:53.084397+0000","last_fullsized":"2023-07-06T01:08:53.084397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083722+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:53.083722+0000","last_peered":"2023-07-06T01:08:53.083722+0000","last_clean":"2023-07-06T01:08:53.083722+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:53.083722+0000","last_undegraded":"2023-07-06T01:08:53.083722+0000","last_fullsized":"2023-07-06T01:08:53.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:26.895276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084090+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:53.084090+0000","last_peered":"2023-07-06T01:08:53.084090+0000","last_clean":"2023-07-06T01:08:53.084090+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:53.084090+0000","last_undegraded":"2023-07-06T01:08:53.084090+0000","last_fullsized":"2023-07-06T01:08:53.084090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:12.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084599+0000","last_change":"2023-07-06T01:08:51.559769+0000","last_active":"2023-07-06T01:08:53.084599+0000","last_peered":"2023-07-06T01:08:53.084599+0000","last_clean":"2023-07-06T01:08:53.084599+0000","last_became_active":"2023-07-06T01:08:51.559480+0000","last_became_peered":"2023-07-06T01:08:51.559480+0000","last_unstale":"2023-07-06T01:08:53.084599+0000","last_undegraded":"2023-07-06T01:08:53.084599+0000","last_fullsized":"2023-07-06T01:08:53.084599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084736+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:53.084736+0000","last_peered":"2023-07-06T01:08:53.084736+0000","last_clean":"2023-07-06T01:08:53.084736+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:53.084736+0000","last_undegraded":"2023-07-06T01:08:53.084736+0000","last_fullsized":"2023-07-06T01:08:53.084736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:18.979186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086793+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:53.086793+0000","last_peered":"2023-07-06T01:08:53.086793+0000","last_clean":"2023-07-06T01:08:53.086793+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:53.086793+0000","last_undegraded":"2023-07-06T01:08:53.086793+0000","last_fullsized":"2023-07-06T01:08:53.086793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:07.245265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552114+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:52.552114+0000","last_peered":"2023-07-06T01:08:52.552114+0000","last_clean":"2023-07-06T01:08:52.552114+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:52.552114+0000","last_undegraded":"2023-07-06T01:08:52.552114+0000","last_fullsized":"2023-07-06T01:08:52.552114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085655+0000","last_change":"2023-07-06T01:08:51.567558+0000","last_active":"2023-07-06T01:08:53.085655+0000","last_peered":"2023-07-06T01:08:53.085655+0000","last_clean":"2023-07-06T01:08:53.085655+0000","last_became_active":"2023-07-06T01:08:51.567124+0000","last_became_peered":"2023-07-06T01:08:51.567124+0000","last_unstale":"2023-07-06T01:08:53.085655+0000","last_undegraded":"2023-07-06T01:08:53.085655+0000","last_fullsized":"2023-07-06T01:08:53.085655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087397+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:53.087397+0000","last_peered":"2023-07-06T01:08:53.087397+0000","last_clean":"2023-07-06T01:08:53.087397+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:53.087397+0000","last_undegraded":"2023-07-06T01:08:53.087397+0000","last_fullsized":"2023-07-06T01:08:53.087397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:19.934388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550560+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:52.550560+0000","last_peered":"2023-07-06T01:08:52.550560+0000","last_clean":"2023-07-06T01:08:52.550560+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:52.550560+0000","last_undegraded":"2023-07-06T01:08:52.550560+0000","last_fullsized":"2023-07-06T01:08:52.550560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:06.882770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551120+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:52.551120+0000","last_peered":"2023-07-06T01:08:52.551120+0000","last_clean":"2023-07-06T01:08:52.551120+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:52.551120+0000","last_undegraded":"2023-07-06T01:08:52.551120+0000","last_fullsized":"2023-07-06T01:08:52.551120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087298+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:53.087298+0000","last_peered":"2023-07-06T01:08:53.087298+0000","last_clean":"2023-07-06T01:08:53.087298+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:53.087298+0000","last_undegraded":"2023-07-06T01:08:53.087298+0000","last_fullsized":"2023-07-06T01:08:53.087298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:11.979401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084458+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:53.084458+0000","last_peered":"2023-07-06T01:08:53.084458+0000","last_clean":"2023-07-06T01:08:53.084458+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:53.084458+0000","last_undegraded":"2023-07-06T01:08:53.084458+0000","last_fullsized":"2023-07-06T01:08:53.084458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550966+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:52.550966+0000","last_peered":"2023-07-06T01:08:52.550966+0000","last_clean":"2023-07-06T01:08:52.550966+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:52.550966+0000","last_undegraded":"2023-07-06T01:08:52.550966+0000","last_fullsized":"2023-07-06T01:08:52.550966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552734+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:52.552734+0000","last_peered":"2023-07-06T01:08:52.552734+0000","last_clean":"2023-07-06T01:08:52.552734+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:52.552734+0000","last_undegraded":"2023-07-06T01:08:52.552734+0000","last_fullsized":"2023-07-06T01:08:52.552734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:19.629343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084587+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:53.084587+0000","last_peered":"2023-07-06T01:08:53.084587+0000","last_clean":"2023-07-06T01:08:53.084587+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:53.084587+0000","last_undegraded":"2023-07-06T01:08:53.084587+0000","last_fullsized":"2023-07-06T01:08:53.084587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551899+0000","last_change":"2023-07-06T01:08:51.545985+0000","last_active":"2023-07-06T01:08:52.551899+0000","last_peered":"2023-07-06T01:08:52.551899+0000","last_clean":"2023-07-06T01:08:52.551899+0000","last_became_active":"2023-07-06T01:08:51.545528+0000","last_became_peered":"2023-07-06T01:08:51.545528+0000","last_unstale":"2023-07-06T01:08:52.551899+0000","last_undegraded":"2023-07-06T01:08:52.551899+0000","last_fullsized":"2023-07-06T01:08:52.551899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085152+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:53.085152+0000","last_peered":"2023-07-06T01:08:53.085152+0000","last_clean":"2023-07-06T01:08:53.085152+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:53.085152+0000","last_undegraded":"2023-07-06T01:08:53.085152+0000","last_fullsized":"2023-07-06T01:08:53.085152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:36.583295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551025+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:52.551025+0000","last_peered":"2023-07-06T01:08:52.551025+0000","last_clean":"2023-07-06T01:08:52.551025+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:52.551025+0000","last_undegraded":"2023-07-06T01:08:52.551025+0000","last_fullsized":"2023-07-06T01:08:52.551025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085799+0000","last_change":"2023-07-06T01:08:51.561799+0000","last_active":"2023-07-06T01:08:53.085799+0000","last_peered":"2023-07-06T01:08:53.085799+0000","last_clean":"2023-07-06T01:08:53.085799+0000","last_became_active":"2023-07-06T01:08:51.561471+0000","last_became_peered":"2023-07-06T01:08:51.561471+0000","last_unstale":"2023-07-06T01:08:53.085799+0000","last_undegraded":"2023-07-06T01:08:53.085799+0000","last_fullsized":"2023-07-06T01:08:53.085799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551090+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:52.551090+0000","last_peered":"2023-07-06T01:08:52.551090+0000","last_clean":"2023-07-06T01:08:52.551090+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:52.551090+0000","last_undegraded":"2023-07-06T01:08:52.551090+0000","last_fullsized":"2023-07-06T01:08:52.551090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:56.760212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083970+0000","last_change":"2023-07-06T01:08:51.545591+0000","last_active":"2023-07-06T01:08:53.083970+0000","last_peered":"2023-07-06T01:08:53.083970+0000","last_clean":"2023-07-06T01:08:53.083970+0000","last_became_active":"2023-07-06T01:08:51.545275+0000","last_became_peered":"2023-07-06T01:08:51.545275+0000","last_unstale":"2023-07-06T01:08:53.083970+0000","last_undegraded":"2023-07-06T01:08:53.083970+0000","last_fullsized":"2023-07-06T01:08:53.083970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084656+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:53.084656+0000","last_peered":"2023-07-06T01:08:53.084656+0000","last_clean":"2023-07-06T01:08:53.084656+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:53.084656+0000","last_undegraded":"2023-07-06T01:08:53.084656+0000","last_fullsized":"2023-07-06T01:08:53.084656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:25.172660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086414+0000","last_change":"2023-07-06T01:08:51.564597+0000","last_active":"2023-07-06T01:08:53.086414+0000","last_peered":"2023-07-06T01:08:53.086414+0000","last_clean":"2023-07-06T01:08:53.086414+0000","last_became_active":"2023-07-06T01:08:51.564031+0000","last_became_peered":"2023-07-06T01:08:51.564031+0000","last_unstale":"2023-07-06T01:08:53.086414+0000","last_undegraded":"2023-07-06T01:08:53.086414+0000","last_fullsized":"2023-07-06T01:08:53.086414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:30.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085851+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:53.085851+0000","last_peered":"2023-07-06T01:08:53.085851+0000","last_clean":"2023-07-06T01:08:53.085851+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:53.085851+0000","last_undegraded":"2023-07-06T01:08:53.085851+0000","last_fullsized":"2023-07-06T01:08:53.085851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086339+0000","last_change":"2023-07-06T01:08:51.564862+0000","last_active":"2023-07-06T01:08:53.086339+0000","last_peered":"2023-07-06T01:08:53.086339+0000","last_clean":"2023-07-06T01:08:53.086339+0000","last_became_active":"2023-07-06T01:08:51.564536+0000","last_became_peered":"2023-07-06T01:08:51.564536+0000","last_unstale":"2023-07-06T01:08:53.086339+0000","last_undegraded":"2023-07-06T01:08:53.086339+0000","last_fullsized":"2023-07-06T01:08:53.086339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:26.281015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552320+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:52.552320+0000","last_peered":"2023-07-06T01:08:52.552320+0000","last_clean":"2023-07-06T01:08:52.552320+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:52.552320+0000","last_undegraded":"2023-07-06T01:08:52.552320+0000","last_fullsized":"2023-07-06T01:08:52.552320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551948+0000","last_change":"2023-07-06T01:08:51.550387+0000","last_active":"2023-07-06T01:08:52.551948+0000","last_peered":"2023-07-06T01:08:52.551948+0000","last_clean":"2023-07-06T01:08:52.551948+0000","last_became_active":"2023-07-06T01:08:51.550102+0000","last_became_peered":"2023-07-06T01:08:51.550102+0000","last_unstale":"2023-07-06T01:08:52.551948+0000","last_undegraded":"2023-07-06T01:08:52.551948+0000","last_fullsized":"2023-07-06T01:08:52.551948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551140+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:52.551140+0000","last_peered":"2023-07-06T01:08:52.551140+0000","last_clean":"2023-07-06T01:08:52.551140+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:52.551140+0000","last_undegraded":"2023-07-06T01:08:52.551140+0000","last_fullsized":"2023-07-06T01:08:52.551140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:38.100545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085028+0000","last_change":"2023-07-06T01:08:51.563224+0000","last_active":"2023-07-06T01:08:53.085028+0000","last_peered":"2023-07-06T01:08:53.085028+0000","last_clean":"2023-07-06T01:08:53.085028+0000","last_became_active":"2023-07-06T01:08:51.563080+0000","last_became_peered":"2023-07-06T01:08:51.563080+0000","last_unstale":"2023-07-06T01:08:53.085028+0000","last_undegraded":"2023-07-06T01:08:53.085028+0000","last_fullsized":"2023-07-06T01:08:53.085028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085052+0000","last_change":"2023-07-06T01:08:51.543670+0000","last_active":"2023-07-06T01:08:53.085052+0000","last_peered":"2023-07-06T01:08:53.085052+0000","last_clean":"2023-07-06T01:08:53.085052+0000","last_became_active":"2023-07-06T01:08:51.542701+0000","last_became_peered":"2023-07-06T01:08:51.542701+0000","last_unstale":"2023-07-06T01:08:53.085052+0000","last_undegraded":"2023-07-06T01:08:53.085052+0000","last_fullsized":"2023-07-06T01:08:53.085052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551937+0000","last_change":"2023-07-06T01:08:51.548220+0000","last_active":"2023-07-06T01:08:52.551937+0000","last_peered":"2023-07-06T01:08:52.551937+0000","last_clean":"2023-07-06T01:08:52.551937+0000","last_became_active":"2023-07-06T01:08:51.547940+0000","last_became_peered":"2023-07-06T01:08:51.547940+0000","last_unstale":"2023-07-06T01:08:52.551937+0000","last_undegraded":"2023-07-06T01:08:52.551937+0000","last_fullsized":"2023-07-06T01:08:52.551937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086197+0000","last_change":"2023-07-06T01:08:51.561978+0000","last_active":"2023-07-06T01:08:53.086197+0000","last_peered":"2023-07-06T01:08:53.086197+0000","last_clean":"2023-07-06T01:08:53.086197+0000","last_became_active":"2023-07-06T01:08:51.561567+0000","last_became_peered":"2023-07-06T01:08:51.561567+0000","last_unstale":"2023-07-06T01:08:53.086197+0000","last_undegraded":"2023-07-06T01:08:53.086197+0000","last_fullsized":"2023-07-06T01:08:53.086197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552910+0000","last_change":"2023-07-06T01:08:51.557783+0000","last_active":"2023-07-06T01:08:52.552910+0000","last_peered":"2023-07-06T01:08:52.552910+0000","last_clean":"2023-07-06T01:08:52.552910+0000","last_became_active":"2023-07-06T01:08:51.553006+0000","last_became_peered":"2023-07-06T01:08:51.553006+0000","last_unstale":"2023-07-06T01:08:52.552910+0000","last_undegraded":"2023-07-06T01:08:52.552910+0000","last_fullsized":"2023-07-06T01:08:52.552910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084259+0000","last_change":"2023-07-06T01:08:51.554515+0000","last_active":"2023-07-06T01:08:53.084259+0000","last_peered":"2023-07-06T01:08:53.084259+0000","last_clean":"2023-07-06T01:08:53.084259+0000","last_became_active":"2023-07-06T01:08:51.554231+0000","last_became_peered":"2023-07-06T01:08:51.554231+0000","last_unstale":"2023-07-06T01:08:53.084259+0000","last_undegraded":"2023-07-06T01:08:53.084259+0000","last_fullsized":"2023-07-06T01:08:53.084259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4529999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:09:06.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:09:06.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.756+0000 7f2b7a1ff700 1 Processor -- start 2023-07-06T01:09:06.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.756+0000 7f2b7a1ff700 1 -- start start 2023-07-06T01:09:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.757+0000 7f2b7a1ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2b7415fca0 0x7f2b740d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.757+0000 7f2b7a1ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b740b5c90 0x7f2b740d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.757+0000 7f2b7a1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740cf780 con 0x7f2b740b6110 2023-07-06T01:09:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.757+0000 7f2b7a1ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740cd490 con 0x7f2b740b5c90 2023-07-06T01:09:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b7a1ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740cd770 con 0x7f2b7415fca0 2023-07-06T01:09:06.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b6bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2b740b5c90 0x7f2b740d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b73fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2b740b6110 0x7f2b740cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34628/0 (socket says 172.21.15.71:34628) 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b73fff700 1 -- 172.21.15.71:0/3341834028 learned_addr learned my addr 172.21.15.71:0/3341834028 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b737fe700 1 --2- 172.21.15.71:0/3341834028 >> v2:172.21.15.194:3300/0 conn(0x7f2b7415fca0 0x7f2b740d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b6bfff700 1 -- 172.21.15.71:0/3341834028 >> v2:172.21.15.194:3300/0 conn(0x7f2b7415fca0 msgr2=0x7f2b740d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b6bfff700 1 --2- 172.21.15.71:0/3341834028 >> v2:172.21.15.194:3300/0 conn(0x7f2b7415fca0 0x7f2b740d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b6bfff700 1 -- 172.21.15.71:0/3341834028 >> v1:172.21.15.71:6789/0 conn(0x7f2b740b6110 legacy=0x7f2b740cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b6bfff700 1 -- 172.21.15.71:0/3341834028 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740cda50 con 0x7f2b740b5c90 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b72ffd700 1 -- 172.21.15.71:0/3341834028 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198396348 0 0) 0x7f2b740cf780 con 0x7f2b740b6110 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.758+0000 7f2b6bfff700 1 --2- 172.21.15.71:0/3341834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b740d2d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b740d0930 tx=0x7f2b5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f441c4b742b0903a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b72ffd700 1 -- 172.21.15.71:0/3341834028 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c011830 con 0x7f2b740b5c90 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b72ffd700 1 -- 172.21.15.71:0/3341834028 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c011990 con 0x7f2b740b5c90 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b72ffd700 1 -- 172.21.15.71:0/3341834028 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c011d20 con 0x7f2b740b5c90 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/3341834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 msgr2=0x7f2b740d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/3341834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b740d2d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2b740d0930 tx=0x7f2b5c009b20 comp rx=0 tx=0).stop 2023-07-06T01:09:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/3341834028 shutdown_connections 2023-07-06T01:09:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/3341834028 >> v2:172.21.15.194:3300/0 conn(0x7f2b7415fca0 0x7f2b740d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/3341834028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b740d2d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/3341834028 >> 172.21.15.71:0/3341834028 conn(0x7f2b7406c150 msgr2=0x7f2b7406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/3341834028 shutdown_connections 2023-07-06T01:09:06.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.759+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/3341834028 wait complete. 2023-07-06T01:09:06.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.761+0000 7f2b7a1ff700 1 Processor -- start 2023-07-06T01:09:06.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.761+0000 7f2b7a1ff700 1 -- start start 2023-07-06T01:09:06.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b7a1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b74158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b7a1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b740b6110 0x7f2b740cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b7a1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b7415fca0 0x7f2b740c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b7a1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740cc130 con 0x7f2b740b5c90 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b7a1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74158950 con 0x7f2b7415fca0 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b7a1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740cb4b0 con 0x7f2b740b6110 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b737fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b74158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b737fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b74158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43158/0 (socket says 172.21.15.71:43158) 2023-07-06T01:09:06.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.762+0000 7f2b737fe700 1 -- 172.21.15.71:0/772193330 learned_addr learned my addr 172.21.15.71:0/772193330 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b6bfff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b740b6110 0x7f2b740cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b73fff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b7415fca0 0x7f2b740c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b737fe700 1 -- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b740b6110 msgr2=0x7f2b740cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b737fe700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b740b6110 0x7f2b740cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b737fe700 1 -- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b7415fca0 msgr2=0x7f2b740c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b737fe700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b7415fca0 0x7f2b740c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b737fe700 1 -- 172.21.15.71:0/772193330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0094a0 con 0x7f2b740b5c90 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b73fff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b7415fca0 0x7f2b740c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b737fe700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b74158410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400e870 tx=0x7f2b6400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64009590 con 0x7f2b740b5c90 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400ee70 con 0x7f2b740b5c90 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b740cb790 con 0x7f2b740b5c90 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400ca50 con 0x7f2b740b5c90 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.763+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b740cbd50 con 0x7f2b740b5c90 2023-07-06T01:09:06.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.764+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b740cc3a0 con 0x7f2b740b5c90 2023-07-06T01:09:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.765+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b6400cbb0 con 0x7f2b740b5c90 2023-07-06T01:09:06.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.766+0000 7f2b70ff9700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2b5406ace0 0x7f2b5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:06.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.766+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b640894a0 con 0x7f2b740b5c90 2023-07-06T01:09:06.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.766+0000 7f2b6bfff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2b5406ace0 0x7f2b5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:06.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.767+0000 7f2b6bfff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2b5406ace0 0x7f2b5406d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0090b0 tx=0x7f2b5c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:06.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.770+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2b64057fd0 con 0x7f2b740b5c90 2023-07-06T01:09:06.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.965+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b7406ae40 con 0x7f2b5406ace0 2023-07-06T01:09:06.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.974+0000 7f2b70ff9700 1 -- 172.21.15.71:0/772193330 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286608 (secure 0 0 0) 0x7f2b5c011b00 con 0x7f2b5406ace0 2023-07-06T01:09:06.980 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:06.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.978+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2b5406ace0 msgr2=0x7f2b5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.978+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2b5406ace0 0x7f2b5406d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c0090b0 tx=0x7f2b5c008030 comp rx=0 tx=0).stop 2023-07-06T01:09:06.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.978+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 msgr2=0x7f2b74158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:06.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.978+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b74158410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400e870 tx=0x7f2b6400ec30 comp rx=0 tx=0).stop 2023-07-06T01:09:06.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 shutdown_connections 2023-07-06T01:09:06.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2b5406ace0 0x7f2b5406d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b7415fca0 0x7f2b740c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b740b5c90 0x7f2b74158410 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 --2- 172.21.15.71:0/772193330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b740b6110 0x7f2b740cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:06.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 >> 172.21.15.71:0/772193330 conn(0x7f2b7406c150 msgr2=0x7f2b740d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:06.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 shutdown_connections 2023-07-06T01:09:06.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:06.979+0000 7f2b7a1ff700 1 -- 172.21.15.71:0/772193330 wait complete. 2023-07-06T01:09:06.985 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:09:06.999 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-07-06T01:09:06.834200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218728,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755992,"statfs":{"total":773094113280,"available":772870135808,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1780,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010827"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083933+0000","last_change":"2023-07-06T01:08:51.546507+0000","last_active":"2023-07-06T01:08:53.083933+0000","last_peered":"2023-07-06T01:08:53.083933+0000","last_clean":"2023-07-06T01:08:53.083933+0000","last_became_active":"2023-07-06T01:08:51.546121+0000","last_became_peered":"2023-07-06T01:08:51.546121+0000","last_unstale":"2023-07-06T01:08:53.083933+0000","last_undegraded":"2023-07-06T01:08:53.083933+0000","last_fullsized":"2023-07-06T01:08:53.083933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:26.336987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084667+0000","last_change":"2023-07-06T01:08:51.555491+0000","last_active":"2023-07-06T01:08:53.084667+0000","last_peered":"2023-07-06T01:08:53.084667+0000","last_clean":"2023-07-06T01:08:53.084667+0000","last_became_active":"2023-07-06T01:08:51.554934+0000","last_became_peered":"2023-07-06T01:08:51.554934+0000","last_unstale":"2023-07-06T01:08:53.084667+0000","last_undegraded":"2023-07-06T01:08:53.084667+0000","last_fullsized":"2023-07-06T01:08:53.084667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085333+0000","last_change":"2023-07-06T01:08:51.566075+0000","last_active":"2023-07-06T01:08:53.085333+0000","last_peered":"2023-07-06T01:08:53.085333+0000","last_clean":"2023-07-06T01:08:53.085333+0000","last_became_active":"2023-07-06T01:08:51.565537+0000","last_became_peered":"2023-07-06T01:08:51.565537+0000","last_unstale":"2023-07-06T01:08:53.085333+0000","last_undegraded":"2023-07-06T01:08:53.085333+0000","last_fullsized":"2023-07-06T01:08:53.085333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085007+0000","last_change":"2023-07-06T01:08:51.544319+0000","last_active":"2023-07-06T01:08:53.085007+0000","last_peered":"2023-07-06T01:08:53.085007+0000","last_clean":"2023-07-06T01:08:53.085007+0000","last_became_active":"2023-07-06T01:08:51.544030+0000","last_became_peered":"2023-07-06T01:08:51.544030+0000","last_unstale":"2023-07-06T01:08:53.085007+0000","last_undegraded":"2023-07-06T01:08:53.085007+0000","last_fullsized":"2023-07-06T01:08:53.085007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550847+0000","last_change":"2023-07-06T01:08:51.549643+0000","last_active":"2023-07-06T01:08:52.550847+0000","last_peered":"2023-07-06T01:08:52.550847+0000","last_clean":"2023-07-06T01:08:52.550847+0000","last_became_active":"2023-07-06T01:08:51.546916+0000","last_became_peered":"2023-07-06T01:08:51.546916+0000","last_unstale":"2023-07-06T01:08:52.550847+0000","last_undegraded":"2023-07-06T01:08:52.550847+0000","last_fullsized":"2023-07-06T01:08:52.550847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086081+0000","last_change":"2023-07-06T01:08:51.562443+0000","last_active":"2023-07-06T01:08:53.086081+0000","last_peered":"2023-07-06T01:08:53.086081+0000","last_clean":"2023-07-06T01:08:53.086081+0000","last_became_active":"2023-07-06T01:08:51.561788+0000","last_became_peered":"2023-07-06T01:08:51.561788+0000","last_unstale":"2023-07-06T01:08:53.086081+0000","last_undegraded":"2023-07-06T01:08:53.086081+0000","last_fullsized":"2023-07-06T01:08:53.086081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086840+0000","last_change":"2023-07-06T01:08:51.548054+0000","last_active":"2023-07-06T01:08:53.086840+0000","last_peered":"2023-07-06T01:08:53.086840+0000","last_clean":"2023-07-06T01:08:53.086840+0000","last_became_active":"2023-07-06T01:08:51.547567+0000","last_became_peered":"2023-07-06T01:08:51.547567+0000","last_unstale":"2023-07-06T01:08:53.086840+0000","last_undegraded":"2023-07-06T01:08:53.086840+0000","last_fullsized":"2023-07-06T01:08:53.086840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084532+0000","last_change":"2023-07-06T01:08:51.563035+0000","last_active":"2023-07-06T01:08:53.084532+0000","last_peered":"2023-07-06T01:08:53.084532+0000","last_clean":"2023-07-06T01:08:53.084532+0000","last_became_active":"2023-07-06T01:08:51.562759+0000","last_became_peered":"2023-07-06T01:08:51.562759+0000","last_unstale":"2023-07-06T01:08:53.084532+0000","last_undegraded":"2023-07-06T01:08:53.084532+0000","last_fullsized":"2023-07-06T01:08:53.084532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550700+0000","last_change":"2023-07-06T01:08:51.549354+0000","last_active":"2023-07-06T01:08:52.550700+0000","last_peered":"2023-07-06T01:08:52.550700+0000","last_clean":"2023-07-06T01:08:52.550700+0000","last_became_active":"2023-07-06T01:08:51.549082+0000","last_became_peered":"2023-07-06T01:08:51.549082+0000","last_unstale":"2023-07-06T01:08:52.550700+0000","last_undegraded":"2023-07-06T01:08:52.550700+0000","last_fullsized":"2023-07-06T01:08:52.550700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:18:15.564746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085937+0000","last_change":"2023-07-06T01:08:51.555267+0000","last_active":"2023-07-06T01:08:53.085937+0000","last_peered":"2023-07-06T01:08:53.085937+0000","last_clean":"2023-07-06T01:08:53.085937+0000","last_became_active":"2023-07-06T01:08:51.554592+0000","last_became_peered":"2023-07-06T01:08:51.554592+0000","last_unstale":"2023-07-06T01:08:53.085937+0000","last_undegraded":"2023-07-06T01:08:53.085937+0000","last_fullsized":"2023-07-06T01:08:53.085937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:19.973983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085511+0000","last_change":"2023-07-06T01:08:51.565857+0000","last_active":"2023-07-06T01:08:53.085511+0000","last_peered":"2023-07-06T01:08:53.085511+0000","last_clean":"2023-07-06T01:08:53.085511+0000","last_became_active":"2023-07-06T01:08:51.565237+0000","last_became_peered":"2023-07-06T01:08:51.565237+0000","last_unstale":"2023-07-06T01:08:53.085511+0000","last_undegraded":"2023-07-06T01:08:53.085511+0000","last_fullsized":"2023-07-06T01:08:53.085511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083889+0000","last_change":"2023-07-06T01:08:51.565593+0000","last_active":"2023-07-06T01:08:53.083889+0000","last_peered":"2023-07-06T01:08:53.083889+0000","last_clean":"2023-07-06T01:08:53.083889+0000","last_became_active":"2023-07-06T01:08:51.565334+0000","last_became_peered":"2023-07-06T01:08:51.565334+0000","last_unstale":"2023-07-06T01:08:53.083889+0000","last_undegraded":"2023-07-06T01:08:53.083889+0000","last_fullsized":"2023-07-06T01:08:53.083889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:48.859326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083791+0000","last_change":"2023-07-06T01:08:51.545491+0000","last_active":"2023-07-06T01:08:53.083791+0000","last_peered":"2023-07-06T01:08:53.083791+0000","last_clean":"2023-07-06T01:08:53.083791+0000","last_became_active":"2023-07-06T01:08:51.545185+0000","last_became_peered":"2023-07-06T01:08:51.545185+0000","last_unstale":"2023-07-06T01:08:53.083791+0000","last_undegraded":"2023-07-06T01:08:53.083791+0000","last_fullsized":"2023-07-06T01:08:53.083791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:13:43.823353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085059+0000","last_change":"2023-07-06T01:08:51.556941+0000","last_active":"2023-07-06T01:08:53.085059+0000","last_peered":"2023-07-06T01:08:53.085059+0000","last_clean":"2023-07-06T01:08:53.085059+0000","last_became_active":"2023-07-06T01:08:51.556564+0000","last_became_peered":"2023-07-06T01:08:51.556564+0000","last_unstale":"2023-07-06T01:08:53.085059+0000","last_undegraded":"2023-07-06T01:08:53.085059+0000","last_fullsized":"2023-07-06T01:08:53.085059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086970+0000","last_change":"2023-07-06T01:08:51.547864+0000","last_active":"2023-07-06T01:08:53.086970+0000","last_peered":"2023-07-06T01:08:53.086970+0000","last_clean":"2023-07-06T01:08:53.086970+0000","last_became_active":"2023-07-06T01:08:51.547170+0000","last_became_peered":"2023-07-06T01:08:51.547170+0000","last_unstale":"2023-07-06T01:08:53.086970+0000","last_undegraded":"2023-07-06T01:08:53.086970+0000","last_fullsized":"2023-07-06T01:08:53.086970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085158+0000","last_change":"2023-07-06T01:08:51.562917+0000","last_active":"2023-07-06T01:08:53.085158+0000","last_peered":"2023-07-06T01:08:53.085158+0000","last_clean":"2023-07-06T01:08:53.085158+0000","last_became_active":"2023-07-06T01:08:51.562635+0000","last_became_peered":"2023-07-06T01:08:51.562635+0000","last_unstale":"2023-07-06T01:08:53.085158+0000","last_undegraded":"2023-07-06T01:08:53.085158+0000","last_fullsized":"2023-07-06T01:08:53.085158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550899+0000","last_change":"2023-07-06T01:08:51.554425+0000","last_active":"2023-07-06T01:08:52.550899+0000","last_peered":"2023-07-06T01:08:52.550899+0000","last_clean":"2023-07-06T01:08:52.550899+0000","last_became_active":"2023-07-06T01:08:51.554199+0000","last_became_peered":"2023-07-06T01:08:51.554199+0000","last_unstale":"2023-07-06T01:08:52.550899+0000","last_undegraded":"2023-07-06T01:08:52.550899+0000","last_fullsized":"2023-07-06T01:08:52.550899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085257+0000","last_change":"2023-07-06T01:08:51.562248+0000","last_active":"2023-07-06T01:08:53.085257+0000","last_peered":"2023-07-06T01:08:53.085257+0000","last_clean":"2023-07-06T01:08:53.085257+0000","last_became_active":"2023-07-06T01:08:51.561945+0000","last_became_peered":"2023-07-06T01:08:51.561945+0000","last_unstale":"2023-07-06T01:08:53.085257+0000","last_undegraded":"2023-07-06T01:08:53.085257+0000","last_fullsized":"2023-07-06T01:08:53.085257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083937+0000","last_change":"2023-07-06T01:08:51.552763+0000","last_active":"2023-07-06T01:08:53.083937+0000","last_peered":"2023-07-06T01:08:53.083937+0000","last_clean":"2023-07-06T01:08:53.083937+0000","last_became_active":"2023-07-06T01:08:51.552507+0000","last_became_peered":"2023-07-06T01:08:51.552507+0000","last_unstale":"2023-07-06T01:08:53.083937+0000","last_undegraded":"2023-07-06T01:08:53.083937+0000","last_fullsized":"2023-07-06T01:08:53.083937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:18:26.887802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085562+0000","last_change":"2023-07-06T01:08:51.564791+0000","last_active":"2023-07-06T01:08:53.085562+0000","last_peered":"2023-07-06T01:08:53.085562+0000","last_clean":"2023-07-06T01:08:53.085562+0000","last_became_active":"2023-07-06T01:08:51.564227+0000","last_became_peered":"2023-07-06T01:08:51.564227+0000","last_unstale":"2023-07-06T01:08:53.085562+0000","last_undegraded":"2023-07-06T01:08:53.085562+0000","last_fullsized":"2023-07-06T01:08:53.085562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087254+0000","last_change":"2023-07-06T01:08:51.548812+0000","last_active":"2023-07-06T01:08:53.087254+0000","last_peered":"2023-07-06T01:08:53.087254+0000","last_clean":"2023-07-06T01:08:53.087254+0000","last_became_active":"2023-07-06T01:08:51.548481+0000","last_became_peered":"2023-07-06T01:08:51.548481+0000","last_unstale":"2023-07-06T01:08:53.087254+0000","last_undegraded":"2023-07-06T01:08:53.087254+0000","last_fullsized":"2023-07-06T01:08:53.087254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550919+0000","last_change":"2023-07-06T01:08:51.554587+0000","last_active":"2023-07-06T01:08:52.550919+0000","last_peered":"2023-07-06T01:08:52.550919+0000","last_clean":"2023-07-06T01:08:52.550919+0000","last_became_active":"2023-07-06T01:08:51.554309+0000","last_became_peered":"2023-07-06T01:08:51.554309+0000","last_unstale":"2023-07-06T01:08:52.550919+0000","last_undegraded":"2023-07-06T01:08:52.550919+0000","last_fullsized":"2023-07-06T01:08:52.550919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552229+0000","last_change":"2023-07-06T01:08:51.545243+0000","last_active":"2023-07-06T01:08:52.552229+0000","last_peered":"2023-07-06T01:08:52.552229+0000","last_clean":"2023-07-06T01:08:52.552229+0000","last_became_active":"2023-07-06T01:08:51.544960+0000","last_became_peered":"2023-07-06T01:08:51.544960+0000","last_unstale":"2023-07-06T01:08:52.552229+0000","last_undegraded":"2023-07-06T01:08:52.552229+0000","last_fullsized":"2023-07-06T01:08:52.552229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086966+0000","last_change":"2023-07-06T01:08:51.546755+0000","last_active":"2023-07-06T01:08:53.086966+0000","last_peered":"2023-07-06T01:08:53.086966+0000","last_clean":"2023-07-06T01:08:53.086966+0000","last_became_active":"2023-07-06T01:08:51.546419+0000","last_became_peered":"2023-07-06T01:08:51.546419+0000","last_unstale":"2023-07-06T01:08:53.086966+0000","last_undegraded":"2023-07-06T01:08:53.086966+0000","last_fullsized":"2023-07-06T01:08:53.086966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:54.356882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084592+0000","last_change":"2023-07-06T01:08:51.552436+0000","last_active":"2023-07-06T01:08:53.084592+0000","last_peered":"2023-07-06T01:08:53.084592+0000","last_clean":"2023-07-06T01:08:53.084592+0000","last_became_active":"2023-07-06T01:08:51.552191+0000","last_became_peered":"2023-07-06T01:08:51.552191+0000","last_unstale":"2023-07-06T01:08:53.084592+0000","last_undegraded":"2023-07-06T01:08:53.084592+0000","last_fullsized":"2023-07-06T01:08:53.084592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084557+0000","last_change":"2023-07-06T01:08:51.545034+0000","last_active":"2023-07-06T01:08:53.084557+0000","last_peered":"2023-07-06T01:08:53.084557+0000","last_clean":"2023-07-06T01:08:53.084557+0000","last_became_active":"2023-07-06T01:08:51.544709+0000","last_became_peered":"2023-07-06T01:08:51.544709+0000","last_unstale":"2023-07-06T01:08:53.084557+0000","last_undegraded":"2023-07-06T01:08:53.084557+0000","last_fullsized":"2023-07-06T01:08:53.084557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085448+0000","last_change":"2023-07-06T01:08:51.556554+0000","last_active":"2023-07-06T01:08:53.085448+0000","last_peered":"2023-07-06T01:08:53.085448+0000","last_clean":"2023-07-06T01:08:53.085448+0000","last_became_active":"2023-07-06T01:08:51.555851+0000","last_became_peered":"2023-07-06T01:08:51.555851+0000","last_unstale":"2023-07-06T01:08:53.085448+0000","last_undegraded":"2023-07-06T01:08:53.085448+0000","last_fullsized":"2023-07-06T01:08:53.085448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086323+0000","last_change":"2023-07-06T01:08:50.545167+0000","last_active":"2023-07-06T01:08:53.086323+0000","last_peered":"2023-07-06T01:08:53.086323+0000","last_clean":"2023-07-06T01:08:53.086323+0000","last_became_active":"2023-07-06T01:08:50.544848+0000","last_became_peered":"2023-07-06T01:08:50.544848+0000","last_unstale":"2023-07-06T01:08:53.086323+0000","last_undegraded":"2023-07-06T01:08:53.086323+0000","last_fullsized":"2023-07-06T01:08:53.086323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:17.319280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.553004+0000","last_change":"2023-07-06T01:08:51.547294+0000","last_active":"2023-07-06T01:08:52.553004+0000","last_peered":"2023-07-06T01:08:52.553004+0000","last_clean":"2023-07-06T01:08:52.553004+0000","last_became_active":"2023-07-06T01:08:51.547030+0000","last_became_peered":"2023-07-06T01:08:51.547030+0000","last_unstale":"2023-07-06T01:08:52.553004+0000","last_undegraded":"2023-07-06T01:08:52.553004+0000","last_fullsized":"2023-07-06T01:08:52.553004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:07.165873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084281+0000","last_change":"2023-07-06T01:08:50.534507+0000","last_active":"2023-07-06T01:08:53.084281+0000","last_peered":"2023-07-06T01:08:53.084281+0000","last_clean":"2023-07-06T01:08:53.084281+0000","last_became_active":"2023-07-06T01:08:50.534145+0000","last_became_peered":"2023-07-06T01:08:50.534145+0000","last_unstale":"2023-07-06T01:08:53.084281+0000","last_undegraded":"2023-07-06T01:08:53.084281+0000","last_fullsized":"2023-07-06T01:08:53.084281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:36.976333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551180+0000","last_change":"2023-07-06T01:08:51.548314+0000","last_active":"2023-07-06T01:08:52.551180+0000","last_peered":"2023-07-06T01:08:52.551180+0000","last_clean":"2023-07-06T01:08:52.551180+0000","last_became_active":"2023-07-06T01:08:51.547576+0000","last_became_peered":"2023-07-06T01:08:51.547576+0000","last_unstale":"2023-07-06T01:08:52.551180+0000","last_undegraded":"2023-07-06T01:08:52.551180+0000","last_fullsized":"2023-07-06T01:08:52.551180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552092+0000","last_change":"2023-07-06T01:08:50.537861+0000","last_active":"2023-07-06T01:08:52.552092+0000","last_peered":"2023-07-06T01:08:52.552092+0000","last_clean":"2023-07-06T01:08:52.552092+0000","last_became_active":"2023-07-06T01:08:50.537568+0000","last_became_peered":"2023-07-06T01:08:50.537568+0000","last_unstale":"2023-07-06T01:08:52.552092+0000","last_undegraded":"2023-07-06T01:08:52.552092+0000","last_fullsized":"2023-07-06T01:08:52.552092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085320+0000","last_change":"2023-07-06T01:08:51.557675+0000","last_active":"2023-07-06T01:08:53.085320+0000","last_peered":"2023-07-06T01:08:53.085320+0000","last_clean":"2023-07-06T01:08:53.085320+0000","last_became_active":"2023-07-06T01:08:51.557340+0000","last_became_peered":"2023-07-06T01:08:51.557340+0000","last_unstale":"2023-07-06T01:08:53.085320+0000","last_undegraded":"2023-07-06T01:08:53.085320+0000","last_fullsized":"2023-07-06T01:08:53.085320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:31:02.855361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551022+0000","last_change":"2023-07-06T01:08:50.525102+0000","last_active":"2023-07-06T01:08:52.551022+0000","last_peered":"2023-07-06T01:08:52.551022+0000","last_clean":"2023-07-06T01:08:52.551022+0000","last_became_active":"2023-07-06T01:08:50.524727+0000","last_became_peered":"2023-07-06T01:08:50.524727+0000","last_unstale":"2023-07-06T01:08:52.551022+0000","last_undegraded":"2023-07-06T01:08:52.551022+0000","last_fullsized":"2023-07-06T01:08:52.551022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552061+0000","last_change":"2023-07-06T01:08:51.549974+0000","last_active":"2023-07-06T01:08:52.552061+0000","last_peered":"2023-07-06T01:08:52.552061+0000","last_clean":"2023-07-06T01:08:52.552061+0000","last_became_active":"2023-07-06T01:08:51.549708+0000","last_became_peered":"2023-07-06T01:08:51.549708+0000","last_unstale":"2023-07-06T01:08:52.552061+0000","last_undegraded":"2023-07-06T01:08:52.552061+0000","last_fullsized":"2023-07-06T01:08:52.552061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:08:37.983081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085783+0000","last_change":"2023-07-06T01:08:50.543638+0000","last_active":"2023-07-06T01:08:53.085783+0000","last_peered":"2023-07-06T01:08:53.085783+0000","last_clean":"2023-07-06T01:08:53.085783+0000","last_became_active":"2023-07-06T01:08:50.543275+0000","last_became_peered":"2023-07-06T01:08:50.543275+0000","last_unstale":"2023-07-06T01:08:53.085783+0000","last_undegraded":"2023-07-06T01:08:53.085783+0000","last_fullsized":"2023-07-06T01:08:53.085783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552097+0000","last_change":"2023-07-06T01:08:51.552404+0000","last_active":"2023-07-06T01:08:52.552097+0000","last_peered":"2023-07-06T01:08:52.552097+0000","last_clean":"2023-07-06T01:08:52.552097+0000","last_became_active":"2023-07-06T01:08:51.551398+0000","last_became_peered":"2023-07-06T01:08:51.551398+0000","last_unstale":"2023-07-06T01:08:52.552097+0000","last_undegraded":"2023-07-06T01:08:52.552097+0000","last_fullsized":"2023-07-06T01:08:52.552097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087253+0000","last_change":"2023-07-06T01:08:50.542669+0000","last_active":"2023-07-06T01:08:53.087253+0000","last_peered":"2023-07-06T01:08:53.087253+0000","last_clean":"2023-07-06T01:08:53.087253+0000","last_became_active":"2023-07-06T01:08:50.540079+0000","last_became_peered":"2023-07-06T01:08:50.540079+0000","last_unstale":"2023-07-06T01:08:53.087253+0000","last_undegraded":"2023-07-06T01:08:53.087253+0000","last_fullsized":"2023-07-06T01:08:53.087253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:36:18.967235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084462+0000","last_change":"2023-07-06T01:08:51.553928+0000","last_active":"2023-07-06T01:08:53.084462+0000","last_peered":"2023-07-06T01:08:53.084462+0000","last_clean":"2023-07-06T01:08:53.084462+0000","last_became_active":"2023-07-06T01:08:51.553607+0000","last_became_peered":"2023-07-06T01:08:51.553607+0000","last_unstale":"2023-07-06T01:08:53.084462+0000","last_undegraded":"2023-07-06T01:08:53.084462+0000","last_fullsized":"2023-07-06T01:08:53.084462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085895+0000","last_change":"2023-07-06T01:08:50.541908+0000","last_active":"2023-07-06T01:08:53.085895+0000","last_peered":"2023-07-06T01:08:53.085895+0000","last_clean":"2023-07-06T01:08:53.085895+0000","last_became_active":"2023-07-06T01:08:50.541626+0000","last_became_peered":"2023-07-06T01:08:50.541626+0000","last_unstale":"2023-07-06T01:08:53.085895+0000","last_undegraded":"2023-07-06T01:08:53.085895+0000","last_fullsized":"2023-07-06T01:08:53.085895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086082+0000","last_change":"2023-07-06T01:08:51.564390+0000","last_active":"2023-07-06T01:08:53.086082+0000","last_peered":"2023-07-06T01:08:53.086082+0000","last_clean":"2023-07-06T01:08:53.086082+0000","last_became_active":"2023-07-06T01:08:51.563606+0000","last_became_peered":"2023-07-06T01:08:51.563606+0000","last_unstale":"2023-07-06T01:08:53.086082+0000","last_undegraded":"2023-07-06T01:08:53.086082+0000","last_fullsized":"2023-07-06T01:08:53.086082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:01.040810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086960+0000","last_change":"2023-07-06T01:08:50.541404+0000","last_active":"2023-07-06T01:08:53.086960+0000","last_peered":"2023-07-06T01:08:53.086960+0000","last_clean":"2023-07-06T01:08:53.086960+0000","last_became_active":"2023-07-06T01:08:50.541061+0000","last_became_peered":"2023-07-06T01:08:50.541061+0000","last_unstale":"2023-07-06T01:08:53.086960+0000","last_undegraded":"2023-07-06T01:08:53.086960+0000","last_fullsized":"2023-07-06T01:08:53.086960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552404+0000","last_change":"2023-07-06T01:08:51.548167+0000","last_active":"2023-07-06T01:08:52.552404+0000","last_peered":"2023-07-06T01:08:52.552404+0000","last_clean":"2023-07-06T01:08:52.552404+0000","last_became_active":"2023-07-06T01:08:51.547839+0000","last_became_peered":"2023-07-06T01:08:51.547839+0000","last_unstale":"2023-07-06T01:08:52.552404+0000","last_undegraded":"2023-07-06T01:08:52.552404+0000","last_fullsized":"2023-07-06T01:08:52.552404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550774+0000","last_change":"2023-07-06T01:08:50.528174+0000","last_active":"2023-07-06T01:08:52.550774+0000","last_peered":"2023-07-06T01:08:52.550774+0000","last_clean":"2023-07-06T01:08:52.550774+0000","last_became_active":"2023-07-06T01:08:50.527730+0000","last_became_peered":"2023-07-06T01:08:50.527730+0000","last_unstale":"2023-07-06T01:08:52.550774+0000","last_undegraded":"2023-07-06T01:08:52.550774+0000","last_fullsized":"2023-07-06T01:08:52.550774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:23.246313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085598+0000","last_change":"2023-07-06T01:08:51.556116+0000","last_active":"2023-07-06T01:08:53.085598+0000","last_peered":"2023-07-06T01:08:53.085598+0000","last_clean":"2023-07-06T01:08:53.085598+0000","last_became_active":"2023-07-06T01:08:51.555757+0000","last_became_peered":"2023-07-06T01:08:51.555757+0000","last_unstale":"2023-07-06T01:08:53.085598+0000","last_undegraded":"2023-07-06T01:08:53.085598+0000","last_fullsized":"2023-07-06T01:08:53.085598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086809+0000","last_change":"2023-07-06T01:08:50.540111+0000","last_active":"2023-07-06T01:08:53.086809+0000","last_peered":"2023-07-06T01:08:53.086809+0000","last_clean":"2023-07-06T01:08:53.086809+0000","last_became_active":"2023-07-06T01:08:50.539250+0000","last_became_peered":"2023-07-06T01:08:50.539250+0000","last_unstale":"2023-07-06T01:08:53.086809+0000","last_undegraded":"2023-07-06T01:08:53.086809+0000","last_fullsized":"2023-07-06T01:08:53.086809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550847+0000","last_change":"2023-07-06T01:08:51.548538+0000","last_active":"2023-07-06T01:08:52.550847+0000","last_peered":"2023-07-06T01:08:52.550847+0000","last_clean":"2023-07-06T01:08:52.550847+0000","last_became_active":"2023-07-06T01:08:51.548054+0000","last_became_peered":"2023-07-06T01:08:51.548054+0000","last_unstale":"2023-07-06T01:08:52.550847+0000","last_undegraded":"2023-07-06T01:08:52.550847+0000","last_fullsized":"2023-07-06T01:08:52.550847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084513+0000","last_change":"2023-07-06T01:08:50.530176+0000","last_active":"2023-07-06T01:08:53.084513+0000","last_peered":"2023-07-06T01:08:53.084513+0000","last_clean":"2023-07-06T01:08:53.084513+0000","last_became_active":"2023-07-06T01:08:50.529826+0000","last_became_peered":"2023-07-06T01:08:50.529826+0000","last_unstale":"2023-07-06T01:08:53.084513+0000","last_undegraded":"2023-07-06T01:08:53.084513+0000","last_fullsized":"2023-07-06T01:08:53.084513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:21:25.330239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552880+0000","last_change":"2023-07-06T01:08:51.549714+0000","last_active":"2023-07-06T01:08:52.552880+0000","last_peered":"2023-07-06T01:08:52.552880+0000","last_clean":"2023-07-06T01:08:52.552880+0000","last_became_active":"2023-07-06T01:08:51.549235+0000","last_became_peered":"2023-07-06T01:08:51.549235+0000","last_unstale":"2023-07-06T01:08:52.552880+0000","last_undegraded":"2023-07-06T01:08:52.552880+0000","last_fullsized":"2023-07-06T01:08:52.552880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087586+0000","last_change":"2023-07-06T01:08:50.540945+0000","last_active":"2023-07-06T01:08:53.087586+0000","last_peered":"2023-07-06T01:08:53.087586+0000","last_clean":"2023-07-06T01:08:53.087586+0000","last_became_active":"2023-07-06T01:08:50.540607+0000","last_became_peered":"2023-07-06T01:08:50.540607+0000","last_unstale":"2023-07-06T01:08:53.087586+0000","last_undegraded":"2023-07-06T01:08:53.087586+0000","last_fullsized":"2023-07-06T01:08:53.087586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:16.656543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084760+0000","last_change":"2023-07-06T01:08:51.555247+0000","last_active":"2023-07-06T01:08:53.084760+0000","last_peered":"2023-07-06T01:08:53.084760+0000","last_clean":"2023-07-06T01:08:53.084760+0000","last_became_active":"2023-07-06T01:08:51.554819+0000","last_became_peered":"2023-07-06T01:08:51.554819+0000","last_unstale":"2023-07-06T01:08:53.084760+0000","last_undegraded":"2023-07-06T01:08:53.084760+0000","last_fullsized":"2023-07-06T01:08:53.084760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:57.766960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087122+0000","last_change":"2023-07-06T01:08:50.541970+0000","last_active":"2023-07-06T01:08:53.087122+0000","last_peered":"2023-07-06T01:08:53.087122+0000","last_clean":"2023-07-06T01:08:53.087122+0000","last_became_active":"2023-07-06T01:08:50.541688+0000","last_became_peered":"2023-07-06T01:08:50.541688+0000","last_unstale":"2023-07-06T01:08:53.087122+0000","last_undegraded":"2023-07-06T01:08:53.087122+0000","last_fullsized":"2023-07-06T01:08:53.087122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085626+0000","last_change":"2023-07-06T01:08:51.562553+0000","last_active":"2023-07-06T01:08:53.085626+0000","last_peered":"2023-07-06T01:08:53.085626+0000","last_clean":"2023-07-06T01:08:53.085626+0000","last_became_active":"2023-07-06T01:08:51.562093+0000","last_became_peered":"2023-07-06T01:08:51.562093+0000","last_unstale":"2023-07-06T01:08:53.085626+0000","last_undegraded":"2023-07-06T01:08:53.085626+0000","last_fullsized":"2023-07-06T01:08:53.085626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:39.107293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087474+0000","last_change":"2023-07-06T01:08:50.542775+0000","last_active":"2023-07-06T01:08:53.087474+0000","last_peered":"2023-07-06T01:08:53.087474+0000","last_clean":"2023-07-06T01:08:53.087474+0000","last_became_active":"2023-07-06T01:08:50.542248+0000","last_became_peered":"2023-07-06T01:08:50.542248+0000","last_unstale":"2023-07-06T01:08:53.087474+0000","last_undegraded":"2023-07-06T01:08:53.087474+0000","last_fullsized":"2023-07-06T01:08:53.087474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:29.179839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085394+0000","last_change":"2023-07-06T01:08:51.547190+0000","last_active":"2023-07-06T01:08:53.085394+0000","last_peered":"2023-07-06T01:08:53.085394+0000","last_clean":"2023-07-06T01:08:53.085394+0000","last_became_active":"2023-07-06T01:08:51.546880+0000","last_became_peered":"2023-07-06T01:08:51.546880+0000","last_unstale":"2023-07-06T01:08:53.085394+0000","last_undegraded":"2023-07-06T01:08:53.085394+0000","last_fullsized":"2023-07-06T01:08:53.085394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:07.889518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084828+0000","last_change":"2023-07-06T01:08:50.538499+0000","last_active":"2023-07-06T01:08:53.084828+0000","last_peered":"2023-07-06T01:08:53.084828+0000","last_clean":"2023-07-06T01:08:53.084828+0000","last_became_active":"2023-07-06T01:08:50.537441+0000","last_became_peered":"2023-07-06T01:08:50.537441+0000","last_unstale":"2023-07-06T01:08:53.084828+0000","last_undegraded":"2023-07-06T01:08:53.084828+0000","last_fullsized":"2023-07-06T01:08:53.084828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550700+0000","last_change":"2023-07-06T01:08:51.546378+0000","last_active":"2023-07-06T01:08:52.550700+0000","last_peered":"2023-07-06T01:08:52.550700+0000","last_clean":"2023-07-06T01:08:52.550700+0000","last_became_active":"2023-07-06T01:08:51.546102+0000","last_became_peered":"2023-07-06T01:08:51.546102+0000","last_unstale":"2023-07-06T01:08:52.550700+0000","last_undegraded":"2023-07-06T01:08:52.550700+0000","last_fullsized":"2023-07-06T01:08:52.550700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552785+0000","last_change":"2023-07-06T01:08:50.535486+0000","last_active":"2023-07-06T01:08:52.552785+0000","last_peered":"2023-07-06T01:08:52.552785+0000","last_clean":"2023-07-06T01:08:52.552785+0000","last_became_active":"2023-07-06T01:08:50.535141+0000","last_became_peered":"2023-07-06T01:08:50.535141+0000","last_unstale":"2023-07-06T01:08:52.552785+0000","last_undegraded":"2023-07-06T01:08:52.552785+0000","last_fullsized":"2023-07-06T01:08:52.552785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:07.399205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085734+0000","last_change":"2023-07-06T01:08:51.564576+0000","last_active":"2023-07-06T01:08:53.085734+0000","last_peered":"2023-07-06T01:08:53.085734+0000","last_clean":"2023-07-06T01:08:53.085734+0000","last_became_active":"2023-07-06T01:08:51.563750+0000","last_became_peered":"2023-07-06T01:08:51.563750+0000","last_unstale":"2023-07-06T01:08:53.085734+0000","last_undegraded":"2023-07-06T01:08:53.085734+0000","last_fullsized":"2023-07-06T01:08:53.085734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:20.636091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085219+0000","last_change":"2023-07-06T01:08:50.536780+0000","last_active":"2023-07-06T01:08:53.085219+0000","last_peered":"2023-07-06T01:08:53.085219+0000","last_clean":"2023-07-06T01:08:53.085219+0000","last_became_active":"2023-07-06T01:08:50.536446+0000","last_became_peered":"2023-07-06T01:08:50.536446+0000","last_unstale":"2023-07-06T01:08:53.085219+0000","last_undegraded":"2023-07-06T01:08:53.085219+0000","last_fullsized":"2023-07-06T01:08:53.085219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:50:08.889015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085774+0000","last_change":"2023-07-06T01:08:51.565749+0000","last_active":"2023-07-06T01:08:53.085774+0000","last_peered":"2023-07-06T01:08:53.085774+0000","last_clean":"2023-07-06T01:08:53.085774+0000","last_became_active":"2023-07-06T01:08:51.564882+0000","last_became_peered":"2023-07-06T01:08:51.564882+0000","last_unstale":"2023-07-06T01:08:53.085774+0000","last_undegraded":"2023-07-06T01:08:53.085774+0000","last_fullsized":"2023-07-06T01:08:53.085774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:27:08.405952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086013+0000","last_change":"2023-07-06T01:08:50.536199+0000","last_active":"2023-07-06T01:08:53.086013+0000","last_peered":"2023-07-06T01:08:53.086013+0000","last_clean":"2023-07-06T01:08:53.086013+0000","last_became_active":"2023-07-06T01:08:50.535928+0000","last_became_peered":"2023-07-06T01:08:50.535928+0000","last_unstale":"2023-07-06T01:08:53.086013+0000","last_undegraded":"2023-07-06T01:08:53.086013+0000","last_fullsized":"2023-07-06T01:08:53.086013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:19:06.159125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085438+0000","last_change":"2023-07-06T01:08:51.557074+0000","last_active":"2023-07-06T01:08:53.085438+0000","last_peered":"2023-07-06T01:08:53.085438+0000","last_clean":"2023-07-06T01:08:53.085438+0000","last_became_active":"2023-07-06T01:08:51.556801+0000","last_became_peered":"2023-07-06T01:08:51.556801+0000","last_unstale":"2023-07-06T01:08:53.085438+0000","last_undegraded":"2023-07-06T01:08:53.085438+0000","last_fullsized":"2023-07-06T01:08:53.085438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551959+0000","last_change":"2023-07-06T01:08:50.540208+0000","last_active":"2023-07-06T01:08:52.551959+0000","last_peered":"2023-07-06T01:08:52.551959+0000","last_clean":"2023-07-06T01:08:52.551959+0000","last_became_active":"2023-07-06T01:08:50.539864+0000","last_became_peered":"2023-07-06T01:08:50.539864+0000","last_unstale":"2023-07-06T01:08:52.551959+0000","last_undegraded":"2023-07-06T01:08:52.551959+0000","last_fullsized":"2023-07-06T01:08:52.551959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:44.334492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084747+0000","last_change":"2023-07-06T01:08:51.553184+0000","last_active":"2023-07-06T01:08:53.084747+0000","last_peered":"2023-07-06T01:08:53.084747+0000","last_clean":"2023-07-06T01:08:53.084747+0000","last_became_active":"2023-07-06T01:08:51.552931+0000","last_became_peered":"2023-07-06T01:08:51.552931+0000","last_unstale":"2023-07-06T01:08:53.084747+0000","last_undegraded":"2023-07-06T01:08:53.084747+0000","last_fullsized":"2023-07-06T01:08:53.084747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084322+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:08:53.084322+0000","last_peered":"2023-07-06T01:08:53.084322+0000","last_clean":"2023-07-06T01:08:53.084322+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:08:53.084322+0000","last_undegraded":"2023-07-06T01:08:53.084322+0000","last_fullsized":"2023-07-06T01:08:53.084322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:19.832781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085719+0000","last_change":"2023-07-06T01:08:50.537966+0000","last_active":"2023-07-06T01:08:53.085719+0000","last_peered":"2023-07-06T01:08:53.085719+0000","last_clean":"2023-07-06T01:08:53.085719+0000","last_became_active":"2023-07-06T01:08:50.537636+0000","last_became_peered":"2023-07-06T01:08:50.537636+0000","last_unstale":"2023-07-06T01:08:53.085719+0000","last_undegraded":"2023-07-06T01:08:53.085719+0000","last_fullsized":"2023-07-06T01:08:53.085719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:47.787233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084364+0000","last_change":"2023-07-06T01:08:51.557906+0000","last_active":"2023-07-06T01:08:53.084364+0000","last_peered":"2023-07-06T01:08:53.084364+0000","last_clean":"2023-07-06T01:08:53.084364+0000","last_became_active":"2023-07-06T01:08:51.557620+0000","last_became_peered":"2023-07-06T01:08:51.557620+0000","last_unstale":"2023-07-06T01:08:53.084364+0000","last_undegraded":"2023-07-06T01:08:53.084364+0000","last_fullsized":"2023-07-06T01:08:53.084364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:57.075959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085188+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:08:53.085188+0000","last_peered":"2023-07-06T01:08:53.085188+0000","last_clean":"2023-07-06T01:08:53.085188+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:08:53.085188+0000","last_undegraded":"2023-07-06T01:08:53.085188+0000","last_fullsized":"2023-07-06T01:08:53.085188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086255+0000","last_change":"2023-07-06T01:08:50.541016+0000","last_active":"2023-07-06T01:08:53.086255+0000","last_peered":"2023-07-06T01:08:53.086255+0000","last_clean":"2023-07-06T01:08:53.086255+0000","last_became_active":"2023-07-06T01:08:50.540736+0000","last_became_peered":"2023-07-06T01:08:50.540736+0000","last_unstale":"2023-07-06T01:08:53.086255+0000","last_undegraded":"2023-07-06T01:08:53.086255+0000","last_fullsized":"2023-07-06T01:08:53.086255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:35:53.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084397+0000","last_change":"2023-07-06T01:08:51.546136+0000","last_active":"2023-07-06T01:08:53.084397+0000","last_peered":"2023-07-06T01:08:53.084397+0000","last_clean":"2023-07-06T01:08:53.084397+0000","last_became_active":"2023-07-06T01:08:51.545893+0000","last_became_peered":"2023-07-06T01:08:51.545893+0000","last_unstale":"2023-07-06T01:08:53.084397+0000","last_undegraded":"2023-07-06T01:08:53.084397+0000","last_fullsized":"2023-07-06T01:08:53.084397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:25.325812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083722+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:08:53.083722+0000","last_peered":"2023-07-06T01:08:53.083722+0000","last_clean":"2023-07-06T01:08:53.083722+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:08:53.083722+0000","last_undegraded":"2023-07-06T01:08:53.083722+0000","last_fullsized":"2023-07-06T01:08:53.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:26.895276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084090+0000","last_change":"2023-07-06T01:08:50.532825+0000","last_active":"2023-07-06T01:08:53.084090+0000","last_peered":"2023-07-06T01:08:53.084090+0000","last_clean":"2023-07-06T01:08:53.084090+0000","last_became_active":"2023-07-06T01:08:50.532585+0000","last_became_peered":"2023-07-06T01:08:50.532585+0000","last_unstale":"2023-07-06T01:08:53.084090+0000","last_undegraded":"2023-07-06T01:08:53.084090+0000","last_fullsized":"2023-07-06T01:08:53.084090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:12.002556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084599+0000","last_change":"2023-07-06T01:08:51.559769+0000","last_active":"2023-07-06T01:08:53.084599+0000","last_peered":"2023-07-06T01:08:53.084599+0000","last_clean":"2023-07-06T01:08:53.084599+0000","last_became_active":"2023-07-06T01:08:51.559480+0000","last_became_peered":"2023-07-06T01:08:51.559480+0000","last_unstale":"2023-07-06T01:08:53.084599+0000","last_undegraded":"2023-07-06T01:08:53.084599+0000","last_fullsized":"2023-07-06T01:08:53.084599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084736+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:08:53.084736+0000","last_peered":"2023-07-06T01:08:53.084736+0000","last_clean":"2023-07-06T01:08:53.084736+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:08:53.084736+0000","last_undegraded":"2023-07-06T01:08:53.084736+0000","last_fullsized":"2023-07-06T01:08:53.084736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:18.979186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086793+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:08:53.086793+0000","last_peered":"2023-07-06T01:08:53.086793+0000","last_clean":"2023-07-06T01:08:53.086793+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:08:53.086793+0000","last_undegraded":"2023-07-06T01:08:53.086793+0000","last_fullsized":"2023-07-06T01:08:53.086793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:07.245265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552114+0000","last_change":"2023-07-06T01:08:50.537552+0000","last_active":"2023-07-06T01:08:52.552114+0000","last_peered":"2023-07-06T01:08:52.552114+0000","last_clean":"2023-07-06T01:08:52.552114+0000","last_became_active":"2023-07-06T01:08:50.537148+0000","last_became_peered":"2023-07-06T01:08:50.537148+0000","last_unstale":"2023-07-06T01:08:52.552114+0000","last_undegraded":"2023-07-06T01:08:52.552114+0000","last_fullsized":"2023-07-06T01:08:52.552114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:40:24.319064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085655+0000","last_change":"2023-07-06T01:08:51.567558+0000","last_active":"2023-07-06T01:08:53.085655+0000","last_peered":"2023-07-06T01:08:53.085655+0000","last_clean":"2023-07-06T01:08:53.085655+0000","last_became_active":"2023-07-06T01:08:51.567124+0000","last_became_peered":"2023-07-06T01:08:51.567124+0000","last_unstale":"2023-07-06T01:08:53.085655+0000","last_undegraded":"2023-07-06T01:08:53.085655+0000","last_fullsized":"2023-07-06T01:08:53.085655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:49:00.611217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087397+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:08:53.087397+0000","last_peered":"2023-07-06T01:08:53.087397+0000","last_clean":"2023-07-06T01:08:53.087397+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:08:53.087397+0000","last_undegraded":"2023-07-06T01:08:53.087397+0000","last_fullsized":"2023-07-06T01:08:53.087397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:19.934388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550560+0000","last_change":"2023-07-06T01:08:50.534797+0000","last_active":"2023-07-06T01:08:52.550560+0000","last_peered":"2023-07-06T01:08:52.550560+0000","last_clean":"2023-07-06T01:08:52.550560+0000","last_became_active":"2023-07-06T01:08:50.534427+0000","last_became_peered":"2023-07-06T01:08:50.534427+0000","last_unstale":"2023-07-06T01:08:52.550560+0000","last_undegraded":"2023-07-06T01:08:52.550560+0000","last_fullsized":"2023-07-06T01:08:52.550560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:29:06.882770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551120+0000","last_change":"2023-07-06T01:08:51.546042+0000","last_active":"2023-07-06T01:08:52.551120+0000","last_peered":"2023-07-06T01:08:52.551120+0000","last_clean":"2023-07-06T01:08:52.551120+0000","last_became_active":"2023-07-06T01:08:51.545750+0000","last_became_peered":"2023-07-06T01:08:51.545750+0000","last_unstale":"2023-07-06T01:08:52.551120+0000","last_undegraded":"2023-07-06T01:08:52.551120+0000","last_fullsized":"2023-07-06T01:08:52.551120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:03.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.087298+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:08:53.087298+0000","last_peered":"2023-07-06T01:08:53.087298+0000","last_clean":"2023-07-06T01:08:53.087298+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:08:53.087298+0000","last_undegraded":"2023-07-06T01:08:53.087298+0000","last_fullsized":"2023-07-06T01:08:53.087298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:43:11.979401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084458+0000","last_change":"2023-07-06T01:08:50.534319+0000","last_active":"2023-07-06T01:08:53.084458+0000","last_peered":"2023-07-06T01:08:53.084458+0000","last_clean":"2023-07-06T01:08:53.084458+0000","last_became_active":"2023-07-06T01:08:50.533826+0000","last_became_peered":"2023-07-06T01:08:50.533826+0000","last_unstale":"2023-07-06T01:08:53.084458+0000","last_undegraded":"2023-07-06T01:08:53.084458+0000","last_fullsized":"2023-07-06T01:08:53.084458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.550966+0000","last_change":"2023-07-06T01:08:51.557367+0000","last_active":"2023-07-06T01:08:52.550966+0000","last_peered":"2023-07-06T01:08:52.550966+0000","last_clean":"2023-07-06T01:08:52.550966+0000","last_became_active":"2023-07-06T01:08:51.557052+0000","last_became_peered":"2023-07-06T01:08:51.557052+0000","last_unstale":"2023-07-06T01:08:52.550966+0000","last_undegraded":"2023-07-06T01:08:52.550966+0000","last_fullsized":"2023-07-06T01:08:52.550966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:26.179407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552734+0000","last_change":"2023-07-06T01:08:50.543132+0000","last_active":"2023-07-06T01:08:52.552734+0000","last_peered":"2023-07-06T01:08:52.552734+0000","last_clean":"2023-07-06T01:08:52.552734+0000","last_became_active":"2023-07-06T01:08:50.542761+0000","last_became_peered":"2023-07-06T01:08:50.542761+0000","last_unstale":"2023-07-06T01:08:52.552734+0000","last_undegraded":"2023-07-06T01:08:52.552734+0000","last_fullsized":"2023-07-06T01:08:52.552734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:19.629343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084587+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:08:53.084587+0000","last_peered":"2023-07-06T01:08:53.084587+0000","last_clean":"2023-07-06T01:08:53.084587+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:08:53.084587+0000","last_undegraded":"2023-07-06T01:08:53.084587+0000","last_fullsized":"2023-07-06T01:08:53.084587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:14.289464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551899+0000","last_change":"2023-07-06T01:08:51.545985+0000","last_active":"2023-07-06T01:08:52.551899+0000","last_peered":"2023-07-06T01:08:52.551899+0000","last_clean":"2023-07-06T01:08:52.551899+0000","last_became_active":"2023-07-06T01:08:51.545528+0000","last_became_peered":"2023-07-06T01:08:51.545528+0000","last_unstale":"2023-07-06T01:08:52.551899+0000","last_undegraded":"2023-07-06T01:08:52.551899+0000","last_fullsized":"2023-07-06T01:08:52.551899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:23:24.253061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085152+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:08:53.085152+0000","last_peered":"2023-07-06T01:08:53.085152+0000","last_clean":"2023-07-06T01:08:53.085152+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:08:53.085152+0000","last_undegraded":"2023-07-06T01:08:53.085152+0000","last_fullsized":"2023-07-06T01:08:53.085152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:37:36.583295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551025+0000","last_change":"2023-07-06T01:08:50.535232+0000","last_active":"2023-07-06T01:08:52.551025+0000","last_peered":"2023-07-06T01:08:52.551025+0000","last_clean":"2023-07-06T01:08:52.551025+0000","last_became_active":"2023-07-06T01:08:50.534926+0000","last_became_peered":"2023-07-06T01:08:50.534926+0000","last_unstale":"2023-07-06T01:08:52.551025+0000","last_undegraded":"2023-07-06T01:08:52.551025+0000","last_fullsized":"2023-07-06T01:08:52.551025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:56.069212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085799+0000","last_change":"2023-07-06T01:08:51.561799+0000","last_active":"2023-07-06T01:08:53.085799+0000","last_peered":"2023-07-06T01:08:53.085799+0000","last_clean":"2023-07-06T01:08:53.085799+0000","last_became_active":"2023-07-06T01:08:51.561471+0000","last_became_peered":"2023-07-06T01:08:51.561471+0000","last_unstale":"2023-07-06T01:08:53.085799+0000","last_undegraded":"2023-07-06T01:08:53.085799+0000","last_fullsized":"2023-07-06T01:08:53.085799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:15:33.989087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551090+0000","last_change":"2023-07-06T01:08:50.534777+0000","last_active":"2023-07-06T01:08:52.551090+0000","last_peered":"2023-07-06T01:08:52.551090+0000","last_clean":"2023-07-06T01:08:52.551090+0000","last_became_active":"2023-07-06T01:08:50.534459+0000","last_became_peered":"2023-07-06T01:08:50.534459+0000","last_unstale":"2023-07-06T01:08:52.551090+0000","last_undegraded":"2023-07-06T01:08:52.551090+0000","last_fullsized":"2023-07-06T01:08:52.551090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:44:56.760212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.083970+0000","last_change":"2023-07-06T01:08:51.545591+0000","last_active":"2023-07-06T01:08:53.083970+0000","last_peered":"2023-07-06T01:08:53.083970+0000","last_clean":"2023-07-06T01:08:53.083970+0000","last_became_active":"2023-07-06T01:08:51.545275+0000","last_became_peered":"2023-07-06T01:08:51.545275+0000","last_unstale":"2023-07-06T01:08:53.083970+0000","last_undegraded":"2023-07-06T01:08:53.083970+0000","last_fullsized":"2023-07-06T01:08:53.083970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:49.844566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084656+0000","last_change":"2023-07-06T01:08:50.539970+0000","last_active":"2023-07-06T01:08:53.084656+0000","last_peered":"2023-07-06T01:08:53.084656+0000","last_clean":"2023-07-06T01:08:53.084656+0000","last_became_active":"2023-07-06T01:08:50.539596+0000","last_became_peered":"2023-07-06T01:08:50.539596+0000","last_unstale":"2023-07-06T01:08:53.084656+0000","last_undegraded":"2023-07-06T01:08:53.084656+0000","last_fullsized":"2023-07-06T01:08:53.084656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:36:25.172660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086414+0000","last_change":"2023-07-06T01:08:51.564597+0000","last_active":"2023-07-06T01:08:53.086414+0000","last_peered":"2023-07-06T01:08:53.086414+0000","last_clean":"2023-07-06T01:08:53.086414+0000","last_became_active":"2023-07-06T01:08:51.564031+0000","last_became_peered":"2023-07-06T01:08:51.564031+0000","last_unstale":"2023-07-06T01:08:53.086414+0000","last_undegraded":"2023-07-06T01:08:53.086414+0000","last_fullsized":"2023-07-06T01:08:53.086414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:48:30.186587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085851+0000","last_change":"2023-07-06T01:08:50.539551+0000","last_active":"2023-07-06T01:08:53.085851+0000","last_peered":"2023-07-06T01:08:53.085851+0000","last_clean":"2023-07-06T01:08:53.085851+0000","last_became_active":"2023-07-06T01:08:50.539227+0000","last_became_peered":"2023-07-06T01:08:50.539227+0000","last_unstale":"2023-07-06T01:08:53.085851+0000","last_undegraded":"2023-07-06T01:08:53.085851+0000","last_fullsized":"2023-07-06T01:08:53.085851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:31:00.034062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086339+0000","last_change":"2023-07-06T01:08:51.564862+0000","last_active":"2023-07-06T01:08:53.086339+0000","last_peered":"2023-07-06T01:08:53.086339+0000","last_clean":"2023-07-06T01:08:53.086339+0000","last_became_active":"2023-07-06T01:08:51.564536+0000","last_became_peered":"2023-07-06T01:08:51.564536+0000","last_unstale":"2023-07-06T01:08:53.086339+0000","last_undegraded":"2023-07-06T01:08:53.086339+0000","last_fullsized":"2023-07-06T01:08:53.086339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:51:26.281015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552320+0000","last_change":"2023-07-06T01:08:50.539506+0000","last_active":"2023-07-06T01:08:52.552320+0000","last_peered":"2023-07-06T01:08:52.552320+0000","last_clean":"2023-07-06T01:08:52.552320+0000","last_became_active":"2023-07-06T01:08:50.539272+0000","last_became_peered":"2023-07-06T01:08:50.539272+0000","last_unstale":"2023-07-06T01:08:52.552320+0000","last_undegraded":"2023-07-06T01:08:52.552320+0000","last_fullsized":"2023-07-06T01:08:52.552320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:35:02.408975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551948+0000","last_change":"2023-07-06T01:08:51.550387+0000","last_active":"2023-07-06T01:08:52.551948+0000","last_peered":"2023-07-06T01:08:52.551948+0000","last_clean":"2023-07-06T01:08:52.551948+0000","last_became_active":"2023-07-06T01:08:51.550102+0000","last_became_peered":"2023-07-06T01:08:51.550102+0000","last_unstale":"2023-07-06T01:08:52.551948+0000","last_undegraded":"2023-07-06T01:08:52.551948+0000","last_fullsized":"2023-07-06T01:08:52.551948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:44:37.098887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551140+0000","last_change":"2023-07-06T01:08:50.531079+0000","last_active":"2023-07-06T01:08:52.551140+0000","last_peered":"2023-07-06T01:08:52.551140+0000","last_clean":"2023-07-06T01:08:52.551140+0000","last_became_active":"2023-07-06T01:08:50.530698+0000","last_became_peered":"2023-07-06T01:08:50.530698+0000","last_unstale":"2023-07-06T01:08:52.551140+0000","last_undegraded":"2023-07-06T01:08:52.551140+0000","last_fullsized":"2023-07-06T01:08:52.551140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:49.500534+0000","last_clean_scrub_stamp":"2023-07-06T01:08:49.500534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:45:38.100545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085028+0000","last_change":"2023-07-06T01:08:51.563224+0000","last_active":"2023-07-06T01:08:53.085028+0000","last_peered":"2023-07-06T01:08:53.085028+0000","last_clean":"2023-07-06T01:08:53.085028+0000","last_became_active":"2023-07-06T01:08:51.563080+0000","last_became_peered":"2023-07-06T01:08:51.563080+0000","last_unstale":"2023-07-06T01:08:53.085028+0000","last_undegraded":"2023-07-06T01:08:53.085028+0000","last_fullsized":"2023-07-06T01:08:53.085028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.085052+0000","last_change":"2023-07-06T01:08:51.543670+0000","last_active":"2023-07-06T01:08:53.085052+0000","last_peered":"2023-07-06T01:08:53.085052+0000","last_clean":"2023-07-06T01:08:53.085052+0000","last_became_active":"2023-07-06T01:08:51.542701+0000","last_became_peered":"2023-07-06T01:08:51.542701+0000","last_unstale":"2023-07-06T01:08:53.085052+0000","last_undegraded":"2023-07-06T01:08:53.085052+0000","last_fullsized":"2023-07-06T01:08:53.085052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:39:10.997755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.551937+0000","last_change":"2023-07-06T01:08:51.548220+0000","last_active":"2023-07-06T01:08:52.551937+0000","last_peered":"2023-07-06T01:08:52.551937+0000","last_clean":"2023-07-06T01:08:52.551937+0000","last_became_active":"2023-07-06T01:08:51.547940+0000","last_became_peered":"2023-07-06T01:08:51.547940+0000","last_unstale":"2023-07-06T01:08:52.551937+0000","last_undegraded":"2023-07-06T01:08:52.551937+0000","last_fullsized":"2023-07-06T01:08:52.551937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:55:13.009303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.086197+0000","last_change":"2023-07-06T01:08:51.561978+0000","last_active":"2023-07-06T01:08:53.086197+0000","last_peered":"2023-07-06T01:08:53.086197+0000","last_clean":"2023-07-06T01:08:53.086197+0000","last_became_active":"2023-07-06T01:08:51.561567+0000","last_became_peered":"2023-07-06T01:08:51.561567+0000","last_unstale":"2023-07-06T01:08:53.086197+0000","last_undegraded":"2023-07-06T01:08:53.086197+0000","last_fullsized":"2023-07-06T01:08:53.086197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:41:49.900494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:52.552910+0000","last_change":"2023-07-06T01:08:51.557783+0000","last_active":"2023-07-06T01:08:52.552910+0000","last_peered":"2023-07-06T01:08:52.552910+0000","last_clean":"2023-07-06T01:08:52.552910+0000","last_became_active":"2023-07-06T01:08:51.553006+0000","last_became_peered":"2023-07-06T01:08:51.553006+0000","last_unstale":"2023-07-06T01:08:52.552910+0000","last_undegraded":"2023-07-06T01:08:52.552910+0000","last_fullsized":"2023-07-06T01:08:52.552910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:59:48.793981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-06T01:08:53.084259+0000","last_change":"2023-07-06T01:08:51.554515+0000","last_active":"2023-07-06T01:08:53.084259+0000","last_peered":"2023-07-06T01:08:53.084259+0000","last_clean":"2023-07-06T01:08:53.084259+0000","last_became_active":"2023-07-06T01:08:51.554231+0000","last_became_peered":"2023-07-06T01:08:51.554231+0000","last_unstale":"2023-07-06T01:08:53.084259+0000","last_undegraded":"2023-07-06T01:08:53.084259+0000","last_fullsized":"2023-07-06T01:08:53.084259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:50.507282+0000","last_clean_scrub_stamp":"2023-07-06T01:08:50.507282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:01:45.341240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7329999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9290000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.54}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.534000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7989999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0810000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.965}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.998999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.992}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.0370000000000008}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.915}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1479999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:09:07.006 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-06T01:09:07.006 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-06T01:09:07.007 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-06T01:09:07.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-06T01:09:07.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.229+0000 7fa6da9ff700 1 Processor -- start 2023-07-06T01:09:07.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.229+0000 7fa6da9ff700 1 -- start start 2023-07-06T01:09:07.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6da9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6d415fca0 0x7fa6d40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6da9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b5c90 0x7fa6d40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6da9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40cf780 con 0x7fa6d40b60e0 2023-07-06T01:09:07.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6da9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d40cd490 con 0x7fa6d415fca0 2023-07-06T01:09:07.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6da9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40cd770 con 0x7fa6d40b5c90 2023-07-06T01:09:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6d37fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b5c90 0x7fa6d40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6d8f9c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa6d40b60e0 0x7fa6d40cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:44876/0 (socket says 172.21.15.71:44876) 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6d8f9c700 1 -- 172.21.15.71:0/3490431389 learned_addr learned my addr 172.21.15.71:0/3490431389 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.231+0000 7fa6d3fff700 1 --2- 172.21.15.71:0/3490431389 >> v2:172.21.15.194:3300/0 conn(0x7fa6d415fca0 0x7fa6d40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d2ffd700 1 -- 172.21.15.71:0/3490431389 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773989394 0 0) 0x7fa6d40cf780 con 0x7fa6d40b60e0 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d2ffd700 1 -- 172.21.15.71:0/3490431389 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6bc0035b0 con 0x7fa6d40b60e0 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d3fff700 1 -- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b5c90 msgr2=0x7fa6d40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d3fff700 1 --2- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b5c90 0x7fa6d40d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d3fff700 1 -- 172.21.15.71:0/3490431389 >> v1:172.21.15.194:6789/0 conn(0x7fa6d40b60e0 legacy=0x7fa6d40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d3fff700 1 -- 172.21.15.71:0/3490431389 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40cda50 con 0x7fa6d415fca0 2023-07-06T01:09:07.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d37fe700 1 --2- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b5c90 0x7fa6d40d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:07.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d3fff700 1 --2- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d415fca0 0x7fa6d40d1420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af48ccc1ebd53711 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:07.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d2ffd700 1 -- 172.21.15.71:0/3490431389 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011830 con 0x7fa6d415fca0 2023-07-06T01:09:07.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d2ffd700 1 -- 172.21.15.71:0/3490431389 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4011990 con 0x7fa6d415fca0 2023-07-06T01:09:07.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.232+0000 7fa6d2ffd700 1 -- 172.21.15.71:0/3490431389 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011d20 con 0x7fa6d415fca0 2023-07-06T01:09:07.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 -- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d415fca0 msgr2=0x7fa6d40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d415fca0 0x7fa6d40d1420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009840 tx=0x7fa6c4009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:07.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 -- 172.21.15.71:0/3490431389 shutdown_connections 2023-07-06T01:09:07.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d415fca0 0x7fa6d40d1420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/3490431389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b5c90 0x7fa6d40d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 -- 172.21.15.71:0/3490431389 >> 172.21.15.71:0/3490431389 conn(0x7fa6d406c150 msgr2=0x7fa6d406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:07.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 -- 172.21.15.71:0/3490431389 shutdown_connections 2023-07-06T01:09:07.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.233+0000 7fa6da9ff700 1 -- 172.21.15.71:0/3490431389 wait complete. 2023-07-06T01:09:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.235+0000 7fa6da9ff700 1 Processor -- start 2023-07-06T01:09:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.235+0000 7fa6da9ff700 1 -- start start 2023-07-06T01:09:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6da9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d40b5c90 0x7fa6d40b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6da9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b60e0 0x7fa6d40cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6da9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 0x7fa6d40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6da9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41f64b0 con 0x7fa6d415fca0 2023-07-06T01:09:07.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6da9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d41f1f60 con 0x7fa6d40b5c90 2023-07-06T01:09:07.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6da9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40b25f0 con 0x7fa6d40b60e0 2023-07-06T01:09:07.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d8f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 0x7fa6d40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d3fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d40b5c90 0x7fa6d40b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d8f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 0x7fa6d40cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43174/0 (socket says 172.21.15.71:43174) 2023-07-06T01:09:07.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d8f9c700 1 -- 172.21.15.71:0/4237723569 learned_addr learned my addr 172.21.15.71:0/4237723569 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:07.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d37fe700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b60e0 0x7fa6d40cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d3fff700 1 -- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b60e0 msgr2=0x7fa6d40cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d3fff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b60e0 0x7fa6d40cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d3fff700 1 -- 172.21.15.71:0/4237723569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 msgr2=0x7fa6d40cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d3fff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 0x7fa6d40cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d3fff700 1 -- 172.21.15.71:0/4237723569 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c80094a0 con 0x7fa6d40b5c90 2023-07-06T01:09:07.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.236+0000 7fa6d8f9c700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 0x7fa6d40cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:07.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.237+0000 7fa6d3fff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d40b5c90 0x7fa6d40b20b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4016000 tx=0x7fa6c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:07.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.237+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4004590 con 0x7fa6d40b5c90 2023-07-06T01:09:07.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.237+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c401e070 con 0x7fa6d40b5c90 2023-07-06T01:09:07.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.237+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40038e0 con 0x7fa6d40b5c90 2023-07-06T01:09:07.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.237+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c40094a0 con 0x7fa6d40b5c90 2023-07-06T01:09:07.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.237+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d41f2500 con 0x7fa6d40b5c90 2023-07-06T01:09:07.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.238+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40008d0 con 0x7fa6d40b5c90 2023-07-06T01:09:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.239+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6c4003a40 con 0x7fa6d40b5c90 2023-07-06T01:09:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.240+0000 7fa6d0ff9700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa6c006ace0 0x7fa6c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.240+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6c408a440 con 0x7fa6d40b5c90 2023-07-06T01:09:07.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.240+0000 7fa6d37fe700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa6c006ace0 0x7fa6c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.241+0000 7fa6d37fe700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa6c006ace0 0x7fa6c006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6d41f6630 tx=0x7fa6c8009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:07.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.245+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6c4055460 con 0x7fa6d40b5c90 2023-07-06T01:09:07.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.485+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa6d40ce0c0 con 0x7fa6d40b5c90 2023-07-06T01:09:07.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.486+0000 7fa6d0ff9700 1 -- 172.21.15.71:0/4237723569 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa6c4058a80 con 0x7fa6d40b5c90 2023-07-06T01:09:07.489 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:07.489 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-06T01:09:07.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa6c006ace0 msgr2=0x7fa6c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa6c006ace0 0x7fa6c006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa6d41f6630 tx=0x7fa6c8009210 comp rx=0 tx=0).stop 2023-07-06T01:09:07.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d40b5c90 msgr2=0x7fa6d40b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d40b5c90 0x7fa6d40b20b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4016000 tx=0x7fa6c4004750 comp rx=0 tx=0).stop 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 shutdown_connections 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa6c006ace0 0x7fa6c006d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa6d415fca0 0x7fa6d40cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d40b5c90 0x7fa6d40b20b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 --2- 172.21.15.71:0/4237723569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6d40b60e0 0x7fa6d40cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 >> 172.21.15.71:0/4237723569 conn(0x7fa6d406c150 msgr2=0x7fa6d40cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 shutdown_connections 2023-07-06T01:09:07.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.488+0000 7fa6da9ff700 1 -- 172.21.15.71:0/4237723569 wait complete. 2023-07-06T01:09:07.508 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-06T01:09:07.509 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:07.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.704+0000 7f63fbfff700 1 Processor -- start 2023-07-06T01:09:07.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.704+0000 7f63fbfff700 1 -- start start 2023-07-06T01:09:07.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.705+0000 7f63fbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63f415fca0 0x7f63f40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.705+0000 7f63fbfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f40cf780 con 0x7f63f40b5c90 2023-07-06T01:09:07.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.705+0000 7f63fbfff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f40cd490 con 0x7f63f40b6110 2023-07-06T01:09:07.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.705+0000 7f63fbfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40cd770 con 0x7f63f415fca0 2023-07-06T01:09:07.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f9d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63f415fca0 0x7f63f40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f959a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f63f40b5c90 0x7f63f40d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34634/0 (socket says 172.21.15.71:34634) 2023-07-06T01:09:07.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f959a700 1 -- 172.21.15.71:0/1918283990 learned_addr learned my addr 172.21.15.71:0/1918283990 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:07.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f9d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f63f415fca0 0x7f63f40d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43176/0 (socket says 172.21.15.71:43176) 2023-07-06T01:09:07.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1918283990 >> v1:172.21.15.194:6789/0 conn(0x7f63f40b6110 legacy=0x7f63f40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:07.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1918283990 >> v1:172.21.15.71:6789/0 conn(0x7f63f40b5c90 legacy=0x7f63f40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1918283990 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40cda50 con 0x7f63f415fca0 2023-07-06T01:09:07.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f8d99700 1 -- 172.21.15.71:0/1918283990 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621438703 0 0) 0x7f63f40cf780 con 0x7f63f40b5c90 2023-07-06T01:09:07.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.706+0000 7f63f9d9b700 1 --2- 172.21.15.71:0/1918283990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f415fca0 0x7f63f40d1420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009840 tx=0x7f63f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338b73c6c28f04b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:07.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63f8d99700 1 -- 172.21.15.71:0/1918283990 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0004230 con 0x7f63f415fca0 2023-07-06T01:09:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63f8d99700 1 -- 172.21.15.71:0/1918283990 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f0004390 con 0x7f63f415fca0 2023-07-06T01:09:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63f8d99700 1 -- 172.21.15.71:0/1918283990 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00036a0 con 0x7f63f415fca0 2023-07-06T01:09:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 -- 172.21.15.71:0/1918283990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f415fca0 msgr2=0x7f63f40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1918283990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f415fca0 0x7f63f40d1420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009840 tx=0x7f63f0009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 -- 172.21.15.71:0/1918283990 shutdown_connections 2023-07-06T01:09:07.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1918283990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f415fca0 0x7f63f40d1420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 -- 172.21.15.71:0/1918283990 >> 172.21.15.71:0/1918283990 conn(0x7f63f406c150 msgr2=0x7f63f406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 -- 172.21.15.71:0/1918283990 shutdown_connections 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.707+0000 7f63fbfff700 1 -- 172.21.15.71:0/1918283990 wait complete. 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.709+0000 7f63fbfff700 1 Processor -- start 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.709+0000 7f63fbfff700 1 -- start start 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 0x7f63f40cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fbfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63f40b6110 0x7f63f40b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fbfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63f415fca0 0x7f63f40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fbfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4156200 con 0x7f63f40b5c90 2023-07-06T01:09:07.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fbfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40c9f10 con 0x7f63f40b6110 2023-07-06T01:09:07.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fbfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41555f0 con 0x7f63f415fca0 2023-07-06T01:09:07.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 0x7f63f40cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 0x7f63f40cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43186/0 (socket says 172.21.15.71:43186) 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1652425695 learned_addr learned my addr 172.21.15.71:0/1652425695 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63f959a700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63f40b6110 0x7f63f40b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.710+0000 7f63fa59c700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63f415fca0 0x7f63f40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63f415fca0 msgr2=0x7f63f40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f9d9b700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63f415fca0 0x7f63f40b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63f40b6110 msgr2=0x7f63f40b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f9d9b700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63f40b6110 0x7f63f40b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f9d9b700 1 -- 172.21.15.71:0/1652425695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00094a0 con 0x7f63f40b5c90 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63fa59c700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63f415fca0 0x7f63f40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f959a700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63f40b6110 0x7f63f40b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63f9d9b700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 0x7f63f40cc1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f63f00090b0 tx=0x7f63f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0011830 con 0x7f63f40b5c90 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f001e070 con 0x7f63f40b5c90 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f41558d0 con 0x7f63f40b5c90 2023-07-06T01:09:07.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0011bb0 con 0x7f63f40b5c90 2023-07-06T01:09:07.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.711+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f4155e90 con 0x7f63f40b5c90 2023-07-06T01:09:07.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.712+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f40008d0 con 0x7f63f40b5c90 2023-07-06T01:09:07.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.713+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63f0011d10 con 0x7f63f40b5c90 2023-07-06T01:09:07.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.714+0000 7f63ea7fc700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f63d806ace0 0x7f63d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:07.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.714+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63f008a8c0 con 0x7f63f40b5c90 2023-07-06T01:09:07.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.714+0000 7f63f959a700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f63d806ace0 0x7f63d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:07.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.715+0000 7f63f959a700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f63d806ace0 0x7f63d806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007fd0 tx=0x7f63e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:07.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.719+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63f0055960 con 0x7f63f40b5c90 2023-07-06T01:09:07.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.912+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63f40c7840 con 0x7f63f40b5c90 2023-07-06T01:09:07.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.913+0000 7f63ea7fc700 1 -- 172.21.15.71:0/1652425695 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f63f0020090 con 0x7f63f40b5c90 2023-07-06T01:09:07.916 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:07.916 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:07.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f63d806ace0 msgr2=0x7f63d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f63d806ace0 0x7f63d806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f63e4007fd0 tx=0x7f63e4009040 comp rx=0 tx=0).stop 2023-07-06T01:09:07.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 msgr2=0x7f63f40cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:07.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 0x7f63f40cc1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f63f00090b0 tx=0x7f63f0004750 comp rx=0 tx=0).stop 2023-07-06T01:09:07.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 shutdown_connections 2023-07-06T01:09:07.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f63d806ace0 0x7f63d806d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63f415fca0 0x7f63f40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63f40b5c90 0x7f63f40cc1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 --2- 172.21.15.71:0/1652425695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63f40b6110 0x7f63f40b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:07.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.915+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 >> 172.21.15.71:0/1652425695 conn(0x7f63f406c150 msgr2=0x7f63f4073060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:07.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.916+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 shutdown_connections 2023-07-06T01:09:07.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:07.916+0000 7f63fbfff700 1 -- 172.21.15.71:0/1652425695 wait complete. 2023-07-06T01:09:07.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:07.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:08.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.130+0000 7f3910bff700 1 Processor -- start 2023-07-06T01:09:08.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.130+0000 7f3910bff700 1 -- start start 2023-07-06T01:09:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.131+0000 7f3910bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f390c15fca0 0x7f390c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.131+0000 7f3910bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f390c0b5c90 0x7f390c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.131+0000 7f3910bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0cf780 con 0x7f390c0b6110 2023-07-06T01:09:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.131+0000 7f3910bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0cd490 con 0x7f390c15fca0 2023-07-06T01:09:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.131+0000 7f3910bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0cd770 con 0x7f390c0b5c90 2023-07-06T01:09:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f390c15fca0 0x7f390c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f390c15fca0 0x7f390c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43194/0 (socket says 172.21.15.71:43194) 2023-07-06T01:09:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 -- 172.21.15.71:0/3041184456 learned_addr learned my addr 172.21.15.71:0/3041184456 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 -- 172.21.15.71:0/3041184456 >> v2:172.21.15.194:3300/0 conn(0x7f390c0b5c90 msgr2=0x7f390c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 --2- 172.21.15.71:0/3041184456 >> v2:172.21.15.194:3300/0 conn(0x7f390c0b5c90 0x7f390c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 -- 172.21.15.71:0/3041184456 >> v1:172.21.15.194:6789/0 conn(0x7f390c0b6110 legacy=0x7f390c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 -- 172.21.15.71:0/3041184456 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0cda50 con 0x7f390c15fca0 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390a59c700 1 --2- 172.21.15.71:0/3041184456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c15fca0 0x7f390c0d1420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f390c06b6f0 tx=0x7f38fc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14fc65f9394f92c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.132+0000 7f390959a700 1 -- 172.21.15.71:0/3041184456 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc004230 con 0x7f390c15fca0 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f390959a700 1 -- 172.21.15.71:0/3041184456 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc004390 con 0x7f390c15fca0 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f390959a700 1 -- 172.21.15.71:0/3041184456 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0036a0 con 0x7f390c15fca0 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 -- 172.21.15.71:0/3041184456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c15fca0 msgr2=0x7f390c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 --2- 172.21.15.71:0/3041184456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c15fca0 0x7f390c0d1420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f390c06b6f0 tx=0x7f38fc009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 -- 172.21.15.71:0/3041184456 shutdown_connections 2023-07-06T01:09:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 --2- 172.21.15.71:0/3041184456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c15fca0 0x7f390c0d1420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 --2- 172.21.15.71:0/3041184456 >> v2:172.21.15.194:3300/0 conn(0x7f390c0b5c90 0x7f390c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 -- 172.21.15.71:0/3041184456 >> 172.21.15.71:0/3041184456 conn(0x7f390c06c150 msgr2=0x7f390c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 -- 172.21.15.71:0/3041184456 shutdown_connections 2023-07-06T01:09:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.133+0000 7f3910bff700 1 -- 172.21.15.71:0/3041184456 wait complete. 2023-07-06T01:09:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.135+0000 7f3910bff700 1 Processor -- start 2023-07-06T01:09:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.135+0000 7f3910bff700 1 -- start start 2023-07-06T01:09:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3910bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390c0b5c90 0x7f390c158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3910bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 0x7f390c1f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3910bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f390c15fca0 0x7f390c1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3910bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c158b90 con 0x7f390c0b6110 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3910bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1f54f0 con 0x7f390c0b5c90 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3910bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1f2440 con 0x7f390c15fca0 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3909d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 0x7f390c1f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3909d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 0x7f390c1f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43206/0 (socket says 172.21.15.71:43206) 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.136+0000 7f3909d9b700 1 -- 172.21.15.71:0/1424088725 learned_addr learned my addr 172.21.15.71:0/1424088725 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3909d9b700 1 -- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f390c15fca0 msgr2=0x7f390c1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3909d9b700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f390c15fca0 0x7f390c1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3909d9b700 1 -- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390c0b5c90 msgr2=0x7f390c158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3909d9b700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390c0b5c90 0x7f390c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3909d9b700 1 -- 172.21.15.71:0/1424088725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009550 con 0x7f390c0b6110 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3909d9b700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 0x7f390c1f1f00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f390000b530 tx=0x7f390000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900011830 con 0x7f390c0b6110 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000119b0 con 0x7f390c0b6110 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c1f26e0 con 0x7f390c0b6110 2023-07-06T01:09:08.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900011d60 con 0x7f390c0b6110 2023-07-06T01:09:08.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.137+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c1f2ca0 con 0x7f390c0b6110 2023-07-06T01:09:08.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.138+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c0008d0 con 0x7f390c0b6110 2023-07-06T01:09:08.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.139+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f390001a400 con 0x7f390c0b6110 2023-07-06T01:09:08.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.140+0000 7f38faffd700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38ec06ace0 0x7f38ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.140+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3900089560 con 0x7f390c0b6110 2023-07-06T01:09:08.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.140+0000 7f390a59c700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38ec06ace0 0x7f38ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.141+0000 7f390a59c700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38ec06ace0 0x7f38ec06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f390c0cc8b0 tx=0x7f38fc010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.144+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3900054610 con 0x7f390c0b6110 2023-07-06T01:09:08.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.336+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f390c1f2e30 con 0x7f390c0b6110 2023-07-06T01:09:08.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.337+0000 7f38faffd700 1 -- 172.21.15.71:0/1424088725 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3900057c30 con 0x7f390c0b6110 2023-07-06T01:09:08.339 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38ec06ace0 msgr2=0x7f38ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38ec06ace0 0x7f38ec06d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f390c0cc8b0 tx=0x7f38fc010000 comp rx=0 tx=0).stop 2023-07-06T01:09:08.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 msgr2=0x7f390c1f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 0x7f390c1f1f00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f390000b530 tx=0x7f390000b8f0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 shutdown_connections 2023-07-06T01:09:08.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38ec06ace0 0x7f38ec06d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f390c15fca0 0x7f390c1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f390c0b5c90 0x7f390c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 --2- 172.21.15.71:0/1424088725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f390c0b6110 0x7f390c1f1f00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 >> 172.21.15.71:0/1424088725 conn(0x7f390c06c150 msgr2=0x7f390c0d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:08.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 shutdown_connections 2023-07-06T01:09:08.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.339+0000 7f3910bff700 1 -- 172.21.15.71:0/1424088725 wait complete. 2023-07-06T01:09:08.359 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.555+0000 7f89e07ff700 1 Processor -- start 2023-07-06T01:09:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.555+0000 7f89e07ff700 1 -- start start 2023-07-06T01:09:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.556+0000 7f89e07ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89d815fca0 0x7f89d80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.556+0000 7f89e07ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b6110 0x7f89d80cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.556+0000 7f89e07ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d80cf780 con 0x7f89d80b5c90 2023-07-06T01:09:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.556+0000 7f89e07ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d80cd490 con 0x7f89d815fca0 2023-07-06T01:09:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.556+0000 7f89e07ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80cd770 con 0x7f89d80b6110 2023-07-06T01:09:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89d815fca0 0x7f89d80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89d815fca0 0x7f89d80d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43208/0 (socket says 172.21.15.71:43208) 2023-07-06T01:09:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 -- 172.21.15.71:0/956749048 learned_addr learned my addr 172.21.15.71:0/956749048 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 -- 172.21.15.71:0/956749048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b6110 msgr2=0x7f89d80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 --2- 172.21.15.71:0/956749048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b6110 0x7f89d80cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 -- 172.21.15.71:0/956749048 >> v1:172.21.15.194:6789/0 conn(0x7f89d80b5c90 legacy=0x7f89d80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 -- 172.21.15.71:0/956749048 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80cda50 con 0x7f89d815fca0 2023-07-06T01:09:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89de59b700 1 --2- 172.21.15.71:0/956749048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d815fca0 0x7f89d80d1420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f89d40098f0 tx=0x7f89d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359dac1f2ea899e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89dd599700 1 -- 172.21.15.71:0/956749048 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4004230 con 0x7f89d815fca0 2023-07-06T01:09:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89dd599700 1 -- 172.21.15.71:0/956749048 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4004390 con 0x7f89d815fca0 2023-07-06T01:09:08.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.557+0000 7f89dd599700 1 -- 172.21.15.71:0/956749048 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40036a0 con 0x7f89d815fca0 2023-07-06T01:09:08.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 -- 172.21.15.71:0/956749048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d815fca0 msgr2=0x7f89d80d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 --2- 172.21.15.71:0/956749048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d815fca0 0x7f89d80d1420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f89d40098f0 tx=0x7f89d4009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:08.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 -- 172.21.15.71:0/956749048 shutdown_connections 2023-07-06T01:09:08.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 --2- 172.21.15.71:0/956749048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b6110 0x7f89d80cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 --2- 172.21.15.71:0/956749048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d815fca0 0x7f89d80d1420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 -- 172.21.15.71:0/956749048 >> 172.21.15.71:0/956749048 conn(0x7f89d806c150 msgr2=0x7f89d806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 -- 172.21.15.71:0/956749048 shutdown_connections 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.558+0000 7f89e07ff700 1 -- 172.21.15.71:0/956749048 wait complete. 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.560+0000 7f89e07ff700 1 Processor -- start 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.560+0000 7f89e07ff700 1 -- start start 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89e07ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b5c90 0x7f89d8156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89e07ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 0x7f89d80c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89e07ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815fca0 0x7f89d80cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89e07ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81577c0 con 0x7f89d80b6110 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89e07ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80cc060 con 0x7f89d815fca0 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89e07ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d80c6930 con 0x7f89d80b5c90 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 0x7f89d80c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 0x7f89d80c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43218/0 (socket says 172.21.15.71:43218) 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 -- 172.21.15.71:0/301075881 learned_addr learned my addr 172.21.15.71:0/301075881 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:08.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89de59b700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b5c90 0x7f89d8156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ded9c700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815fca0 0x7f89d80cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 -- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b5c90 msgr2=0x7f89d8156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b5c90 0x7f89d8156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 -- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815fca0 msgr2=0x7f89d80cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815fca0 0x7f89d80cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.561+0000 7f89ddd9a700 1 -- 172.21.15.71:0/301075881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009550 con 0x7f89d80b6110 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.562+0000 7f89ddd9a700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 0x7f89d80c76f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c4a0 tx=0x7f89c800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.562+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80054e0 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.562+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8003680 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.562+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8003a30 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.562+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d80c6c10 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.562+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d80c71d0 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.563+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d80008d0 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.564+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89c8003b90 con 0x7f89d80b6110 2023-07-06T01:09:08.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.565+0000 7f89ceffd700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f89bc06ad10 0x7f89bc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.565+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89c8088440 con 0x7f89d80b6110 2023-07-06T01:09:08.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.565+0000 7f89de59b700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f89bc06ad10 0x7f89bc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.566+0000 7f89de59b700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f89bc06ad10 0x7f89bc06d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009130 tx=0x7f89d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.569+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89c8053450 con 0x7f89d80b6110 2023-07-06T01:09:08.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.767+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89d80b3780 con 0x7f89d80b6110 2023-07-06T01:09:08.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.767+0000 7f89ceffd700 1 -- 172.21.15.71:0/301075881 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89c8056a70 con 0x7f89d80b6110 2023-07-06T01:09:08.771 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:08.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f89bc06ad10 msgr2=0x7f89bc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f89bc06ad10 0x7f89bc06d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009130 tx=0x7f89d4008030 comp rx=0 tx=0).stop 2023-07-06T01:09:08.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 msgr2=0x7f89d80c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 0x7f89d80c76f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c4a0 tx=0x7f89c800c7b0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 shutdown_connections 2023-07-06T01:09:08.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f89bc06ad10 0x7f89bc06d1c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89d815fca0 0x7f89d80cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f89d80b5c90 0x7f89d8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 --2- 172.21.15.71:0/301075881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d80b6110 0x7f89d80c76f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 >> 172.21.15.71:0/301075881 conn(0x7f89d806c150 msgr2=0x7f89d815a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:08.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 shutdown_connections 2023-07-06T01:09:08.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.769+0000 7f89e07ff700 1 -- 172.21.15.71:0/301075881 wait complete. 2023-07-06T01:09:08.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.983+0000 7fd262dff700 1 Processor -- start 2023-07-06T01:09:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.984+0000 7fd262dff700 1 -- start start 2023-07-06T01:09:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd262dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd25c0b5c90 0x7fd25c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd262dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c0cf780 con 0x7fd25c15fca0 2023-07-06T01:09:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd262dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c0cd490 con 0x7fd25c0b6110 2023-07-06T01:09:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd262dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0cd770 con 0x7fd25c0b5c90 2023-07-06T01:09:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd25bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd25c0b5c90 0x7fd25c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd260b9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd25c15fca0 0x7fd25c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34642/0 (socket says 172.21.15.71:34642) 2023-07-06T01:09:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd260b9b700 1 -- 172.21.15.71:0/755457839 learned_addr learned my addr 172.21.15.71:0/755457839 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd25bfff700 1 -- 172.21.15.71:0/755457839 >> v1:172.21.15.194:6789/0 conn(0x7fd25c0b6110 legacy=0x7fd25c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd25bfff700 1 -- 172.21.15.71:0/755457839 >> v1:172.21.15.71:6789/0 conn(0x7fd25c15fca0 legacy=0x7fd25c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd25bfff700 1 -- 172.21.15.71:0/755457839 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0cda50 con 0x7fd25c0b5c90 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.985+0000 7fd25b7fe700 1 -- 172.21.15.71:0/755457839 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245753356 0 0) 0x7fd25c0cf780 con 0x7fd25c15fca0 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd25bfff700 1 --2- 172.21.15.71:0/755457839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c0b5c90 0x7fd25c0d2d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd248009840 tx=0x7fd248009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de525c7c69358aa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd25b7fe700 1 -- 172.21.15.71:0/755457839 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248004230 con 0x7fd25c0b5c90 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd25b7fe700 1 -- 172.21.15.71:0/755457839 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248004390 con 0x7fd25c0b5c90 2023-07-06T01:09:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd25b7fe700 1 -- 172.21.15.71:0/755457839 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480036a0 con 0x7fd25c0b5c90 2023-07-06T01:09:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd262dff700 1 -- 172.21.15.71:0/755457839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c0b5c90 msgr2=0x7fd25c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd262dff700 1 --2- 172.21.15.71:0/755457839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c0b5c90 0x7fd25c0d2d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd248009840 tx=0x7fd248009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd262dff700 1 -- 172.21.15.71:0/755457839 shutdown_connections 2023-07-06T01:09:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd262dff700 1 --2- 172.21.15.71:0/755457839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c0b5c90 0x7fd25c0d2d40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.986+0000 7fd262dff700 1 -- 172.21.15.71:0/755457839 >> 172.21.15.71:0/755457839 conn(0x7fd25c06c150 msgr2=0x7fd25c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.987+0000 7fd262dff700 1 -- 172.21.15.71:0/755457839 shutdown_connections 2023-07-06T01:09:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.987+0000 7fd262dff700 1 -- 172.21.15.71:0/755457839 wait complete. 2023-07-06T01:09:08.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.988+0000 7fd262dff700 1 Processor -- start 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.988+0000 7fd262dff700 1 -- start start 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.989+0000 7fd262dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd25c0b5c90 0x7fd25c0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.989+0000 7fd262dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd25c0b6110 0x7fd25c14ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.989+0000 7fd262dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 0x7fd25c1f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.989+0000 7fd262dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c1f1de0 con 0x7fd25c15fca0 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.989+0000 7fd262dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c14b060 con 0x7fd25c0b6110 2023-07-06T01:09:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.989+0000 7fd262dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c1f63b0 con 0x7fd25c0b5c90 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 0x7fd25c1f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 0x7fd25c1f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43234/0 (socket says 172.21.15.71:43234) 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 -- 172.21.15.71:0/1091520222 learned_addr learned my addr 172.21.15.71:0/1091520222 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd25bfff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd25c0b6110 0x7fd25c14ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd260b9b700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd25c0b5c90 0x7fd25c0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 -- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd25c0b5c90 msgr2=0x7fd25c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd25c0b5c90 0x7fd25c0c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 -- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd25c0b6110 msgr2=0x7fd25c14ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd25c0b6110 0x7fd25c14ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 -- 172.21.15.71:0/1091520222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480094a0 con 0x7fd25c15fca0 2023-07-06T01:09:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.990+0000 7fd26139c700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 0x7fd25c1f5e70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c7d0 tx=0x7fd25400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.991+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254003e10 con 0x7fd25c15fca0 2023-07-06T01:09:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.991+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254005070 con 0x7fd25c15fca0 2023-07-06T01:09:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.991+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254005420 con 0x7fd25c15fca0 2023-07-06T01:09:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.991+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c14b250 con 0x7fd25c15fca0 2023-07-06T01:09:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.991+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c14b810 con 0x7fd25c15fca0 2023-07-06T01:09:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.992+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c0008d0 con 0x7fd25c15fca0 2023-07-06T01:09:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.993+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd254005580 con 0x7fd25c15fca0 2023-07-06T01:09:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.994+0000 7fd2597fa700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd24006ace0 0x7fd24006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.994+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2540885c0 con 0x7fd25c15fca0 2023-07-06T01:09:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.994+0000 7fd260b9b700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd24006ace0 0x7fd24006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:08.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.995+0000 7fd260b9b700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd24006ace0 0x7fd24006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd250007fd0 tx=0x7fd250007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:08.998+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd254053670 con 0x7fd25c15fca0 2023-07-06T01:09:09.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.191+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd25c0b2d40 con 0x7fd25c15fca0 2023-07-06T01:09:09.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.191+0000 7fd2597fa700 1 -- 172.21.15.71:0/1091520222 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd254056c90 con 0x7fd25c15fca0 2023-07-06T01:09:09.194 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:09.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd24006ace0 msgr2=0x7fd24006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd24006ace0 0x7fd24006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd250007fd0 tx=0x7fd250007de0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 msgr2=0x7fd25c1f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 0x7fd25c1f5e70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd25400c7d0 tx=0x7fd25400cae0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 shutdown_connections 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd24006ace0 0x7fd24006d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd25c15fca0 0x7fd25c1f5e70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd25c0b5c90 0x7fd25c0c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 --2- 172.21.15.71:0/1091520222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd25c0b6110 0x7fd25c14ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 >> 172.21.15.71:0/1091520222 conn(0x7fd25c06c150 msgr2=0x7fd25c0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 shutdown_connections 2023-07-06T01:09:09.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.193+0000 7fd262dff700 1 -- 172.21.15.71:0/1091520222 wait complete. 2023-07-06T01:09:09.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:09.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.409+0000 7fe74b5ff700 1 Processor -- start 2023-07-06T01:09:09.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.410+0000 7fe74b5ff700 1 -- start start 2023-07-06T01:09:09.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe74b5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7440d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe74b5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7440b5c90 0x7fe7440d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe74b5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440cf780 con 0x7fe7440b6100 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe74b5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440cd490 con 0x7fe7440b5c90 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe74b5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440cd770 con 0x7fe74415fca0 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe748b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7440b5c90 0x7fe7440d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe749b9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe7440b6100 0x7fe7440cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34654/0 (socket says 172.21.15.71:34654) 2023-07-06T01:09:09.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe749b9c700 1 -- 172.21.15.71:0/2051943405 learned_addr learned my addr 172.21.15.71:0/2051943405 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:09.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe748b9a700 1 --2- 172.21.15.71:0/2051943405 >> v2:172.21.15.71:3300/0 conn(0x7fe7440b5c90 0x7fe7440d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43242/0 (socket says 172.21.15.71:43242) 2023-07-06T01:09:09.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.411+0000 7fe74939b700 1 --2- 172.21.15.71:0/2051943405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7440d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe748b9a700 1 -- 172.21.15.71:0/2051943405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 msgr2=0x7fe7440d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:09.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe748b9a700 1 --2- 172.21.15.71:0/2051943405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7440d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe748b9a700 1 -- 172.21.15.71:0/2051943405 >> v1:172.21.15.71:6789/0 conn(0x7fe7440b6100 legacy=0x7fe7440cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe748b9a700 1 -- 172.21.15.71:0/2051943405 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440cda50 con 0x7fe7440b5c90 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe73bfff700 1 -- 172.21.15.71:0/2051943405 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600156620 0 0) 0x7fe7440cf780 con 0x7fe7440b6100 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe748b9a700 1 --2- 172.21.15.71:0/2051943405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440d2d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe734009840 tx=0x7fe734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6a41c6025fb1fb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe73bfff700 1 -- 172.21.15.71:0/2051943405 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734011830 con 0x7fe7440b5c90 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe73bfff700 1 -- 172.21.15.71:0/2051943405 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe734011990 con 0x7fe7440b5c90 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.412+0000 7fe73bfff700 1 -- 172.21.15.71:0/2051943405 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734011d20 con 0x7fe7440b5c90 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2051943405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 msgr2=0x7fe7440d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2051943405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440d2d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe734009840 tx=0x7fe734009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:09.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2051943405 shutdown_connections 2023-07-06T01:09:09.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2051943405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7440d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2051943405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440d2d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2051943405 >> 172.21.15.71:0/2051943405 conn(0x7fe74406c150 msgr2=0x7fe74406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:09.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2051943405 shutdown_connections 2023-07-06T01:09:09.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.413+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2051943405 wait complete. 2023-07-06T01:09:09.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.415+0000 7fe74b5ff700 1 Processor -- start 2023-07-06T01:09:09.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.415+0000 7fe74b5ff700 1 -- start start 2023-07-06T01:09:09.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74b5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74b5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7440b6100 0x7fe744157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74b5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7441f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74b5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440ca450 con 0x7fe7440b5c90 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74b5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440cbf50 con 0x7fe7440b6100 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74b5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74415d180 con 0x7fe74415fca0 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43252/0 (socket says 172.21.15.71:43252) 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 -- 172.21.15.71:0/2897685622 learned_addr learned my addr 172.21.15.71:0/2897685622 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe748b9a700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7440b6100 0x7fe744157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe749b9c700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7441f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 -- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 msgr2=0x7fe7441f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7441f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 -- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7440b6100 msgr2=0x7fe744157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7440b6100 0x7fe744157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 -- 172.21.15.71:0/2897685622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7340094a0 con 0x7fe7440b5c90 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe749b9c700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7441f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.416+0000 7fe74939b700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440c9f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e8a0 tx=0x7fe74000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.417+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740009590 con 0x7fe7440b5c90 2023-07-06T01:09:09.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.417+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740013680 con 0x7fe7440b5c90 2023-07-06T01:09:09.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.417+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7440ca680 con 0x7fe7440b5c90 2023-07-06T01:09:09.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.417+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7400139f0 con 0x7fe7440b5c90 2023-07-06T01:09:09.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.417+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7440cac40 con 0x7fe7440b5c90 2023-07-06T01:09:09.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.418+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7440cc230 con 0x7fe7440b5c90 2023-07-06T01:09:09.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.419+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe740013b50 con 0x7fe7440b5c90 2023-07-06T01:09:09.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.420+0000 7fe739ffb700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe72806ace0 0x7fe72806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.420+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe740089430 con 0x7fe7440b5c90 2023-07-06T01:09:09.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.420+0000 7fe748b9a700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe72806ace0 0x7fe72806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.421+0000 7fe748b9a700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe72806ace0 0x7fe72806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe734000c00 tx=0x7fe734008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.424+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe740057ed0 con 0x7fe7440b5c90 2023-07-06T01:09:09.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.619+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7440cbd20 con 0x7fe7440b5c90 2023-07-06T01:09:09.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.619+0000 7fe739ffb700 1 -- 172.21.15.71:0/2897685622 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7440cbd20 con 0x7fe7440b5c90 2023-07-06T01:09:09.622 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:09.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe72806ace0 msgr2=0x7fe72806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe72806ace0 0x7fe72806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe734000c00 tx=0x7fe734008030 comp rx=0 tx=0).stop 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 msgr2=0x7fe7440c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440c9f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e8a0 tx=0x7fe74000ebb0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 shutdown_connections 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe72806ace0 0x7fe72806d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74415fca0 0x7fe7441f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7440b5c90 0x7fe7440c9f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 --2- 172.21.15.71:0/2897685622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7440b6100 0x7fe744157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 >> 172.21.15.71:0/2897685622 conn(0x7fe74406c150 msgr2=0x7fe7440d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:09.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 shutdown_connections 2023-07-06T01:09:09.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.622+0000 7fe74b5ff700 1 -- 172.21.15.71:0/2897685622 wait complete. 2023-07-06T01:09:09.642 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:09.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.835+0000 7f16d55ff700 1 Processor -- start 2023-07-06T01:09:09.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.836+0000 7f16d55ff700 1 -- start start 2023-07-06T01:09:09.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16d55ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16d015fca0 0x7f16d00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16d55ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16d55ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d00cf780 con 0x7f16d00b60e0 2023-07-06T01:09:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16d55ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d00cd490 con 0x7f16d015fca0 2023-07-06T01:09:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16d55ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00cd770 con 0x7f16d00b5c90 2023-07-06T01:09:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16cf7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f16d00b60e0 0x7f16d00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34670/0 (socket says 172.21.15.71:34670) 2023-07-06T01:09:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16cf7fe700 1 -- 172.21.15.71:0/174872705 learned_addr learned my addr 172.21.15.71:0/174872705 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:09.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16c7fff700 1 --2- 172.21.15.71:0/174872705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16ceffd700 1 --2- 172.21.15.71:0/174872705 >> v2:172.21.15.194:3300/0 conn(0x7f16d015fca0 0x7f16d00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16ce7fc700 1 -- 172.21.15.71:0/174872705 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263755498 0 0) 0x7f16d00cf780 con 0x7f16d00b60e0 2023-07-06T01:09:09.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.837+0000 7f16ce7fc700 1 -- 172.21.15.71:0/174872705 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc0035b0 con 0x7f16d00b60e0 2023-07-06T01:09:09.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16c7fff700 1 -- 172.21.15.71:0/174872705 >> v2:172.21.15.194:3300/0 conn(0x7f16d015fca0 msgr2=0x7f16d00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:09.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16c7fff700 1 --2- 172.21.15.71:0/174872705 >> v2:172.21.15.194:3300/0 conn(0x7f16d015fca0 0x7f16d00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16c7fff700 1 -- 172.21.15.71:0/174872705 >> v1:172.21.15.71:6789/0 conn(0x7f16d00b60e0 legacy=0x7f16d00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16c7fff700 1 -- 172.21.15.71:0/174872705 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d00cda50 con 0x7f16d00b5c90 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16c7fff700 1 --2- 172.21.15.71:0/174872705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00d2d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009840 tx=0x7f16b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537cdb3586451a33 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16ce7fc700 1 -- 172.21.15.71:0/174872705 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8011830 con 0x7f16d00b5c90 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16ce7fc700 1 -- 172.21.15.71:0/174872705 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8011990 con 0x7f16d00b5c90 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.838+0000 7f16ce7fc700 1 -- 172.21.15.71:0/174872705 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8011d20 con 0x7f16d00b5c90 2023-07-06T01:09:09.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 -- 172.21.15.71:0/174872705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 msgr2=0x7f16d00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 --2- 172.21.15.71:0/174872705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00d2d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009840 tx=0x7f16b8009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 -- 172.21.15.71:0/174872705 shutdown_connections 2023-07-06T01:09:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 --2- 172.21.15.71:0/174872705 >> v2:172.21.15.194:3300/0 conn(0x7f16d015fca0 0x7f16d00d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 --2- 172.21.15.71:0/174872705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00d2d40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 -- 172.21.15.71:0/174872705 >> 172.21.15.71:0/174872705 conn(0x7f16d006c150 msgr2=0x7f16d006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:09.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 -- 172.21.15.71:0/174872705 shutdown_connections 2023-07-06T01:09:09.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.839+0000 7f16d55ff700 1 -- 172.21.15.71:0/174872705 wait complete. 2023-07-06T01:09:09.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.841+0000 7f16d55ff700 1 Processor -- start 2023-07-06T01:09:09.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.841+0000 7f16d55ff700 1 -- start start 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16d55ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16d55ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16d00b60e0 0x7f16d014c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16d55ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 0x7f16d015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16d55ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d014c8b0 con 0x7f16d015fca0 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16d55ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d015cda0 con 0x7f16d00b60e0 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16d55ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d015d040 con 0x7f16d00b5c90 2023-07-06T01:09:09.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 0x7f16d015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 0x7f16d015c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43260/0 (socket says 172.21.15.71:43260) 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 -- 172.21.15.71:0/1775143028 learned_addr learned my addr 172.21.15.71:0/1775143028 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16ceffd700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16c7fff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16d00b60e0 0x7f16d014c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 -- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 msgr2=0x7f16d00a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 -- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16d00b60e0 msgr2=0x7f16d014c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16d00b60e0 0x7f16d014c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.842+0000 7f16cf7fe700 1 -- 172.21.15.71:0/1775143028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80094a0 con 0x7f16d015fca0 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.843+0000 7f16cf7fe700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 0x7f16d015c860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f16c800cbb0 tx=0x7f16c800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.843+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800a9e0 con 0x7f16d015fca0 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.843+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800ab40 con 0x7f16d015fca0 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.843+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d015d320 con 0x7f16d015fca0 2023-07-06T01:09:09.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.843+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8012400 con 0x7f16d015fca0 2023-07-06T01:09:09.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.843+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d015d8e0 con 0x7f16d015fca0 2023-07-06T01:09:09.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.844+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d00008d0 con 0x7f16d015fca0 2023-07-06T01:09:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.845+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16c801b3b0 con 0x7f16d015fca0 2023-07-06T01:09:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.846+0000 7f16c77fe700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f16b006ace0 0x7f16b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.846+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16c80891a0 con 0x7f16d015fca0 2023-07-06T01:09:09.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.846+0000 7f16ceffd700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f16b006ace0 0x7f16b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:09.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.847+0000 7f16ceffd700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f16b006ace0 0x7f16b006d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009b40 tx=0x7f16c0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:09.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:09.850+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16c8054270 con 0x7f16d015fca0 2023-07-06T01:09:10.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.084+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16d015e8b0 con 0x7f16d015fca0 2023-07-06T01:09:10.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.084+0000 7f16c77fe700 1 -- 172.21.15.71:0/1775143028 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f16c8057890 con 0x7f16d015fca0 2023-07-06T01:09:10.088 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:10.088 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f16b006ace0 msgr2=0x7f16b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f16b006ace0 0x7f16b006d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009b40 tx=0x7f16c0009210 comp rx=0 tx=0).stop 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 msgr2=0x7f16d015c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 0x7f16d015c860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f16c800cbb0 tx=0x7f16c800cec0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 shutdown_connections 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f16b006ace0 0x7f16b006d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f16d015fca0 0x7f16d015c860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16d00b5c90 0x7f16d00a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 --2- 172.21.15.71:0/1775143028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16d00b60e0 0x7f16d014c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 >> 172.21.15.71:0/1775143028 conn(0x7f16d006c150 msgr2=0x7f16d00cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 shutdown_connections 2023-07-06T01:09:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.087+0000 7f16d55ff700 1 -- 172.21.15.71:0/1775143028 wait complete. 2023-07-06T01:09:10.091 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:10.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:10.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.298+0000 7f654d7ff700 1 Processor -- start 2023-07-06T01:09:10.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.298+0000 7f654d7ff700 1 -- start start 2023-07-06T01:09:10.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.299+0000 7f654d7ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f654815fca0 0x7f65480d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.299+0000 7f654d7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 0x7f65480cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.299+0000 7f654d7ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65480cf780 con 0x7f65480b5c90 2023-07-06T01:09:10.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.299+0000 7f654d7ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65480cd490 con 0x7f654815fca0 2023-07-06T01:09:10.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.299+0000 7f654d7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480cd770 con 0x7f65480b6110 2023-07-06T01:09:10.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 0x7f65480cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 0x7f65480cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:42366/0 (socket says 172.21.15.71:42366) 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 -- 172.21.15.71:0/1125653343 learned_addr learned my addr 172.21.15.71:0/1125653343 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f6546ffd700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f654815fca0 0x7f65480d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 -- 172.21.15.71:0/1125653343 >> v2:172.21.15.194:3300/0 conn(0x7f654815fca0 msgr2=0x7f65480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 --2- 172.21.15.71:0/1125653343 >> v2:172.21.15.194:3300/0 conn(0x7f654815fca0 0x7f65480d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 -- 172.21.15.71:0/1125653343 >> v1:172.21.15.194:6789/0 conn(0x7f65480b5c90 legacy=0x7f65480d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f65477fe700 1 -- 172.21.15.71:0/1125653343 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480cda50 con 0x7f65480b6110 2023-07-06T01:09:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.300+0000 7f6545ffb700 1 -- 172.21.15.71:0/1125653343 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583694800 0 0) 0x7f65480cf780 con 0x7f65480b5c90 2023-07-06T01:09:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.301+0000 7f65477fe700 1 --2- 172.21.15.71:0/1125653343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 0x7f65480cfc10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6540009e50 tx=0x7f654000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8315023ba7de57 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.301+0000 7f6545ffb700 1 -- 172.21.15.71:0/1125653343 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000e070 con 0x7f65480b6110 2023-07-06T01:09:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.301+0000 7f6545ffb700 1 -- 172.21.15.71:0/1125653343 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654000b910 con 0x7f65480b6110 2023-07-06T01:09:10.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.301+0000 7f6545ffb700 1 -- 172.21.15.71:0/1125653343 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654000bcc0 con 0x7f65480b6110 2023-07-06T01:09:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.301+0000 7f654d7ff700 1 -- 172.21.15.71:0/1125653343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 msgr2=0x7f65480cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.301+0000 7f654d7ff700 1 --2- 172.21.15.71:0/1125653343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 0x7f65480cfc10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6540009e50 tx=0x7f654000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.302+0000 7f654d7ff700 1 -- 172.21.15.71:0/1125653343 shutdown_connections 2023-07-06T01:09:10.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.302+0000 7f654d7ff700 1 --2- 172.21.15.71:0/1125653343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b6110 0x7f65480cfc10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.302+0000 7f654d7ff700 1 --2- 172.21.15.71:0/1125653343 >> v2:172.21.15.194:3300/0 conn(0x7f654815fca0 0x7f65480d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.302+0000 7f654d7ff700 1 -- 172.21.15.71:0/1125653343 >> 172.21.15.71:0/1125653343 conn(0x7f654806c150 msgr2=0x7f654806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:10.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.302+0000 7f654d7ff700 1 -- 172.21.15.71:0/1125653343 shutdown_connections 2023-07-06T01:09:10.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.302+0000 7f654d7ff700 1 -- 172.21.15.71:0/1125653343 wait complete. 2023-07-06T01:09:10.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.303+0000 7f654d7ff700 1 Processor -- start 2023-07-06T01:09:10.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.304+0000 7f654d7ff700 1 -- start start 2023-07-06T01:09:10.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.304+0000 7f654d7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65481f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f654d7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65480b6110 0x7f65480b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f654d7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 0x7f65480cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f654d7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480b3610 con 0x7f654815fca0 2023-07-06T01:09:10.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f654d7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480b89d0 con 0x7f65480b6110 2023-07-06T01:09:10.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f654d7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480b38b0 con 0x7f65480b5c90 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 0x7f65480cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 0x7f65480cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43266/0 (socket says 172.21.15.71:43266) 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 -- 172.21.15.71:0/2875387717 learned_addr learned my addr 172.21.15.71:0/2875387717 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f6546ffd700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65481f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65467fc700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65480b6110 0x7f65480b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 -- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 msgr2=0x7f65481f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65481f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 -- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65480b6110 msgr2=0x7f65480b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65480b6110 0x7f65480b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 -- 172.21.15.71:0/2875387717 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540009b30 con 0x7f654815fca0 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.305+0000 7f65477fe700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 0x7f65480cbfb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f654000b680 tx=0x7f6540004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.306+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400048b0 con 0x7f654815fca0 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.306+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65400099b0 con 0x7f654815fca0 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.306+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654001c680 con 0x7f654815fca0 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.306+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480b3b90 con 0x7f654815fca0 2023-07-06T01:09:10.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.306+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65481f1be0 con 0x7f654815fca0 2023-07-06T01:09:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.307+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65480b4050 con 0x7f654815fca0 2023-07-06T01:09:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.308+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f654001c7e0 con 0x7f654815fca0 2023-07-06T01:09:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.309+0000 7f652f7fe700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.309+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f654008ad70 con 0x7f654815fca0 2023-07-06T01:09:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.309+0000 7f6546ffd700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.310+0000 7f6546ffd700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6538009b40 tx=0x7f6538009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:10.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.313+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6540055e10 con 0x7f654815fca0 2023-07-06T01:09:10.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.508+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65480008d0 con 0x7f654815fca0 2023-07-06T01:09:10.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.510+0000 7f652f7fe700 1 -- 172.21.15.71:0/2875387717 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f6540059430 con 0x7f654815fca0 2023-07-06T01:09:10.512 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:10.513 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 msgr2=0x7f653406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6538009b40 tx=0x7f6538009210 comp rx=0 tx=0).stop 2023-07-06T01:09:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 msgr2=0x7f65480cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 0x7f65480cbfb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f654000b680 tx=0x7f6540004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 shutdown_connections 2023-07-06T01:09:10.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f653406ace0 0x7f653406d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f654815fca0 0x7f65480cbfb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65480b5c90 0x7f65481f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 --2- 172.21.15.71:0/2875387717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65480b6110 0x7f65480b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 >> 172.21.15.71:0/2875387717 conn(0x7f654806c150 msgr2=0x7f65480b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:10.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 shutdown_connections 2023-07-06T01:09:10.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.512+0000 7f654d7ff700 1 -- 172.21.15.71:0/2875387717 wait complete. 2023-07-06T01:09:10.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:10.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:10.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.729+0000 7f9e69bff700 1 Processor -- start 2023-07-06T01:09:10.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.729+0000 7f9e69bff700 1 -- start start 2023-07-06T01:09:10.735 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e69bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e69bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e640b5c90 0x7f9e640d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e69bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e640b6100 0x7f9e640d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e69bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640cf780 con 0x7f9e640b6100 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e69bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640cd490 con 0x7f9e640b5c90 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e69bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640cd770 con 0x7f9e6415fca0 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e640b6100 0x7f9e640d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e640b6100 0x7f9e640d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43268/0 (socket says 172.21.15.71:43268) 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 -- 172.21.15.71:0/127595885 learned_addr learned my addr 172.21.15.71:0/127595885 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e637fe700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e5bfff700 1 --2- 172.21.15.71:0/127595885 >> v2:172.21.15.194:3300/0 conn(0x7f9e640b5c90 0x7f9e640d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 -- 172.21.15.71:0/127595885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 msgr2=0x7f9e640d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 -- 172.21.15.71:0/127595885 >> v2:172.21.15.194:3300/0 conn(0x7f9e640b5c90 msgr2=0x7f9e640d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:10.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 --2- 172.21.15.71:0/127595885 >> v2:172.21.15.194:3300/0 conn(0x7f9e640b5c90 0x7f9e640d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e63fff700 1 -- 172.21.15.71:0/127595885 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640cda50 con 0x7f9e640b6100 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e637fe700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.731+0000 7f9e5bfff700 1 --2- 172.21.15.71:0/127595885 >> v2:172.21.15.194:3300/0 conn(0x7f9e640b5c90 0x7f9e640d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e63fff700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b6100 0x7f9e640d3280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e6406cda0 tx=0x7f9e5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb70aa3d75d5b4a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e62ffd700 1 -- 172.21.15.71:0/127595885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00e070 con 0x7f9e640b6100 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e62ffd700 1 -- 172.21.15.71:0/127595885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c00b9c0 con 0x7f9e640b6100 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e62ffd700 1 -- 172.21.15.71:0/127595885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00bd70 con 0x7f9e640b6100 2023-07-06T01:09:10.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 -- 172.21.15.71:0/127595885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b6100 msgr2=0x7f9e640d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b6100 0x7f9e640d3280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e6406cda0 tx=0x7f9e5c00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 -- 172.21.15.71:0/127595885 shutdown_connections 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 --2- 172.21.15.71:0/127595885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b6100 0x7f9e640d3280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 --2- 172.21.15.71:0/127595885 >> v2:172.21.15.194:3300/0 conn(0x7f9e640b5c90 0x7f9e640d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 -- 172.21.15.71:0/127595885 >> 172.21.15.71:0/127595885 conn(0x7f9e6406c150 msgr2=0x7f9e6406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 -- 172.21.15.71:0/127595885 shutdown_connections 2023-07-06T01:09:10.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.732+0000 7f9e69bff700 1 -- 172.21.15.71:0/127595885 wait complete. 2023-07-06T01:09:10.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.734+0000 7f9e69bff700 1 Processor -- start 2023-07-06T01:09:10.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.734+0000 7f9e69bff700 1 -- start start 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e69bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 0x7f9e6414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e69bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e640b6100 0x7f9e640b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e69bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e69bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6415be50 con 0x7f9e640b5c90 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e69bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640b49c0 con 0x7f9e640b6100 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e69bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641e7e10 con 0x7f9e6415fca0 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e637fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 0x7f9e6414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e637fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 0x7f9e6414a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43272/0 (socket says 172.21.15.71:43272) 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.735+0000 7f9e637fe700 1 -- 172.21.15.71:0/2234628718 learned_addr learned my addr 172.21.15.71:0/2234628718 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e637fe700 1 -- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 msgr2=0x7f9e640b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e637fe700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e637fe700 1 -- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e640b6100 msgr2=0x7f9e640b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e637fe700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e640b6100 0x7f9e640b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e637fe700 1 -- 172.21.15.71:0/2234628718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c009b30 con 0x7f9e640b5c90 2023-07-06T01:09:10.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e637fe700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 0x7f9e6414a1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400e810 tx=0x7f9e5400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54004230 con 0x7f9e640b5c90 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54004390 con 0x7f9e640b5c90 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540036a0 con 0x7f9e640b5c90 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6414a700 con 0x7f9e640b5c90 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.736+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e640b4120 con 0x7f9e640b5c90 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.737+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e640008d0 con 0x7f9e640b5c90 2023-07-06T01:09:10.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.738+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e54003800 con 0x7f9e640b5c90 2023-07-06T01:09:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.739+0000 7f9e60ff9700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e4406ace0 0x7f9e4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.739+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e54088ff0 con 0x7f9e640b5c90 2023-07-06T01:09:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.740+0000 7f9e5bfff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e4406ace0 0x7f9e4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:10.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.740+0000 7f9e5bfff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e4406ace0 0x7f9e4406d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c006fd0 tx=0x7f9e4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:10.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.743+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9e54054040 con 0x7f9e640b5c90 2023-07-06T01:09:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.939+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e6415bf90 con 0x7f9e640b5c90 2023-07-06T01:09:10.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.939+0000 7f9e60ff9700 1 -- 172.21.15.71:0/2234628718 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e54057660 con 0x7f9e640b5c90 2023-07-06T01:09:10.943 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e4406ace0 msgr2=0x7f9e4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e4406ace0 0x7f9e4406d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c006fd0 tx=0x7f9e4c008040 comp rx=0 tx=0).stop 2023-07-06T01:09:10.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 msgr2=0x7f9e6414a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 0x7f9e6414a1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400e810 tx=0x7f9e5400ebd0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 shutdown_connections 2023-07-06T01:09:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e4406ace0 0x7f9e4406d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6415fca0 0x7f9e640b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e640b5c90 0x7f9e6414a1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 --2- 172.21.15.71:0/2234628718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e640b6100 0x7f9e640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 >> 172.21.15.71:0/2234628718 conn(0x7f9e6406c150 msgr2=0x7f9e640d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 shutdown_connections 2023-07-06T01:09:10.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:10.942+0000 7f9e69bff700 1 -- 172.21.15.71:0/2234628718 wait complete. 2023-07-06T01:09:10.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:11.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.156+0000 7fcee2dff700 1 Processor -- start 2023-07-06T01:09:11.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.156+0000 7fcee2dff700 1 -- start start 2023-07-06T01:09:11.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.157+0000 7fcee2dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcedc15fca0 0x7fcedc0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.157+0000 7fcee2dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcedc0b5c90 0x7fcedc0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.157+0000 7fcee2dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc0cf780 con 0x7fcedc0b6110 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.157+0000 7fcee2dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0cd490 con 0x7fcedc0b5c90 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.157+0000 7fcee2dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0cd770 con 0x7fcedc15fca0 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.157+0000 7fcedbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcedc0b5c90 0x7fcedc0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcedc0b5c90 0x7fcedc0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43278/0 (socket says 172.21.15.71:43278) 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 -- 172.21.15.71:0/339261629 learned_addr learned my addr 172.21.15.71:0/339261629 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:11.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcee0b9b700 1 --2- 172.21.15.71:0/339261629 >> v2:172.21.15.194:3300/0 conn(0x7fcedc15fca0 0x7fcedc0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 -- 172.21.15.71:0/339261629 >> v2:172.21.15.194:3300/0 conn(0x7fcedc15fca0 msgr2=0x7fcedc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 --2- 172.21.15.71:0/339261629 >> v2:172.21.15.194:3300/0 conn(0x7fcedc15fca0 0x7fcedc0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 -- 172.21.15.71:0/339261629 >> v1:172.21.15.194:6789/0 conn(0x7fcedc0b6110 legacy=0x7fcedc0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 -- 172.21.15.71:0/339261629 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0cda50 con 0x7fcedc0b5c90 2023-07-06T01:09:11.162 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedbfff700 1 --2- 172.21.15.71:0/339261629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0d2d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0d0930 tx=0x7fcec8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6809610adf61a97 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedb7fe700 1 -- 172.21.15.71:0/339261629 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011830 con 0x7fcedc0b5c90 2023-07-06T01:09:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedb7fe700 1 -- 172.21.15.71:0/339261629 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec8011990 con 0x7fcedc0b5c90 2023-07-06T01:09:11.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.158+0000 7fcedb7fe700 1 -- 172.21.15.71:0/339261629 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011d20 con 0x7fcedc0b5c90 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 -- 172.21.15.71:0/339261629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b5c90 msgr2=0x7fcedc0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 --2- 172.21.15.71:0/339261629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0d2d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0d0930 tx=0x7fcec8009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 -- 172.21.15.71:0/339261629 shutdown_connections 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 --2- 172.21.15.71:0/339261629 >> v2:172.21.15.194:3300/0 conn(0x7fcedc15fca0 0x7fcedc0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 --2- 172.21.15.71:0/339261629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0d2d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 -- 172.21.15.71:0/339261629 >> 172.21.15.71:0/339261629 conn(0x7fcedc06c150 msgr2=0x7fcedc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:11.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 -- 172.21.15.71:0/339261629 shutdown_connections 2023-07-06T01:09:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.159+0000 7fcee2dff700 1 -- 172.21.15.71:0/339261629 wait complete. 2023-07-06T01:09:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.161+0000 7fcee2dff700 1 Processor -- start 2023-07-06T01:09:11.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.161+0000 7fcee2dff700 1 -- start start 2023-07-06T01:09:11.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee2dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee2dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 0x7fcedc0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee2dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc15fca0 0x7fcedc14cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee2dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0cb020 con 0x7fcedc0b6110 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee2dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0cb9f0 con 0x7fcedc0b5c90 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee2dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0ca410 con 0x7fcedc15fca0 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcedbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 0x7fcedc0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcedbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 0x7fcedc0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43292/0 (socket says 172.21.15.71:43292) 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcedbfff700 1 -- 172.21.15.71:0/4199028245 learned_addr learned my addr 172.21.15.71:0/4199028245 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee0b9b700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.162+0000 7fcee139c700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc15fca0 0x7fcedc14cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcedbfff700 1 -- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc15fca0 msgr2=0x7fcedc14cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcedbfff700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc15fca0 0x7fcedc14cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcedbfff700 1 -- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc0b5c90 msgr2=0x7fcedc0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcedbfff700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcedbfff700 1 -- 172.21.15.71:0/4199028245 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8009550 con 0x7fcedc0b6110 2023-07-06T01:09:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcedbfff700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 0x7fcedc0cc590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcec8000c00 tx=0x7fcec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8004380 con 0x7fcedc0b6110 2023-07-06T01:09:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec801f070 con 0x7fcedc0b6110 2023-07-06T01:09:11.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcee2dff700 1 -- 172.21.15.71:0/4199028245 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0ca6f0 con 0x7fcedc0b6110 2023-07-06T01:09:11.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80036a0 con 0x7fcedc0b6110 2023-07-06T01:09:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.163+0000 7fcee2dff700 1 -- 172.21.15.71:0/4199028245 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc0cacb0 con 0x7fcedc0b6110 2023-07-06T01:09:11.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.164+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb40052f0 con 0x7fcedc0b6110 2023-07-06T01:09:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.165+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcec8021030 con 0x7fcedc0b6110 2023-07-06T01:09:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.167+0000 7fced97fa700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcec006ad10 0x7fcec006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.167+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcec808a860 con 0x7fcedc0b6110 2023-07-06T01:09:11.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.167+0000 7fcee0b9b700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcec006ad10 0x7fcec006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.168+0000 7fcee0b9b700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcec006ad10 0x7fcec006d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fced0009b40 tx=0x7fced0009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:11.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.171+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcec8055880 con 0x7fcedc0b6110 2023-07-06T01:09:11.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.364+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fceb4005b20 con 0x7fcedc0b6110 2023-07-06T01:09:11.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.365+0000 7fced97fa700 1 -- 172.21.15.71:0/4199028245 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcec8058ea0 con 0x7fcedc0b6110 2023-07-06T01:09:11.368 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcec006ad10 msgr2=0x7fcec006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcec006ad10 0x7fcec006d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fced0009b40 tx=0x7fced0009210 comp rx=0 tx=0).stop 2023-07-06T01:09:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 msgr2=0x7fcedc0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 0x7fcedc0cc590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcec8000c00 tx=0x7fcec8004750 comp rx=0 tx=0).stop 2023-07-06T01:09:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 shutdown_connections 2023-07-06T01:09:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcec006ad10 0x7fcec006d1c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc15fca0 0x7fcedc14cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc0b5c90 0x7fcedc0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 --2- 172.21.15.71:0/4199028245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcedc0b6110 0x7fcedc0cc590 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.367+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 >> 172.21.15.71:0/4199028245 conn(0x7fcedc06c150 msgr2=0x7fcedc0cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.368+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 shutdown_connections 2023-07-06T01:09:11.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.368+0000 7fcec6ffd700 1 -- 172.21.15.71:0/4199028245 wait complete. 2023-07-06T01:09:11.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:11.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.581+0000 7fa1f7dff700 1 Processor -- start 2023-07-06T01:09:11.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.581+0000 7fa1f7dff700 1 -- start start 2023-07-06T01:09:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.582+0000 7fa1f7dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 0x7fa1f00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.582+0000 7fa1f7dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00cf780 con 0x7fa1f00b5c90 2023-07-06T01:09:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.582+0000 7fa1f7dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00cd490 con 0x7fa1f00b6100 2023-07-06T01:09:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.582+0000 7fa1f7dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00cd770 con 0x7fa1f015fca0 2023-07-06T01:09:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.582+0000 7fa1f539a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa1f00b5c90 0x7fa1f00d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34682/0 (socket says 172.21.15.71:34682) 2023-07-06T01:09:11.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.582+0000 7fa1f539a700 1 -- 172.21.15.71:0/1063157416 learned_addr learned my addr 172.21.15.71:0/1063157416 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333257559 0 0) 0x7fa1f00cf780 con 0x7fa1f00b5c90 2023-07-06T01:09:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1dc0035b0 con 0x7fa1f00b5c90 2023-07-06T01:09:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f5b9b700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 0x7fa1f00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389211530 0 0) 0x7fa1dc0035b0 con 0x7fa1f00b5c90 2023-07-06T01:09:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 msgr2=0x7fa1f00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:11.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 0x7fa1f00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 >> v1:172.21.15.194:6789/0 conn(0x7fa1f00b6100 legacy=0x7fa1f00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00cda50 con 0x7fa1f00b5c90 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fa1e0001670 con 0x7fa1f00b5c90 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 >> v1:172.21.15.71:6789/0 conn(0x7fa1f00b5c90 legacy=0x7fa1f00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 0x7fa1dc003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1dc003fb0 0x7fa1dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc004d90 0x7fa1dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00cd770 con 0x7fa1dc003fb0 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00baf0 con 0x7fa1dc004d90 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00bcb0 con 0x7fa1f015fca0 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.583+0000 7fa1f539a700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1dc003fb0 0x7fa1dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f5b9b700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 0x7fa1dc003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f639c700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc004d90 0x7fa1dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f539a700 1 -- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 msgr2=0x7fa1dc003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f539a700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1f015fca0 0x7fa1dc003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f539a700 1 -- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc004d90 msgr2=0x7fa1dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f539a700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc004d90 0x7fa1dc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f539a700 1 -- 172.21.15.71:0/1063157416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0035b0 con 0x7fa1dc003fb0 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f539a700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1dc003fb0 0x7fa1dc004850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c210 tx=0x7fa1dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936bf8085d246eb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0007c10 con 0x7fa1dc003fb0 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e000cdd0 con 0x7fa1dc003fb0 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.584+0000 7fa1f4b99700 1 -- 172.21.15.71:0/1063157416 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0005ba0 con 0x7fa1dc003fb0 2023-07-06T01:09:11.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f7dff700 1 -- 172.21.15.71:0/1063157416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1dc003fb0 msgr2=0x7fa1dc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/1063157416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1dc003fb0 0x7fa1dc004850 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c210 tx=0x7fa1dc005880 comp rx=0 tx=0).stop 2023-07-06T01:09:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f639c700 1 -- 172.21.15.71:0/1063157416 reap_dead start 2023-07-06T01:09:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f7dff700 1 -- 172.21.15.71:0/1063157416 shutdown_connections 2023-07-06T01:09:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f7dff700 1 -- 172.21.15.71:0/1063157416 >> 172.21.15.71:0/1063157416 conn(0x7fa1f006c150 msgr2=0x7fa1f006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f7dff700 1 -- 172.21.15.71:0/1063157416 shutdown_connections 2023-07-06T01:09:11.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.585+0000 7fa1f7dff700 1 -- 172.21.15.71:0/1063157416 wait complete. 2023-07-06T01:09:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.587+0000 7fa1f7dff700 1 Processor -- start 2023-07-06T01:09:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.588+0000 7fa1f7dff700 1 -- start start 2023-07-06T01:09:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f7dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc003fb0 0x7fa1f00cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f7dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 0x7fa1f00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f7dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1f00cbeb0 0x7fa1f01586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f7dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00cbae0 con 0x7fa1f00cc990 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f7dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00cb110 con 0x7fa1f00cbeb0 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f7dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00cc320 con 0x7fa1dc003fb0 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 0x7fa1f00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 0x7fa1f00c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43308/0 (socket says 172.21.15.71:43308) 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 -- 172.21.15.71:0/3422880659 learned_addr learned my addr 172.21.15.71:0/3422880659 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:11.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f5b9b700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc003fb0 0x7fa1f00cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f639c700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1f00cbeb0 0x7fa1f01586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 -- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc003fb0 msgr2=0x7fa1f00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc003fb0 0x7fa1f00cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 -- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1f00cbeb0 msgr2=0x7fa1f01586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1f00cbeb0 0x7fa1f01586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f539a700 1 -- 172.21.15.71:0/3422880659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00caac0 con 0x7fa1f00cc990 2023-07-06T01:09:11.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.589+0000 7fa1f639c700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1f00cbeb0 0x7fa1f01586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.590+0000 7fa1f539a700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 0x7fa1f00c83a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00bac0 tx=0x7fa1e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.590+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0001630 con 0x7fa1f00cc990 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.590+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e00070d0 con 0x7fa1f00cc990 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.590+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0007480 con 0x7fa1f00cc990 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.590+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00cada0 con 0x7fa1f00cc990 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.590+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f00c8ac0 con 0x7fa1f00cc990 2023-07-06T01:09:11.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.591+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f00cb2c0 con 0x7fa1f00cc990 2023-07-06T01:09:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.592+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1e0019030 con 0x7fa1f00cc990 2023-07-06T01:09:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.593+0000 7fa1e67fc700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:11.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.593+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1e008a190 con 0x7fa1f00cc990 2023-07-06T01:09:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.593+0000 7fa1f5b9b700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.594+0000 7fa1f5b9b700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa1d406ace0 0x7fa1d406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009ba0 tx=0x7fa1ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:11.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.597+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa1f00cb2c0 con 0x7fa1f00cc990 2023-07-06T01:09:11.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.794+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1f00c8ac0 con 0x7fa1f00cc990 2023-07-06T01:09:11.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.794+0000 7fa1e67fc700 1 -- 172.21.15.71:0/3422880659 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1f00c8ac0 con 0x7fa1f00cc990 2023-07-06T01:09:11.797 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:11.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa1d406ace0 msgr2=0x7fa1d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa1d406ace0 0x7fa1d406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009ba0 tx=0x7fa1ec008040 comp rx=0 tx=0).stop 2023-07-06T01:09:11.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 msgr2=0x7fa1f00c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 0x7fa1f00c83a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00bac0 tx=0x7fa1e0001a00 comp rx=0 tx=0).stop 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 shutdown_connections 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa1d406ace0 0x7fa1d406d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1f00cbeb0 0x7fa1f01586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc003fb0 0x7fa1f00cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 --2- 172.21.15.71:0/3422880659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f00cc990 0x7fa1f00c83a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.796+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 >> 172.21.15.71:0/3422880659 conn(0x7fa1f006c150 msgr2=0x7fa1f00b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:11.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.797+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 shutdown_connections 2023-07-06T01:09:11.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:11.797+0000 7fa1f7dff700 1 -- 172.21.15.71:0/3422880659 wait complete. 2023-07-06T01:09:11.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:12.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.011+0000 7fbc2b5ff700 1 Processor -- start 2023-07-06T01:09:12.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.011+0000 7fbc2b5ff700 1 -- start start 2023-07-06T01:09:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.012+0000 7fbc2b5ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbc240b5c90 0x7fbc240d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.012+0000 7fbc2b5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc240b6110 0x7fbc240d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.012+0000 7fbc2b5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240cf780 con 0x7fbc2415fca0 2023-07-06T01:09:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.012+0000 7fbc2b5ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc240cd490 con 0x7fbc240b5c90 2023-07-06T01:09:12.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.012+0000 7fbc2b5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240cd770 con 0x7fbc240b6110 2023-07-06T01:09:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc2939b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbc2415fca0 0x7fbc240d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34684/0 (socket says 172.21.15.71:34684) 2023-07-06T01:09:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc2939b700 1 -- 172.21.15.71:0/1567979111 learned_addr learned my addr 172.21.15.71:0/1567979111 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc28b9a700 1 --2- 172.21.15.71:0/1567979111 >> v2:172.21.15.194:3300/0 conn(0x7fbc240b5c90 0x7fbc240d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc29b9c700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc240b6110 0x7fbc240d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc1bfff700 1 -- 172.21.15.71:0/1567979111 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832091639 0 0) 0x7fbc240cf780 con 0x7fbc2415fca0 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc1bfff700 1 -- 172.21.15.71:0/1567979111 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc100035b0 con 0x7fbc2415fca0 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc28b9a700 1 -- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc240b6110 msgr2=0x7fbc240d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc28b9a700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc240b6110 0x7fbc240d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc28b9a700 1 -- 172.21.15.71:0/1567979111 >> v1:172.21.15.71:6789/0 conn(0x7fbc2415fca0 legacy=0x7fbc240d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc28b9a700 1 -- 172.21.15.71:0/1567979111 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240cda50 con 0x7fbc240b5c90 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.013+0000 7fbc29b9c700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc240b6110 0x7fbc240d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc28b9a700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 0x7fbc240d2d40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009840 tx=0x7fbc14009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808a949b921cd6d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc1bfff700 1 -- 172.21.15.71:0/1567979111 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14011830 con 0x7fbc240b5c90 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc1bfff700 1 -- 172.21.15.71:0/1567979111 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14011990 con 0x7fbc240b5c90 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc1bfff700 1 -- 172.21.15.71:0/1567979111 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14011d00 con 0x7fbc240b5c90 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 msgr2=0x7fbc240d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 0x7fbc240d2d40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009840 tx=0x7fbc14009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/1567979111 shutdown_connections 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc240b6110 0x7fbc240d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/1567979111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 0x7fbc240d2d40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/1567979111 >> 172.21.15.71:0/1567979111 conn(0x7fbc2406c150 msgr2=0x7fbc2406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.014+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/1567979111 shutdown_connections 2023-07-06T01:09:12.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.015+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/1567979111 wait complete. 2023-07-06T01:09:12.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.016+0000 7fbc2b5ff700 1 Processor -- start 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.016+0000 7fbc2b5ff700 1 -- start start 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc2b5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 0x7fbc2415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc2b5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 0x7fbc240cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc2b5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc2415fca0 0x7fbc240cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc2b5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240c84e0 con 0x7fbc240b6110 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc2b5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240cb730 con 0x7fbc240b5c90 2023-07-06T01:09:12.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc2b5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240cab20 con 0x7fbc2415fca0 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc28b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 0x7fbc240cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc28b9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 0x7fbc240cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43310/0 (socket says 172.21.15.71:43310) 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.017+0000 7fbc28b9a700 1 -- 172.21.15.71:0/2207950207 learned_addr learned my addr 172.21.15.71:0/2207950207 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc28b9a700 1 -- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc2415fca0 msgr2=0x7fbc240cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc28b9a700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc2415fca0 0x7fbc240cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc28b9a700 1 -- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 msgr2=0x7fbc2415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc28b9a700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 0x7fbc2415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc28b9a700 1 -- 172.21.15.71:0/2207950207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c009a70 con 0x7fbc240b6110 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc28b9a700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 0x7fbc240cc2b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc140090b0 tx=0x7fbc14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14004550 con 0x7fbc240b6110 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1401f070 con 0x7fbc240b6110 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140038a0 con 0x7fbc240b6110 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc140094a0 con 0x7fbc240b6110 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.018+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240cb0e0 con 0x7fbc240b6110 2023-07-06T01:09:12.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.019+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc240cb8e0 con 0x7fbc240b6110 2023-07-06T01:09:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.020+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc14003a00 con 0x7fbc240b6110 2023-07-06T01:09:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.021+0000 7fbc19ffb700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbc0806ace0 0x7fbc0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.021+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc14021070 con 0x7fbc240b6110 2023-07-06T01:09:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.022+0000 7fbc2939b700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbc0806ace0 0x7fbc0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.022+0000 7fbc2939b700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbc0806ace0 0x7fbc0806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc20007fd0 tx=0x7fbc20007980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.025+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc240cb8e0 con 0x7fbc240b6110 2023-07-06T01:09:12.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.217+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc240cb8a0 con 0x7fbc240b6110 2023-07-06T01:09:12.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.217+0000 7fbc19ffb700 1 -- 172.21.15.71:0/2207950207 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc140150a0 con 0x7fbc240b6110 2023-07-06T01:09:12.220 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:12.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbc0806ace0 msgr2=0x7fbc0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbc0806ace0 0x7fbc0806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc20007fd0 tx=0x7fbc20007980 comp rx=0 tx=0).stop 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 msgr2=0x7fbc240cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 0x7fbc240cc2b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc140090b0 tx=0x7fbc14004750 comp rx=0 tx=0).stop 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 shutdown_connections 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbc0806ace0 0x7fbc0806d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc2415fca0 0x7fbc240cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc240b5c90 0x7fbc2415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 --2- 172.21.15.71:0/2207950207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc240b6110 0x7fbc240cc2b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 >> 172.21.15.71:0/2207950207 conn(0x7fbc2406c150 msgr2=0x7fbc240d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:12.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 shutdown_connections 2023-07-06T01:09:12.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.220+0000 7fbc2b5ff700 1 -- 172.21.15.71:0/2207950207 wait complete. 2023-07-06T01:09:12.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:12.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.432+0000 7f6fc67ff700 1 Processor -- start 2023-07-06T01:09:12.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.432+0000 7f6fc67ff700 1 -- start start 2023-07-06T01:09:12.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fc67ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 0x7f6fc00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fc67ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6fc00b6100 0x7f6fc00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fc67ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc00cf780 con 0x7f6fc00b5c90 2023-07-06T01:09:12.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fc67ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00cd490 con 0x7f6fc00b6100 2023-07-06T01:09:12.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fc67ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00cd770 con 0x7f6fc015fca0 2023-07-06T01:09:12.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fbf7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6fc00b5c90 0x7f6fc00d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:34696/0 (socket says 172.21.15.71:34696) 2023-07-06T01:09:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fbf7fe700 1 -- 172.21.15.71:0/3074648500 learned_addr learned my addr 172.21.15.71:0/3074648500 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fbffff700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 0x7f6fc00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.434+0000 7f6fc4d9c700 1 --2- 172.21.15.71:0/3074648500 >> v2:172.21.15.194:3300/0 conn(0x7f6fc00b6100 0x7f6fc00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399348940 0 0) 0x7f6fc00cf780 con 0x7f6fc00b5c90 2023-07-06T01:09:12.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa80035b0 con 0x7f6fc00b5c90 2023-07-06T01:09:12.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571864622 0 0) 0x7f6fa80035b0 con 0x7f6fc00b5c90 2023-07-06T01:09:12.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 msgr2=0x7f6fc00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 0x7f6fc00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 >> v2:172.21.15.194:3300/0 conn(0x7f6fc00b6100 msgr2=0x7f6fc00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 --2- 172.21.15.71:0/3074648500 >> v2:172.21.15.194:3300/0 conn(0x7f6fc00b6100 0x7f6fc00cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00cda50 con 0x7f6fc00b5c90 2023-07-06T01:09:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f6fb4001670 con 0x7f6fc00b5c90 2023-07-06T01:09:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 >> v1:172.21.15.71:6789/0 conn(0x7f6fc00b5c90 legacy=0x7f6fc00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa8003a00 0x7f6fa8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fa80048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 0x7f6fa8004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00cd490 con 0x7f6fa8004430 2023-07-06T01:09:12.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00cd770 con 0x7f6fa8003a00 2023-07-06T01:09:12.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa800ba10 con 0x7f6fc015fca0 2023-07-06T01:09:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbf7fe700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fa80048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fbffff700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa8003a00 0x7f6fa8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.435+0000 7f6fc4d9c700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 0x7f6fa8004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbf7fe700 1 -- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 msgr2=0x7f6fa8004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbf7fe700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015fca0 0x7f6fa8004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbf7fe700 1 -- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa8003a00 msgr2=0x7f6fa8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbf7fe700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa8003a00 0x7f6fa8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbf7fe700 1 -- 172.21.15.71:0/3074648500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80035b0 con 0x7f6fa8004430 2023-07-06T01:09:12.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbf7fe700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fa80048f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c370 tx=0x7f6fa8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663d9b1a942f1647 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4007c60 con 0x7f6fa8004430 2023-07-06T01:09:12.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb4005960 con 0x7f6fa8004430 2023-07-06T01:09:12.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.436+0000 7f6fbeffd700 1 -- 172.21.15.71:0/3074648500 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4005d10 con 0x7f6fa8004430 2023-07-06T01:09:12.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc67ff700 1 -- 172.21.15.71:0/3074648500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 msgr2=0x7f6fa80048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/3074648500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fa80048f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c370 tx=0x7f6fa8005880 comp rx=0 tx=0).stop 2023-07-06T01:09:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc4d9c700 1 -- 172.21.15.71:0/3074648500 reap_dead start 2023-07-06T01:09:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc67ff700 1 -- 172.21.15.71:0/3074648500 shutdown_connections 2023-07-06T01:09:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc67ff700 1 -- 172.21.15.71:0/3074648500 >> 172.21.15.71:0/3074648500 conn(0x7f6fc006c150 msgr2=0x7f6fc006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:12.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc67ff700 1 -- 172.21.15.71:0/3074648500 shutdown_connections 2023-07-06T01:09:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.437+0000 7f6fc67ff700 1 -- 172.21.15.71:0/3074648500 wait complete. 2023-07-06T01:09:12.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.439+0000 7f6fc67ff700 1 Processor -- start 2023-07-06T01:09:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.439+0000 7f6fc67ff700 1 -- start start 2023-07-06T01:09:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fc67ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fc00c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fc67ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc015b7a0 0x7f6fc015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fc67ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015d870 0x7f6fc015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fc67ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc015e250 con 0x7f6fa8004430 2023-07-06T01:09:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fc67ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00c7190 con 0x7f6fc015b7a0 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fc67ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00c7470 con 0x7f6fc015d870 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fc00c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fc00c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43330/0 (socket says 172.21.15.71:43330) 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 -- 172.21.15.71:0/2554943691 learned_addr learned my addr 172.21.15.71:0/2554943691 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 -- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015d870 msgr2=0x7f6fc015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015d870 0x7f6fc015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 -- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc015b7a0 msgr2=0x7f6fc015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc015b7a0 0x7f6fc015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.440+0000 7f6fbffff700 1 -- 172.21.15.71:0/2554943691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00c7750 con 0x7f6fa8004430 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.441+0000 7f6fbffff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fc00c6bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00119a0 tx=0x7f6fb0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.441+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000f8c0 con 0x7f6fa8004430 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.441+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000fa20 con 0x7f6fa8004430 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.441+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc00c7a30 con 0x7f6fa8004430 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.441+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000fdb0 con 0x7f6fa8004430 2023-07-06T01:09:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.441+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc015e600 con 0x7f6fa8004430 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.442+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc00008d0 con 0x7f6fa8004430 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.443+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fb0014440 con 0x7f6fa8004430 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.444+0000 7f6fbcff9700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6fac06ace0 0x7f6fac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.444+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fb0089a90 con 0x7f6fa8004430 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.444+0000 7f6fbf7fe700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6fac06ace0 0x7f6fac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.445+0000 7f6fbf7fe700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6fac06ace0 0x7f6fac06d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00c8740 tx=0x7f6fb400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.448+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6fb0054b40 con 0x7f6fa8004430 2023-07-06T01:09:12.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.691+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fc00d0170 con 0x7f6fa8004430 2023-07-06T01:09:12.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.692+0000 7f6fbcff9700 1 -- 172.21.15.71:0/2554943691 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f6fb0058160 con 0x7f6fa8004430 2023-07-06T01:09:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:12.695 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6fac06ace0 msgr2=0x7f6fac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6fac06ace0 0x7f6fac06d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6fc00c8740 tx=0x7f6fb400f000 comp rx=0 tx=0).stop 2023-07-06T01:09:12.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 msgr2=0x7f6fc00c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fc00c6bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00119a0 tx=0x7f6fb0011d60 comp rx=0 tx=0).stop 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 shutdown_connections 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6fac06ace0 0x7f6fac06d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6fc015d870 0x7f6fc015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa8004430 0x7f6fc00c6bb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 --2- 172.21.15.71:0/2554943691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fc015b7a0 0x7f6fc015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 >> 172.21.15.71:0/2554943691 conn(0x7f6fc006c150 msgr2=0x7f6fc00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 shutdown_connections 2023-07-06T01:09:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.694+0000 7f6fc67ff700 1 -- 172.21.15.71:0/2554943691 wait complete. 2023-07-06T01:09:12.699 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:12.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:12.789 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:09:12.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:09:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.919+0000 7fa1339ff700 1 Processor -- start 2023-07-06T01:09:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.920+0000 7fa1339ff700 1 -- start start 2023-07-06T01:09:12.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa1339ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c15fca0 0x7fa12c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa1339ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa12c0b5c90 0x7fa12c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa1339ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa12c0b6100 0x7fa12c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa1339ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c0cf780 con 0x7fa12c0b5c90 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa1339ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c0cd490 con 0x7fa12c0b6100 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa1339ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0cd770 con 0x7fa12c15fca0 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa12c0b5c90 0x7fa12c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa12c0b5c90 0x7fa12c0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43334/0 (socket says 172.21.15.71:43334) 2023-07-06T01:09:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 -- 172.21.15.71:0/3749984976 learned_addr learned my addr 172.21.15.71:0/3749984976 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa131f9c700 1 --2- 172.21.15.71:0/3749984976 >> v2:172.21.15.194:3300/0 conn(0x7fa12c0b6100 0x7fa12c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa13179b700 1 --2- 172.21.15.71:0/3749984976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c15fca0 0x7fa12c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 -- 172.21.15.71:0/3749984976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c15fca0 msgr2=0x7fa12c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 --2- 172.21.15.71:0/3749984976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c15fca0 0x7fa12c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 -- 172.21.15.71:0/3749984976 >> v2:172.21.15.194:3300/0 conn(0x7fa12c0b6100 msgr2=0x7fa12c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 --2- 172.21.15.71:0/3749984976 >> v2:172.21.15.194:3300/0 conn(0x7fa12c0b6100 0x7fa12c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.921+0000 7fa130f9a700 1 -- 172.21.15.71:0/3749984976 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0cda50 con 0x7fa12c0b5c90 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.922+0000 7fa130f9a700 1 --2- 172.21.15.71:0/3749984976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c0d2d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0b8f80 tx=0x7fa11c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629d47777d0a7c71 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.922+0000 7fa123fff700 1 -- 172.21.15.71:0/3749984976 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c011830 con 0x7fa12c0b5c90 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.922+0000 7fa123fff700 1 -- 172.21.15.71:0/3749984976 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c011990 con 0x7fa12c0b5c90 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.922+0000 7fa123fff700 1 -- 172.21.15.71:0/3749984976 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c011d20 con 0x7fa12c0b5c90 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.922+0000 7fa1339ff700 1 -- 172.21.15.71:0/3749984976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 msgr2=0x7fa12c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.922+0000 7fa1339ff700 1 --2- 172.21.15.71:0/3749984976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c0d2d40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0b8f80 tx=0x7fa11c009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 -- 172.21.15.71:0/3749984976 shutdown_connections 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 --2- 172.21.15.71:0/3749984976 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c15fca0 0x7fa12c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 --2- 172.21.15.71:0/3749984976 >> v2:172.21.15.194:3300/0 conn(0x7fa12c0b6100 0x7fa12c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 --2- 172.21.15.71:0/3749984976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c0d2d40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 -- 172.21.15.71:0/3749984976 >> 172.21.15.71:0/3749984976 conn(0x7fa12c06c150 msgr2=0x7fa12c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 -- 172.21.15.71:0/3749984976 shutdown_connections 2023-07-06T01:09:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.923+0000 7fa1339ff700 1 -- 172.21.15.71:0/3749984976 wait complete. 2023-07-06T01:09:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.924+0000 7fa1339ff700 1 Processor -- start 2023-07-06T01:09:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 -- start start 2023-07-06T01:09:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c0b6100 0x7fa12c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c15fca0 0x7fa12c0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c15f570 con 0x7fa12c0b5c90 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c157c00 con 0x7fa12c15fca0 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.925+0000 7fa1339ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c157ee0 con 0x7fa12c0b6100 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43344/0 (socket says 172.21.15.71:43344) 2023-07-06T01:09:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 -- 172.21.15.71:0/4187056422 learned_addr learned my addr 172.21.15.71:0/4187056422 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa130f9a700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c0b6100 0x7fa12c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa131f9c700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c15fca0 0x7fa12c0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 -- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c0b6100 msgr2=0x7fa12c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c0b6100 0x7fa12c15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 -- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c15fca0 msgr2=0x7fa12c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c15fca0 0x7fa12c0c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 -- 172.21.15.71:0/4187056422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c009550 con 0x7fa12c0b5c90 2023-07-06T01:09:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.926+0000 7fa13179b700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c149a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa12800e870 tx=0x7fa12800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.927+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128009590 con 0x7fa12c0b5c90 2023-07-06T01:09:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.927+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128013680 con 0x7fa12c0b5c90 2023-07-06T01:09:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.927+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c1581c0 con 0x7fa12c0b5c90 2023-07-06T01:09:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.927+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280139f0 con 0x7fa12c0b5c90 2023-07-06T01:09:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.927+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c0c96b0 con 0x7fa12c0b5c90 2023-07-06T01:09:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.928+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c158810 con 0x7fa12c0b5c90 2023-07-06T01:09:12.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.929+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa128013b50 con 0x7fa12c0b5c90 2023-07-06T01:09:12.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.929+0000 7fa121ffb700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa11006ace0 0x7fa11006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:12.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.930+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1280893e0 con 0x7fa12c0b5c90 2023-07-06T01:09:12.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.930+0000 7fa130f9a700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa11006ace0 0x7fa11006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.931+0000 7fa130f9a700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa11006ace0 0x7fa11006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009c10 tx=0x7fa11c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:12.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:12.934+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa128057e80 con 0x7fa12c0b5c90 2023-07-06T01:09:13.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.131+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa12c157d40 con 0x7fa12c0b5c90 2023-07-06T01:09:13.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.132+0000 7fa121ffb700 1 -- 172.21.15.71:0/4187056422 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fa12c157d40 con 0x7fa12c0b5c90 2023-07-06T01:09:13.135 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:13.135 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.134+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa11006ace0 msgr2=0x7fa11006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.134+0000 7fa1339ff700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa11006ace0 0x7fa11006d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009c10 tx=0x7fa11c008030 comp rx=0 tx=0).stop 2023-07-06T01:09:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.134+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 msgr2=0x7fa12c149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.134+0000 7fa1339ff700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c149a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa12800e870 tx=0x7fa12800eb80 comp rx=0 tx=0).stop 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.134+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 shutdown_connections 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.134+0000 7fa1339ff700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa11006ace0 0x7fa11006d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.135+0000 7fa1339ff700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c15fca0 0x7fa12c0c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.135+0000 7fa1339ff700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa12c0b5c90 0x7fa12c149a60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.135+0000 7fa1339ff700 1 --2- 172.21.15.71:0/4187056422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa12c0b6100 0x7fa12c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.135+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 >> 172.21.15.71:0/4187056422 conn(0x7fa12c06c150 msgr2=0x7fa12c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:13.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.135+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 shutdown_connections 2023-07-06T01:09:13.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.135+0000 7fa1339ff700 1 -- 172.21.15.71:0/4187056422 wait complete. 2023-07-06T01:09:13.155 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:13.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.385+0000 7f8f2bdff700 1 Processor -- start 2023-07-06T01:09:13.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.385+0000 7f8f2bdff700 1 -- start start 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f2bdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8f2415fca0 0x7f8f240d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f2bdff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f240cf780 con 0x7f8f240b6110 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f2bdff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f240cd490 con 0x7f8f240b5c90 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f2bdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f240cd770 con 0x7f8f2415fca0 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f29b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8f2415fca0 0x7f8f240d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f29b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8f2415fca0 0x7f8f240d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32980/0 (socket says 172.21.15.71:32980) 2023-07-06T01:09:13.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f2a39c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8f240b6110 0x7f8f240cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:32878/0 (socket says 172.21.15.71:32878) 2023-07-06T01:09:13.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.386+0000 7f8f29b9b700 1 -- 172.21.15.71:0/3962714392 learned_addr learned my addr 172.21.15.71:0/3962714392 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f29b9b700 1 -- 172.21.15.71:0/3962714392 >> v1:172.21.15.194:6789/0 conn(0x7f8f240b5c90 legacy=0x7f8f240d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f29b9b700 1 -- 172.21.15.71:0/3962714392 >> v1:172.21.15.71:6789/0 conn(0x7f8f240b6110 legacy=0x7f8f240cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f29b9b700 1 -- 172.21.15.71:0/3962714392 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240cda50 con 0x7f8f2415fca0 2023-07-06T01:09:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f29b9b700 1 --2- 172.21.15.71:0/3962714392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f2415fca0 0x7f8f240d1420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f200098f0 tx=0x7f8f20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233b427a02264cb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f28b99700 1 -- 172.21.15.71:0/3962714392 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20004230 con 0x7f8f2415fca0 2023-07-06T01:09:13.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f28b99700 1 -- 172.21.15.71:0/3962714392 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f20004390 con 0x7f8f2415fca0 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.387+0000 7f8f28b99700 1 -- 172.21.15.71:0/3962714392 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200036a0 con 0x7f8f2415fca0 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3962714392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f2415fca0 msgr2=0x7f8f240d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3962714392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f2415fca0 0x7f8f240d1420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f200098f0 tx=0x7f8f20009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3962714392 shutdown_connections 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3962714392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f2415fca0 0x7f8f240d1420 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3962714392 >> 172.21.15.71:0/3962714392 conn(0x7f8f2406c150 msgr2=0x7f8f2406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:13.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3962714392 shutdown_connections 2023-07-06T01:09:13.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.388+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3962714392 wait complete. 2023-07-06T01:09:13.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.390+0000 7f8f2bdff700 1 Processor -- start 2023-07-06T01:09:13.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.390+0000 7f8f2bdff700 1 -- start start 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2bdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f240b5c90 0x7f8f240c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2bdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 0x7f8f240b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2bdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f2415fca0 0x7f8f240cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2bdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240cccf0 con 0x7f8f240b6110 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2bdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f240cca10 con 0x7f8f240b5c90 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2bdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f24157f30 con 0x7f8f2415fca0 2023-07-06T01:09:13.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 0x7f8f240b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 0x7f8f240b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:32986/0 (socket says 172.21.15.71:32986) 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 -- 172.21.15.71:0/3484070300 learned_addr learned my addr 172.21.15.71:0/3484070300 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f29b9b700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f240b5c90 0x7f8f240c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2a39c700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f2415fca0 0x7f8f240cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 -- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f2415fca0 msgr2=0x7f8f240cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f2415fca0 0x7f8f240cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 -- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f240b5c90 msgr2=0x7f8f240c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f240b5c90 0x7f8f240c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 -- 172.21.15.71:0/3484070300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20009550 con 0x7f8f240b6110 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f29b9b700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f240b5c90 0x7f8f240c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2a39c700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f2415fca0 0x7f8f240cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.391+0000 7f8f2939a700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 0x7f8f240b32c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c4e0 tx=0x7f8f1400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.392+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f140052d0 con 0x7f8f240b6110 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.392+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f14005430 con 0x7f8f240b6110 2023-07-06T01:09:13.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.392+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f140038c0 con 0x7f8f240b6110 2023-07-06T01:09:13.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.392+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f24158210 con 0x7f8f240b6110 2023-07-06T01:09:13.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.392+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f240c7980 con 0x7f8f240b6110 2023-07-06T01:09:13.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.393+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f24158730 con 0x7f8f240b6110 2023-07-06T01:09:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.394+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f14003a20 con 0x7f8f240b6110 2023-07-06T01:09:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.395+0000 7f8f1a7fc700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f0806ace0 0x7f8f0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.395+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f140889b0 con 0x7f8f240b6110 2023-07-06T01:09:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.395+0000 7f8f29b9b700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f0806ace0 0x7f8f0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.396+0000 7f8f29b9b700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f0806ace0 0x7f8f0806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009c40 tx=0x7f8f20008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:13.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.399+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f24158730 con 0x7f8f240b6110 2023-07-06T01:09:13.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.636+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f24158730 con 0x7f8f240b6110 2023-07-06T01:09:13.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.636+0000 7f8f1a7fc700 1 -- 172.21.15.71:0/3484070300 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f8f24158730 con 0x7f8f240b6110 2023-07-06T01:09:13.639 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:13.639 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f0806ace0 msgr2=0x7f8f0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f0806ace0 0x7f8f0806d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009c40 tx=0x7f8f20008030 comp rx=0 tx=0).stop 2023-07-06T01:09:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 msgr2=0x7f8f240b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:13.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 0x7f8f240b32c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c4e0 tx=0x7f8f1400c8a0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 shutdown_connections 2023-07-06T01:09:13.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f0806ace0 0x7f8f0806d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f2415fca0 0x7f8f240cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f240b5c90 0x7f8f240c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 --2- 172.21.15.71:0/3484070300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f240b6110 0x7f8f240b32c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 >> 172.21.15.71:0/3484070300 conn(0x7f8f2406c150 msgr2=0x7f8f240d1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 shutdown_connections 2023-07-06T01:09:13.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:13.639+0000 7f8f2bdff700 1 -- 172.21.15.71:0/3484070300 wait complete. 2023-07-06T01:09:13.644 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:14.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T01:08:51.009959+0000', 'modified': '2023-07-06T01:08:54.558235+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6835/4032291003', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 4032291003}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 4032291003}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T01:09:14.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T01:09:14.061 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T01:09:14.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.253+0000 7fad7cfff700 1 Processor -- start 2023-07-06T01:09:14.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.253+0000 7fad7cfff700 1 -- start start 2023-07-06T01:09:14.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7cfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fad7815fca0 0x7fad780d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7cfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad780d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7cfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780cf780 con 0x7fad780b60e0 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7cfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad780cd490 con 0x7fad7815fca0 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7cfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780cd770 con 0x7fad780b5c90 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fad7815fca0 0x7fad780d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad76d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fad780b60e0 0x7fad780cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:32884/0 (socket says 172.21.15.71:32884) 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad76d9d700 1 -- 172.21.15.71:0/3852658031 learned_addr learned my addr 172.21.15.71:0/3852658031 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3852658031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad780d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7659c700 1 -- 172.21.15.71:0/3852658031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 msgr2=0x7fad780d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7659c700 1 --2- 172.21.15.71:0/3852658031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad780d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7659c700 1 -- 172.21.15.71:0/3852658031 >> v1:172.21.15.71:6789/0 conn(0x7fad780b60e0 legacy=0x7fad780cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.255+0000 7fad7659c700 1 -- 172.21.15.71:0/3852658031 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780cda50 con 0x7fad7815fca0 2023-07-06T01:09:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7659c700 1 --2- 172.21.15.71:0/3852658031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7815fca0 0x7fad780d1420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad68009840 tx=0x7fad68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee2b12a8e33bcf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad75d9b700 1 -- 172.21.15.71:0/3852658031 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68011830 con 0x7fad7815fca0 2023-07-06T01:09:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad75d9b700 1 -- 172.21.15.71:0/3852658031 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68011990 con 0x7fad7815fca0 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad75d9b700 1 -- 172.21.15.71:0/3852658031 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68011d20 con 0x7fad7815fca0 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 -- 172.21.15.71:0/3852658031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7815fca0 msgr2=0x7fad780d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3852658031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7815fca0 0x7fad780d1420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fad68009840 tx=0x7fad68009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 -- 172.21.15.71:0/3852658031 shutdown_connections 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3852658031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad7815fca0 0x7fad780d1420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3852658031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad780d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 -- 172.21.15.71:0/3852658031 >> 172.21.15.71:0/3852658031 conn(0x7fad7806c150 msgr2=0x7fad7806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:14.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 -- 172.21.15.71:0/3852658031 shutdown_connections 2023-07-06T01:09:14.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.256+0000 7fad7cfff700 1 -- 172.21.15.71:0/3852658031 wait complete. 2023-07-06T01:09:14.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.258+0000 7fad7cfff700 1 Processor -- start 2023-07-06T01:09:14.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.258+0000 7fad7cfff700 1 -- start start 2023-07-06T01:09:14.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad7cfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad781e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad7cfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 0x7fad78156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad7cfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad7815fca0 0x7fad781e7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad7cfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781e64c0 con 0x7fad780b60e0 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad7cfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad781e67a0 con 0x7fad7815fca0 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad7cfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad781e6a80 con 0x7fad780b5c90 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad6ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 0x7fad78156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad6ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 0x7fad78156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33012/0 (socket says 172.21.15.71:33012) 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.259+0000 7fad6ffff700 1 -- 172.21.15.71:0/3814349156 learned_addr learned my addr 172.21.15.71:0/3814349156 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad7659c700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad781e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad76d9d700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad7815fca0 0x7fad781e7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6ffff700 1 -- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 msgr2=0x7fad781e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad781e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6ffff700 1 -- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad7815fca0 msgr2=0x7fad781e7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad7815fca0 0x7fad781e7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6ffff700 1 -- 172.21.15.71:0/3814349156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680094a0 con 0x7fad780b60e0 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad7659c700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad781e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 0x7fad78156cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad6000e810 tx=0x7fad6000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6effd700 1 -- 172.21.15.71:0/3814349156 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60013610 con 0x7fad780b60e0 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6effd700 1 -- 172.21.15.71:0/3814349156 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60013770 con 0x7fad780b60e0 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad6effd700 1 -- 172.21.15.71:0/3814349156 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60013b20 con 0x7fad780b60e0 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad781e6d60 con 0x7fad780b60e0 2023-07-06T01:09:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.260+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781574a0 con 0x7fad780b60e0 2023-07-06T01:09:14.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.262+0000 7fad6effd700 1 -- 172.21.15.71:0/3814349156 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad60013c80 con 0x7fad780b60e0 2023-07-06T01:09:14.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.263+0000 7fad6effd700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad5806ace0 0x7fad5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.263+0000 7fad6effd700 1 -- 172.21.15.71:0/3814349156 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad60089150 con 0x7fad780b60e0 2023-07-06T01:09:14.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.264+0000 7fad7659c700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad5806ace0 0x7fad5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.264+0000 7fad7659c700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad5806ace0 0x7fad5806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad680090b0 tx=0x7fad6801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.265+0000 7fad908bfb80 1 Processor -- start 2023-07-06T01:09:14.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 -- start start 2023-07-06T01:09:14.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c482120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c4a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c45f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c3d3ea0 con 0x55573c481d50 2023-07-06T01:09:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c347600 con 0x55573c45cb50 2023-07-06T01:09:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.266+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55573c3b6910 con 0x55573c487190 2023-07-06T01:09:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c482120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c482120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33024/0 (socket says 172.21.15.71:33024) 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 -- 172.21.15.71:0/2858930888 learned_addr learned my addr 172.21.15.71:0/2858930888 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad76d9d700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c45f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad6ffff700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c4a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 -- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 msgr2=0x55573c4a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c4a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 -- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 msgr2=0x55573c45f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c45f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 -- 172.21.15.71:0/2858930888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55573c1a3790 con 0x55573c481d50 2023-07-06T01:09:14.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad6ffff700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c4a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:14.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad76d9d700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c45f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:14.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.267+0000 7fad7659c700 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c482120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad68011e20 tx=0x7fad68010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4240dcb05baeda server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad57fff700 1 -- 172.21.15.71:0/2858930888 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680037a0 con 0x55573c481d50 2023-07-06T01:09:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad57fff700 1 -- 172.21.15.71:0/2858930888 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68003900 con 0x55573c481d50 2023-07-06T01:09:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad57fff700 1 -- 172.21.15.71:0/2858930888 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68003c70 con 0x55573c481d50 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 -- 172.21.15.71:0/2858930888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 msgr2=0x55573c482120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c482120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fad68011e20 tx=0x7fad68010000 comp rx=0 tx=0).stop 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 -- 172.21.15.71:0/2858930888 shutdown_connections 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c45f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c482120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 --2- 172.21.15.71:0/2858930888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c4a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 -- 172.21.15.71:0/2858930888 >> 172.21.15.71:0/2858930888 conn(0x55573c454310 msgr2=0x55573c4a45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.268+0000 7fad908bfb80 1 -- 172.21.15.71:0/2858930888 shutdown_connections 2023-07-06T01:09:14.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.269+0000 7fad908bfb80 1 -- 172.21.15.71:0/2858930888 wait complete. 2023-07-06T01:09:14.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.269+0000 7fad908bfb80 1 -- start start 2023-07-06T01:09:14.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.270+0000 7fad908bfb80 1 Processor -- start 2023-07-06T01:09:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 0x55573c476e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c480710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c480c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c3afbe0 con 0x55573c45cb50 2023-07-06T01:09:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c36d5b0 con 0x55573c481d50 2023-07-06T01:09:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55573c353910 con 0x55573c487190 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.271+0000 7fad908bfb80 10 client.0 _ll_register_callbacks cb 0x55573c36bb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 0x55573c476e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 0x55573c476e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33036/0 (socket says 172.21.15.71:33036) 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 -- 172.21.15.71:0/3336712990 learned_addr learned my addr 172.21.15.71:0/3336712990 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad76d9d700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c480c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c480710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 -- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 msgr2=0x55573c480c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c480c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 -- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 msgr2=0x55573c480710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c480710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 -- 172.21.15.71:0/3336712990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad780cda50 con 0x55573c45cb50 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad7659c700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 0x55573c476e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad68009840 tx=0x7fad680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a36bb8a15cb3706 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad557fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad557fa700 1 -- 172.21.15.71:0/3336712990 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680037a0 con 0x55573c45cb50 2023-07-06T01:09:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad557fa700 1 -- 172.21.15.71:0/3336712990 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad68035070 con 0x55573c45cb50 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.272+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55573c451920 con 0x55573c45cb50 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad557fa700 1 -- 172.21.15.71:0/3336712990 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad6802f890 con 0x55573c45cb50 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 10 client.4674 fetch_fsmap learned FSMap version 8 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55573c2900a0 con 0x55573c45cb50 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad557fa700 1 -- 172.21.15.71:0/3336712990 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55573c451920 con 0x55573c45cb50 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad557fa700 1 -- 172.21.15.71:0/3336712990 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fad6802f9f0 con 0x55573c45cb50 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2023-07-06T01:09:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 10 client.4674 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 20 client.4674 populate_metadata read hostname 'smithi071' 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c47ece0 0x55573c479c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 4 client.4674 mds_command: new command op to 4297 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 --> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55573c42e0d0 con 0x55573c47ece0 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.273+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c47ece0 0x55573c479c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.274+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c47ece0 0x55573c479c60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef59bc399b459cc5 server_cookie=228624b49f8fa063 in_seq=0 out_seq=0 2023-07-06T01:09:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.274+0000 7fad557fa700 10 client.4674 ms_handle_connect on v2:172.21.15.71:6834/4032291003 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.274+0000 7fad557fa700 1 -- 172.21.15.71:0/3336712990 <== mds.0 v2:172.21.15.71:6834/4032291003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55573c42e0d0 con 0x55573c47ece0 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.274+0000 7fad557fa700 10 client.4674 handle_command_reply: tid=0 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 client.4674 shutdown 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 msgr2=0x55573c476e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 0x55573c476e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fad68009840 tx=0x7fad680047c0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 shutdown_connections 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c47ece0 0x55573c479c60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c480c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c45cb50 0x55573c476e00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad557fa700 0 client.4674 ms_handle_reset on v2:172.21.15.71:6834/4032291003 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3336712990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c480710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 >> 172.21.15.71:0/3336712990 conn(0x55573c454310 msgr2=0x55573c458ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 shutdown_connections 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 1 -- 172.21.15.71:0/3336712990 wait complete. 2023-07-06T01:09:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.275+0000 7fad908bfb80 20 client.4674 trim_cache size 0 max 16384 2023-07-06T01:09:14.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.293+0000 7fad908bfb80 1 Processor -- start 2023-07-06T01:09:14.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.293+0000 7fad908bfb80 1 -- start start 2023-07-06T01:09:14.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c478540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c45bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c49b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad908bfb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c1a4390 con 0x55573c481d50 2023-07-06T01:09:14.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c4c65e0 con 0x55573c45cb50 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55573c4771d0 con 0x55573c487190 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c45bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c45bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33048/0 (socket says 172.21.15.71:33048) 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 -- 172.21.15.71:0/3847469353 learned_addr learned my addr 172.21.15.71:0/3847469353 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 -- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 msgr2=0x55573c49b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad76d9d700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c49b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad7659c700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c478540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c49b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 -- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 msgr2=0x55573c478540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c478540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad6ffff700 1 -- 172.21.15.71:0/3847469353 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55573c375b10 con 0x55573c481d50 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.294+0000 7fad76d9d700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c49b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad7659c700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c478540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad6ffff700 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c45bd90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fad6000efd0 tx=0x7fad6005bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37e9130e6e57498 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad6cff9700 1 -- 172.21.15.71:0/3847469353 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600752c0 con 0x55573c481d50 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad6cff9700 1 -- 172.21.15.71:0/3847469353 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6006f070 con 0x55573c481d50 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad6cff9700 1 -- 172.21.15.71:0/3847469353 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60056270 con 0x55573c481d50 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 -- 172.21.15.71:0/3847469353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 msgr2=0x55573c45bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c45bd90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fad6000efd0 tx=0x7fad6005bf40 comp rx=0 tx=0).stop 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 -- 172.21.15.71:0/3847469353 shutdown_connections 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c487190 0x55573c49b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c45cb50 0x55573c478540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 --2- 172.21.15.71:0/3847469353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c481d50 0x55573c45bd90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.295+0000 7fad908bfb80 1 -- 172.21.15.71:0/3847469353 >> 172.21.15.71:0/3847469353 conn(0x55573c454310 msgr2=0x55573c45e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:14.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.296+0000 7fad908bfb80 1 -- 172.21.15.71:0/3847469353 shutdown_connections 2023-07-06T01:09:14.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.296+0000 7fad908bfb80 1 -- 172.21.15.71:0/3847469353 wait complete. 2023-07-06T01:09:14.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.296+0000 7fad908bfb80 1 -- start start 2023-07-06T01:09:14.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.297+0000 7fad908bfb80 1 Processor -- start 2023-07-06T01:09:14.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c45cb50 0x55573c50c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c45d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 0x55573c50f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c487690 con 0x55573c487190 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55573c47a3c0 con 0x55573c481d50 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55573c475f10 con 0x55573c45cb50 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad908bfb80 10 client.0 _ll_register_callbacks cb 0x7fad68011c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.298+0000 7fad76d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 0x55573c50f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 0x55573c50f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33060/0 (socket says 172.21.15.71:33060) 2023-07-06T01:09:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 -- 172.21.15.71:0/784597106 learned_addr learned my addr 172.21.15.71:0/784597106 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad7659c700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c45cb50 0x55573c50c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad6ffff700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c45d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 -- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c45cb50 msgr2=0x55573c50c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c45cb50 0x55573c50c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 -- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 msgr2=0x55573c45d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c45d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 -- 172.21.15.71:0/784597106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad781574a0 con 0x55573c487190 2023-07-06T01:09:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad7659c700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c45cb50 0x55573c50c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad6ffff700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c45d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad76d9d700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 0x55573c50f530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad780b64f0 tx=0x7fad700079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91536eafb3f7fae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad557fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad557fa700 1 -- 172.21.15.71:0/784597106 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70013910 con 0x55573c487190 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad557fa700 1 -- 172.21.15.71:0/784597106 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad70013a70 con 0x55573c487190 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.299+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad68003900 con 0x55573c487190 2023-07-06T01:09:14.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad557fa700 1 -- 172.21.15.71:0/784597106 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad70013c30 con 0x55573c487190 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 10 client.4680 fetch_fsmap learned FSMap version 8 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55573c2041d0 con 0x55573c487190 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad557fa700 1 -- 172.21.15.71:0/784597106 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68003900 con 0x55573c487190 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad557fa700 1 -- 172.21.15.71:0/784597106 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fad7001f440 con 0x55573c487190 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 10 client.4680 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 20 client.4680 populate_metadata read hostname 'smithi071' 2023-07-06T01:09:14.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c459dc0 0x55573c45a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 4 client.4680 mds_command: new command op to 4297 tid=0[{"prefix": "status"}] 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 --> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55573c3a8d20 con 0x55573c459dc0 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.300+0000 7fad7659c700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c459dc0 0x55573c45a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad557fa700 10 client.4680 ms_handle_connect on v2:172.21.15.71:6834/4032291003 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad7659c700 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c459dc0 0x55573c45a190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a58a6163ad4e45 server_cookie=cc33b5c27cf873ac in_seq=0 out_seq=0 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad557fa700 1 -- 172.21.15.71:0/784597106 <== mds.0 v2:172.21.15.71:6834/4032291003 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55573c3a8d20 con 0x55573c459dc0 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad557fa700 10 client.4680 handle_command_reply: tid=0 2023-07-06T01:09:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 client.4680 shutdown 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 msgr2=0x55573c50f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 0x55573c50f530 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad780b64f0 tx=0x7fad700079c0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 shutdown_connections 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55573c487190 0x55573c50f530 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.71:6834/4032291003,v1:172.21.15.71:6835/4032291003] conn(0x55573c459dc0 0x55573c45a190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55573c45cb50 0x55573c50c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 --2- 172.21.15.71:0/784597106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55573c481d50 0x55573c45d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad557fa700 0 client.4680 ms_handle_reset on v2:172.21.15.71:6834/4032291003 2023-07-06T01:09:14.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 >> 172.21.15.71:0/784597106 conn(0x55573c454310 msgr2=0x55573c45e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:14.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 shutdown_connections 2023-07-06T01:09:14.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 1 -- 172.21.15.71:0/784597106 wait complete. 2023-07-06T01:09:14.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.301+0000 7fad908bfb80 20 client.4680 trim_cache size 0 max 16384 2023-07-06T01:09:14.312 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "2e134b12-52b2-40d1-8145-7c2e3ab16f64", 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4297, 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-07-06T01:09:14.313 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 22.776852308999999, 2023-07-06T01:09:14.314 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 8, 2023-07-06T01:09:14.314 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 23, 2023-07-06T01:09:14.314 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 23, 2023-07-06T01:09:14.314 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 28.939941190999999 2023-07-06T01:09:14.314 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:09:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad5806ace0 msgr2=0x7fad5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad5806ace0 0x7fad5806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad680090b0 tx=0x7fad6801c040 comp rx=0 tx=0).stop 2023-07-06T01:09:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 msgr2=0x7fad78156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 0x7fad78156cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad6000e810 tx=0x7fad6000ebd0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 shutdown_connections 2023-07-06T01:09:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad5806ace0 0x7fad5806d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad7815fca0 0x7fad781e7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad780b5c90 0x7fad781e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 --2- 172.21.15.71:0/3814349156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad780b60e0 0x7fad78156cc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 >> 172.21.15.71:0/3814349156 conn(0x7fad7806c150 msgr2=0x7fad7815a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 shutdown_connections 2023-07-06T01:09:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:14.302+0000 7fad7cfff700 1 -- 172.21.15.71:0/3814349156 wait complete. 2023-07-06T01:09:14.321 INFO:teuthology.run_tasks:Running task kclient... 2023-07-06T01:09:14.344 INFO:tasks.kclient:Mounting kernel clients... 2023-07-06T01:09:14.345 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-06T01:09:14.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.345 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:09:14.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-07-06T01:09:14.465 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2023-07-06T01:09:14.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:09:14.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.468 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:09:14.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-07-06T01:09:14.586 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2023-07-06T01:09:14.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:09:14.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.589 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:09:14.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.642 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-07-06T01:09:14.717 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2023-07-06T01:09:14.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:09:14.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.723 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:09:14.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:14.771 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-07-06T01:09:14.881 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2023-07-06T01:09:14.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:09:14.884 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-07-06T01:09:14.884 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T01:09:14.885 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T01:09:14.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T01:09:15.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.082+0000 7f8ca9fff700 1 Processor -- start 2023-07-06T01:09:15.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.082+0000 7f8ca9fff700 1 -- start start 2023-07-06T01:09:15.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.083+0000 7f8ca9fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca415fca0 0x7f8ca40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:15.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca9fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca40cf780 con 0x7f8ca40b6110 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca9fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca40cd490 con 0x7f8ca40b5c90 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca9fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca40cd770 con 0x7f8ca415fca0 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca415fca0 0x7f8ca40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca415fca0 0x7f8ca40d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33068/0 (socket says 172.21.15.71:33068) 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8ca40b6110 0x7f8ca40cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:32894/0 (socket says 172.21.15.71:32894) 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 -- 172.21.15.71:0/2224204192 learned_addr learned my addr 172.21.15.71:0/2224204192 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:15.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 -- 172.21.15.71:0/2224204192 >> v1:172.21.15.194:6789/0 conn(0x7f8ca40b5c90 legacy=0x7f8ca40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 -- 172.21.15.71:0/2224204192 >> v1:172.21.15.71:6789/0 conn(0x7f8ca40b6110 legacy=0x7f8ca40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 -- 172.21.15.71:0/2224204192 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40cda50 con 0x7f8ca415fca0 2023-07-06T01:09:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca27fc700 1 -- 172.21.15.71:0/2224204192 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156007559 0 0) 0x7f8ca40cf780 con 0x7f8ca40b6110 2023-07-06T01:09:15.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.084+0000 7f8ca37fe700 1 --2- 172.21.15.71:0/2224204192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca415fca0 0x7f8ca40d1420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c940098f0 tx=0x7f8c94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8638e1eae80ee427 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:15.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca27fc700 1 -- 172.21.15.71:0/2224204192 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94004230 con 0x7f8ca415fca0 2023-07-06T01:09:15.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca27fc700 1 -- 172.21.15.71:0/2224204192 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94004390 con 0x7f8ca415fca0 2023-07-06T01:09:15.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca27fc700 1 -- 172.21.15.71:0/2224204192 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c940036a0 con 0x7f8ca415fca0 2023-07-06T01:09:15.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 -- 172.21.15.71:0/2224204192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca415fca0 msgr2=0x7f8ca40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:15.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/2224204192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca415fca0 0x7f8ca40d1420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c940098f0 tx=0x7f8c94009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:15.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 -- 172.21.15.71:0/2224204192 shutdown_connections 2023-07-06T01:09:15.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/2224204192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca415fca0 0x7f8ca40d1420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 -- 172.21.15.71:0/2224204192 >> 172.21.15.71:0/2224204192 conn(0x7f8ca406c150 msgr2=0x7f8ca406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:15.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 -- 172.21.15.71:0/2224204192 shutdown_connections 2023-07-06T01:09:15.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.085+0000 7f8ca9fff700 1 -- 172.21.15.71:0/2224204192 wait complete. 2023-07-06T01:09:15.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.087+0000 7f8ca9fff700 1 Processor -- start 2023-07-06T01:09:15.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.087+0000 7f8ca9fff700 1 -- start start 2023-07-06T01:09:15.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca9fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ca40b5c90 0x7f8ca41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:15.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca9fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 0x7f8ca40d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:15.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca9fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ca415fca0 0x7f8ca40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca9fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f2230 con 0x7f8ca40b6110 2023-07-06T01:09:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca9fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f2510 con 0x7f8ca415fca0 2023-07-06T01:09:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca9fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f27f0 con 0x7f8ca40b5c90 2023-07-06T01:09:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 0x7f8ca40d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:15.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 0x7f8ca40d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33070/0 (socket says 172.21.15.71:33070) 2023-07-06T01:09:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca2ffd700 1 -- 172.21.15.71:0/1322425994 learned_addr learned my addr 172.21.15.71:0/1322425994 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca3fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ca415fca0 0x7f8ca40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.088+0000 7f8ca37fe700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ca40b5c90 0x7f8ca41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca2ffd700 1 -- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ca40b5c90 msgr2=0x7f8ca41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:15.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca2ffd700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ca40b5c90 0x7f8ca41575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca2ffd700 1 -- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ca415fca0 msgr2=0x7f8ca40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca2ffd700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ca415fca0 0x7f8ca40b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca2ffd700 1 -- 172.21.15.71:0/1322425994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009550 con 0x7f8ca40b6110 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca2ffd700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 0x7f8ca40d0c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800b4a0 tx=0x7f8c9800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011830 con 0x7f8ca40b6110 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98011990 con 0x7f8ca40b6110 2023-07-06T01:09:15.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca41f2ad0 con 0x7f8ca40b6110 2023-07-06T01:09:15.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98011d40 con 0x7f8ca40b6110 2023-07-06T01:09:15.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.089+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca41f1e00 con 0x7f8ca40b6110 2023-07-06T01:09:15.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.090+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca40008d0 con 0x7f8ca40b6110 2023-07-06T01:09:15.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.091+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c9801a400 con 0x7f8ca40b6110 2023-07-06T01:09:15.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.092+0000 7f8c8bfff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8c9006ace0 0x7f8c9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:15.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.092+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c98088ff0 con 0x7f8ca40b6110 2023-07-06T01:09:15.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.092+0000 7f8ca37fe700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8c9006ace0 0x7f8c9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:15.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.093+0000 7f8ca37fe700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8c9006ace0 0x7f8c9006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009130 tx=0x7f8c94008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:15.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.096+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c980bb310 con 0x7f8ca40b6110 2023-07-06T01:09:15.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.334+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ca40cfef0 con 0x7f8ca40b6110 2023-07-06T01:09:15.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.335+0000 7f8c8bfff700 1 -- 172.21.15.71:0/1322425994 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8c98015060 con 0x7f8ca40b6110 2023-07-06T01:09:15.338 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T01:09:15.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8c9006ace0 msgr2=0x7f8c9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:15.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8c9006ace0 0x7f8c9006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009130 tx=0x7f8c94008030 comp rx=0 tx=0).stop 2023-07-06T01:09:15.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 msgr2=0x7f8ca40d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:15.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 0x7f8ca40d0c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800b4a0 tx=0x7f8c9800b7b0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 shutdown_connections 2023-07-06T01:09:15.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8c9006ace0 0x7f8c9006d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ca415fca0 0x7f8ca40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ca40b5c90 0x7f8ca41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 --2- 172.21.15.71:0/1322425994 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca40b6110 0x7f8ca40d0c20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:15.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 >> 172.21.15.71:0/1322425994 conn(0x7f8ca406c150 msgr2=0x7f8ca40b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:15.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 shutdown_connections 2023-07-06T01:09:15.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:15.337+0000 7f8ca9fff700 1 -- 172.21.15.71:0/1322425994 wait complete. 2023-07-06T01:09:15.357 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T01:09:15.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T01:09:15.358 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-07-06T01:09:15.358 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T01:09:15.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T01:09:15.359 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T01:09:15.359 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T01:09:15.359 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T01:09:15.359 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T01:09:15.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:15.360 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-07-06T01:09:15.405 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:15.405 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:15.406 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:15.407 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-06T01:09:15.408 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42331sec preferred_lft 42331sec 2023-07-06T01:09:15.408 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-07-06T01:09:15.408 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:15.409 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T01:09:15.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:15.410 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:15.410 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:15.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2023-07-06T01:09:15.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2023-07-06T01:09:15.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2023-07-06T01:09:15.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T01:09:15.411 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:15.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:15.879 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T01:09:15.984 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-07-06T01:09:15.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:15.987 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-07-06T01:09:16.056 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-07-06T01:09:16.056 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T01:09:16.056 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T01:09:16.057 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T01:09:16.057 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T01:09:16.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:16.058 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:16.058 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:16.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T01:09:16.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T01:09:16.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T01:09:16.059 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:16.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:16.722 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:09:16.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:16.769 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-07-06T01:09:16.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:16.814 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:16.815 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:16.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T01:09:16.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-06T01:09:16.816 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:16.997 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-06T01:09:16.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:16.998 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:16.998 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:16.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-06T01:09:16.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T01:09:16.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-06T01:09:16.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-06T01:09:16.999 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-06T01:09:16.999 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:17.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:17.254 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:17.254 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:17.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-07-06T01:09:17.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T01:09:17.255 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:17.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:17.433 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T01:09:17.478 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T01:09:17.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:17.479 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T01:09:17.562 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T01:09:17.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:17.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:17.710 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:17.710 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:18.172 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:18.173 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:18.173 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.194:3300,172.21.15.194:3301" 2023-07-06T01:09:18.173 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@2e134b12-52b2-40d1-8145-7c2e3ab16f64.cephfs=/ 2023-07-06T01:09:18.173 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2023-07-06T01:09:18.179 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T01:09:18.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:18.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T01:09:18.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:18.251 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:18.357 INFO:teuthology.orchestra.run.smithi071.stdout:client4633 2023-07-06T01:09:18.358 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:18.358 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:18.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:18.403 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:18.545 INFO:teuthology.orchestra.run.smithi071.stdout:client4633 2023-07-06T01:09:18.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:18.546 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:18.651 INFO:teuthology.orchestra.run.smithi071.stdout:client4633 2023-07-06T01:09:18.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:18.652 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2e134b12-52b2-40d1-8145-7c2e3ab16f64.client4633/status') 2023-07-06T01:09:18.774 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.4633 (3)172.21.15.71:0/2356400065 2023-07-06T01:09:18.774 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2023-07-06T01:09:18.774 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2023-07-06T01:09:18.774 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2023-07-06T01:09:18.775 INFO:teuthology.orchestra.run.smithi071.stderr:70 bytes copied, 5.0617e-05 s, 1.4 MB/s 2023-07-06T01:09:18.776 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-07-06T01:09:18.777 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T01:09:18.777 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-06T01:09:18.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T01:09:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.969+0000 7f585cdff700 1 Processor -- start 2023-07-06T01:09:18.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.969+0000 7f585cdff700 1 -- start start 2023-07-06T01:09:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.970+0000 7f585cdff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f585806c330 0x7f585806c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f585cdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f585cdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58581565f0 0x7f5858156a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f585cdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585806cc40 con 0x7f58581565f0 2023-07-06T01:09:18.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f585cdff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58580c9a60 con 0x7f585806c330 2023-07-06T01:09:18.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f585cdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5858159b70 con 0x7f58580c9010 2023-07-06T01:09:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58581565f0 0x7f5858156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f58581565f0 0x7f5858156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33082/0 (socket says 172.21.15.71:33082) 2023-07-06T01:09:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 -- 172.21.15.71:0/4114722493 learned_addr learned my addr 172.21.15.71:0/4114722493 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f585659c700 1 --2- 172.21.15.71:0/4114722493 >> v2:172.21.15.194:3300/0 conn(0x7f585806c330 0x7f585806c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f584ffff700 1 --2- 172.21.15.71:0/4114722493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 -- 172.21.15.71:0/4114722493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 msgr2=0x7f58580c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 --2- 172.21.15.71:0/4114722493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 -- 172.21.15.71:0/4114722493 >> v2:172.21.15.194:3300/0 conn(0x7f585806c330 msgr2=0x7f585806c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 --2- 172.21.15.71:0/4114722493 >> v2:172.21.15.194:3300/0 conn(0x7f585806c330 0x7f585806c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.971+0000 7f5856d9d700 1 -- 172.21.15.71:0/4114722493 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858159e50 con 0x7f58581565f0 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.972+0000 7f5856d9d700 1 --2- 172.21.15.71:0/4114722493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f5858156a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f585806f160 tx=0x7f585000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904122cc07a4d27b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.972+0000 7f5855d9b700 1 -- 172.21.15.71:0/4114722493 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850010070 con 0x7f58581565f0 2023-07-06T01:09:18.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.972+0000 7f5855d9b700 1 -- 172.21.15.71:0/4114722493 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585000dce0 con 0x7f58581565f0 2023-07-06T01:09:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.972+0000 7f5855d9b700 1 -- 172.21.15.71:0/4114722493 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000b310 con 0x7f58581565f0 2023-07-06T01:09:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.972+0000 7f585cdff700 1 -- 172.21.15.71:0/4114722493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 msgr2=0x7f5858156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.972+0000 7f585cdff700 1 --2- 172.21.15.71:0/4114722493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f5858156a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f585806f160 tx=0x7f585000d430 comp rx=0 tx=0).stop 2023-07-06T01:09:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 -- 172.21.15.71:0/4114722493 shutdown_connections 2023-07-06T01:09:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 --2- 172.21.15.71:0/4114722493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f5858156a60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 --2- 172.21.15.71:0/4114722493 >> v2:172.21.15.194:3300/0 conn(0x7f585806c330 0x7f585806c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 --2- 172.21.15.71:0/4114722493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 -- 172.21.15.71:0/4114722493 >> 172.21.15.71:0/4114722493 conn(0x7f58580cb440 msgr2=0x7f58580cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 -- 172.21.15.71:0/4114722493 shutdown_connections 2023-07-06T01:09:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.973+0000 7f585cdff700 1 -- 172.21.15.71:0/4114722493 wait complete. 2023-07-06T01:09:18.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.974+0000 7f585cdff700 1 Processor -- start 2023-07-06T01:09:18.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.975+0000 7f585cdff700 1 -- start start 2023-07-06T01:09:18.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.975+0000 7f585cdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585806c330 0x7f5858154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.975+0000 7f585cdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f585cdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f58580b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f585cdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580af910 con 0x7f58581565f0 2023-07-06T01:09:18.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f585cdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580aedd0 con 0x7f585806c330 2023-07-06T01:09:18.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f585cdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c6c60 con 0x7f58580c9010 2023-07-06T01:09:18.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f58580b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f58580b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33098/0 (socket says 172.21.15.71:33098) 2023-07-06T01:09:18.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 -- 172.21.15.71:0/1572678556 learned_addr learned my addr 172.21.15.71:0/1572678556 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:18.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f584ffff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f585659c700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585806c330 0x7f5858154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 -- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 msgr2=0x7f58580afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:18.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 -- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585806c330 msgr2=0x7f5858154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:18.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585806c330 0x7f5858154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:18.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 -- 172.21.15.71:0/1572678556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585000bd40 con 0x7f58581565f0 2023-07-06T01:09:18.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f585659c700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585806c330 0x7f5858154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:18.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.976+0000 7f5856d9d700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f58580b01b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5850014000 tx=0x7f5850004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:18.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.977+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850009a10 con 0x7f58581565f0 2023-07-06T01:09:18.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.977+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850009b70 con 0x7f58581565f0 2023-07-06T01:09:18.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.977+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58580af070 con 0x7f58581565f0 2023-07-06T01:09:18.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.977+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000b4c0 con 0x7f58581565f0 2023-07-06T01:09:18.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.977+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58580af630 con 0x7f58581565f0 2023-07-06T01:09:18.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.978+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58580c6e20 con 0x7f58581565f0 2023-07-06T01:09:18.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.979+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5850004040 con 0x7f58581565f0 2023-07-06T01:09:18.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.980+0000 7f584effd700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f583806ace0 0x7f583806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:18.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.980+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f585008d220 con 0x7f58581565f0 2023-07-06T01:09:18.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.981+0000 7f585659c700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f583806ace0 0x7f583806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:18.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.981+0000 7f585659c700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f583806ace0 0x7f583806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5848009b10 tx=0x7f5848008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:18.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:18.985+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58500582c0 con 0x7f58581565f0 2023-07-06T01:09:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.225+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f58580008d0 con 0x7f58581565f0 2023-07-06T01:09:19.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.225+0000 7f584effd700 1 -- 172.21.15.71:0/1572678556 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f585001ce60 con 0x7f58581565f0 2023-07-06T01:09:19.228 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T01:09:19.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.227+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f583806ace0 msgr2=0x7f583806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:19.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f583806ace0 0x7f583806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5848009b10 tx=0x7f5848008040 comp rx=0 tx=0).stop 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 msgr2=0x7f58580b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f58580b01b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5850014000 tx=0x7f5850004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 shutdown_connections 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f583806ace0 0x7f583806d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58581565f0 0x7f58580b01b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f585806c330 0x7f5858154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 --2- 172.21.15.71:0/1572678556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58580c9010 0x7f58580afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 >> 172.21.15.71:0/1572678556 conn(0x7f58580cb440 msgr2=0x7f58580700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 shutdown_connections 2023-07-06T01:09:19.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:19.228+0000 7f585cdff700 1 -- 172.21.15.71:0/1572678556 wait complete. 2023-07-06T01:09:19.248 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T01:09:19.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T01:09:19.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-07-06T01:09:19.248 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-06T01:09:19.249 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-06T01:09:19.249 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T01:09:19.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T01:09:19.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T01:09:19.249 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-06T01:09:19.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.250 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-07-06T01:09:19.295 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.296 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.298 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 2a:3c:e1:3a:cf:46 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b402:9aff:fe8a:d248/64 scope link 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 2a:3c:e1:3a:cf:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T01:09:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::283c:e1ff:fe3a:cf46/64 scope link 2023-07-06T01:09:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.301 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T01:09:19.367 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-07-06T01:09:19.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.371 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-07-06T01:09:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-07-06T01:09:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T01:09:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T01:09:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T01:09:19.419 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T01:09:19.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.421 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:19.422 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:19.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T01:09:19.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T01:09:19.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T01:09:19.423 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:19.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.591 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:09:19.638 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T01:09:19.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.696 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-07-06T01:09:19.742 INFO:teuthology.orchestra.run.smithi071.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-06T01:09:19.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.744 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:19.745 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:19.745 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T01:09:19.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-06T01:09:19.746 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:19.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-06T01:09:19.994 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 72:ef:bf:76:50:56 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::70ef:bfff:fe76:5056/64 scope link 2023-07-06T01:09:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:19.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:19.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-06T01:09:20.066 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:20.067 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:09:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 72:ef:bf:76:50:56 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T01:09:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T01:09:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::70ef:bfff:fe76:5056/64 scope link 2023-07-06T01:09:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:20.069 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-06T01:09:20.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:20.070 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:20.070 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:20.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-06T01:09:20.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-06T01:09:20.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-06T01:09:20.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-06T01:09:20.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-06T01:09:20.071 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:20.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:20.318 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:09:20.318 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:09:20.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.1 up 2023-07-06T01:09:20.319 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.1 master ceph-brx 2023-07-06T01:09:20.319 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:09:20.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:20.496 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-06T01:09:20.542 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-06T01:09:20.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:20.543 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-06T01:09:20.627 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-07-06T01:09:20.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:20.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:20.771 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:20.771 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:20.799 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:20.799 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:20.799 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.194:3300,172.21.15.194:3301" 2023-07-06T01:09:20.799 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 2@2e134b12-52b2-40d1-8145-7c2e3ab16f64.cephfs=/ 2023-07-06T01:09:20.799 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.71:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2023-07-06T01:09:20.804 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T01:09:20.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:20.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-06T01:09:20.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:20.874 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:20.960 INFO:teuthology.orchestra.run.smithi071.stdout:client4642 2023-07-06T01:09:20.961 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:20.961 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:21.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:21.007 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:21.133 INFO:teuthology.orchestra.run.smithi071.stdout:client4642 2023-07-06T01:09:21.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:21.134 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:21.222 INFO:teuthology.orchestra.run.smithi071.stdout:client4642 2023-07-06T01:09:21.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:21.223 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2e134b12-52b2-40d1-8145-7c2e3ab16f64.client4642/status') 2023-07-06T01:09:21.330 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.4642 (3)172.21.15.71:0/1534885231 2023-07-06T01:09:21.330 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2023-07-06T01:09:21.330 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2023-07-06T01:09:21.331 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2023-07-06T01:09:21.331 INFO:teuthology.orchestra.run.smithi071.stderr:70 bytes copied, 5.0641e-05 s, 1.4 MB/s 2023-07-06T01:09:21.332 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-07-06T01:09:21.333 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T01:09:21.333 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T01:09:21.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T01:09:21.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.525+0000 7fb4c29ff700 1 Processor -- start 2023-07-06T01:09:21.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.526+0000 7fb4c29ff700 1 -- start start 2023-07-06T01:09:21.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c29ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb4bc0b6110 0x7fb4bc0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c29ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0cf780 con 0x7fb4bc15fca0 2023-07-06T01:09:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c29ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0cd490 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c29ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cd770 con 0x7fb4bc0b6110 2023-07-06T01:09:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c0f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb4bc0b6110 0x7fb4bc0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c0f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb4bc0b6110 0x7fb4bc0cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33108/0 (socket says 172.21.15.71:33108) 2023-07-06T01:09:21.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c0f9c700 1 -- 172.21.15.71:0/1290483407 learned_addr learned my addr 172.21.15.71:0/1290483407 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:21.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4bbfff700 1 --1- 172.21.15.71:0/1290483407 >> v1:172.21.15.71:6789/0 conn(0x7fb4bc15fca0 0x7fb4bc0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:32908/0 (socket says 172.21.15.71:32908) 2023-07-06T01:09:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.527+0000 7fb4c0f9c700 1 -- 172.21.15.71:0/1290483407 >> v1:172.21.15.194:6789/0 conn(0x7fb4bc0b5c90 legacy=0x7fb4bc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4c0f9c700 1 -- 172.21.15.71:0/1290483407 >> v1:172.21.15.71:6789/0 conn(0x7fb4bc15fca0 legacy=0x7fb4bc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4c0f9c700 1 -- 172.21.15.71:0/1290483407 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0cda50 con 0x7fb4bc0b6110 2023-07-06T01:09:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4baffd700 1 -- 172.21.15.71:0/1290483407 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633197766 0 0) 0x7fb4bc0cf780 con 0x7fb4bc15fca0 2023-07-06T01:09:21.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4c0f9c700 1 --2- 172.21.15.71:0/1290483407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc0cfc10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009e50 tx=0x7fb4b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8475b46688c5f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4baffd700 1 -- 172.21.15.71:0/1290483407 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400e070 con 0x7fb4bc0b6110 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4baffd700 1 -- 172.21.15.71:0/1290483407 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400b9c0 con 0x7fb4bc0b6110 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4baffd700 1 -- 172.21.15.71:0/1290483407 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400bd70 con 0x7fb4bc0b6110 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4c29ff700 1 -- 172.21.15.71:0/1290483407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b6110 msgr2=0x7fb4bc0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.528+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/1290483407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc0cfc10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4009e50 tx=0x7fb4b400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.529+0000 7fb4c29ff700 1 -- 172.21.15.71:0/1290483407 shutdown_connections 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.529+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/1290483407 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc0cfc10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.529+0000 7fb4c29ff700 1 -- 172.21.15.71:0/1290483407 >> 172.21.15.71:0/1290483407 conn(0x7fb4bc06c150 msgr2=0x7fb4bc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:21.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.529+0000 7fb4c29ff700 1 -- 172.21.15.71:0/1290483407 shutdown_connections 2023-07-06T01:09:21.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.529+0000 7fb4c29ff700 1 -- 172.21.15.71:0/1290483407 wait complete. 2023-07-06T01:09:21.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.530+0000 7fb4c29ff700 1 Processor -- start 2023-07-06T01:09:21.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 -- start start 2023-07-06T01:09:21.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 0x7fb4bc0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4bc15fca0 0x7fb4bc0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0c7650 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0c69d0 con 0x7fb4bc0b6110 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.531+0000 7fb4c29ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0c6cb0 con 0x7fb4bc15fca0 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 0x7fb4bc0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 0x7fb4bc0c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33116/0 (socket says 172.21.15.71:33116) 2023-07-06T01:09:21.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 -- 172.21.15.71:0/2051071698 learned_addr learned my addr 172.21.15.71:0/2051071698 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bb7fe700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4c0f9c700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4bc15fca0 0x7fb4bc0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 -- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4bc15fca0 msgr2=0x7fb4bc0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4bc15fca0 0x7fb4bc0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 -- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4bc0b6110 msgr2=0x7fb4bc149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 -- 172.21.15.71:0/2051071698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b4009b30 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bb7fe700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.532+0000 7fb4bbfff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 0x7fb4bc0c5b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c520 tx=0x7fb4ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.533+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac004c80 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.533+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac004e20 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.533+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac007310 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.533+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0c6f90 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.533+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0c6050 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.534+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc0c78c0 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.535+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4ac007470 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.536+0000 7fb4b8ff9700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ad10 0x7fb4a806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:21.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.536+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4ac089100 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.536+0000 7fb4bb7fe700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ad10 0x7fb4a806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:21.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.537+0000 7fb4bb7fe700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ad10 0x7fb4a806d1c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc15f370 tx=0x7fb4b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:21.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.540+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4ac0541a0 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.776+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4bc0d3970 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.776+0000 7fb4b8ff9700 1 -- 172.21.15.71:0/2051071698 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4ac0577c0 con 0x7fb4bc0b5c90 2023-07-06T01:09:21.779 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T01:09:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ad10 msgr2=0x7fb4a806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ad10 0x7fb4a806d1c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc15f370 tx=0x7fb4b0009040 comp rx=0 tx=0).stop 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 msgr2=0x7fb4bc0c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 0x7fb4bc0c5b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00c520 tx=0x7fb4ac00c8e0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 shutdown_connections 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb4a806ad10 0x7fb4a806d1c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4bc15fca0 0x7fb4bc0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb4bc0b5c90 0x7fb4bc0c5b10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 --2- 172.21.15.71:0/2051071698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4bc0b6110 0x7fb4bc149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 >> 172.21.15.71:0/2051071698 conn(0x7fb4bc06c150 msgr2=0x7fb4bc0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 shutdown_connections 2023-07-06T01:09:21.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:21.779+0000 7fb4c29ff700 1 -- 172.21.15.71:0/2051071698 wait complete. 2023-07-06T01:09:21.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T01:09:21.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T01:09:21.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2023-07-06T01:09:21.800 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-06T01:09:21.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T01:09:21.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T01:09:21.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T01:09:21.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T01:09:21.801 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-06T01:09:21.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:21.801 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2023-07-06T01:09:21.852 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:21.852 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:21.852 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:21.852 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:21.853 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-07-06T01:09:21.854 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2023-07-06T01:09:21.855 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:21.855 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T01:09:21.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:21.856 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:21.856 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:21.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2023-07-06T01:09:21.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2023-07-06T01:09:21.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2023-07-06T01:09:21.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T01:09:21.858 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:22.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:22.368 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T01:09:22.439 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-07-06T01:09:22.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:22.442 DEBUG:teuthology.orchestra.run.smithi194:> route 2023-07-06T01:09:22.508 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2023-07-06T01:09:22.508 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T01:09:22.508 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T01:09:22.508 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T01:09:22.508 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T01:09:22.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:22.509 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:22.509 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:22.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T01:09:22.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T01:09:22.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T01:09:22.510 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:23.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:23.182 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:09:23.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:23.228 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2023-07-06T01:09:23.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:23.274 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:23.275 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:23.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T01:09:23.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-06T01:09:23.275 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:23.454 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-06T01:09:23.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:23.455 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:23.455 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:23.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-06T01:09:23.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T01:09:23.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-06T01:09:23.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-06T01:09:23.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-06T01:09:23.457 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:23.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:23.722 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:23.722 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:23.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2023-07-06T01:09:23.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T01:09:23.723 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:23.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:23.900 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-06T01:09:23.945 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-06T01:09:23.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:23.946 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-06T01:09:24.030 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-06T01:09:24.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:24.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:24.174 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:24.174 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:24.628 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:24.628 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:24.628 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.194:3300,172.21.15.194:3301" 2023-07-06T01:09:24.628 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@2e134b12-52b2-40d1-8145-7c2e3ab16f64.cephfs=/ 2023-07-06T01:09:24.629 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.71:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2023-07-06T01:09:24.633 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T01:09:24.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:24.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-06T01:09:24.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:24.703 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:24.797 INFO:teuthology.orchestra.run.smithi194.stdout:client4707 2023-07-06T01:09:24.798 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:24.798 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:24.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:24.845 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:24.971 INFO:teuthology.orchestra.run.smithi194.stdout:client4707 2023-07-06T01:09:24.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:24.972 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:25.058 INFO:teuthology.orchestra.run.smithi194.stdout:client4707 2023-07-06T01:09:25.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:25.059 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2e134b12-52b2-40d1-8145-7c2e3ab16f64.client4707/status') 2023-07-06T01:09:25.165 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4707 (3)172.21.15.194:0/1474283688 2023-07-06T01:09:25.165 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2023-07-06T01:09:25.166 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2023-07-06T01:09:25.166 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2023-07-06T01:09:25.166 INFO:teuthology.orchestra.run.smithi194.stderr:71 bytes copied, 4.7825e-05 s, 1.5 MB/s 2023-07-06T01:09:25.168 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-07-06T01:09:25.168 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T01:09:25.168 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-06T01:09:25.168 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T01:09:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.370+0000 7f3ed81ff700 1 Processor -- start 2023-07-06T01:09:25.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.370+0000 7f3ed81ff700 1 -- start start 2023-07-06T01:09:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.371+0000 7f3ed81ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3ed0158cd0 0x7f3ed00cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.371+0000 7f3ed81ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00cd370 con 0x7f3ed00ce420 2023-07-06T01:09:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.371+0000 7f3ed81ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00ad7f0 con 0x7f3ed00c9010 2023-07-06T01:09:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.371+0000 7f3ed81ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00cbf50 con 0x7f3ed0158cd0 2023-07-06T01:09:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed679c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3ed00ce420 0x7f3ed00cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43508/0 (socket says 172.21.15.71:43508) 2023-07-06T01:09:25.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed679c700 1 -- 172.21.15.71:0/1144959626 learned_addr learned my addr 172.21.15.71:0/1144959626 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed5f9b700 1 --2- 172.21.15.71:0/1144959626 >> v2:172.21.15.194:3300/0 conn(0x7f3ed0158cd0 0x7f3ed00cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed4f99700 1 -- 172.21.15.71:0/1144959626 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837997701 0 0) 0x7f3ed00cd370 con 0x7f3ed00ce420 2023-07-06T01:09:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed4f99700 1 -- 172.21.15.71:0/1144959626 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ebc0035b0 con 0x7f3ed00ce420 2023-07-06T01:09:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed5f9b700 1 -- 172.21.15.71:0/1144959626 >> v1:172.21.15.194:6789/0 conn(0x7f3ed00c9010 legacy=0x7f3ed006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed4f99700 1 -- 172.21.15.71:0/1144959626 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203650821 0 0) 0x7f3ed00ad7f0 con 0x7f3ed00c9010 2023-07-06T01:09:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed5f9b700 1 -- 172.21.15.71:0/1144959626 >> v1:172.21.15.71:6789/0 conn(0x7f3ed00ce420 legacy=0x7f3ed00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.372+0000 7f3ed5f9b700 1 -- 172.21.15.71:0/1144959626 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00cc160 con 0x7f3ed0158cd0 2023-07-06T01:09:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed5f9b700 1 --2- 172.21.15.71:0/1144959626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00cdee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009840 tx=0x7f3ecc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea107bca98202a43 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:25.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed4f99700 1 -- 172.21.15.71:0/1144959626 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00f8a0 con 0x7f3ed0158cd0 2023-07-06T01:09:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed4f99700 1 -- 172.21.15.71:0/1144959626 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc00fa00 con 0x7f3ed0158cd0 2023-07-06T01:09:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed4f99700 1 -- 172.21.15.71:0/1144959626 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00fd90 con 0x7f3ed0158cd0 2023-07-06T01:09:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1144959626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 msgr2=0x7f3ed00cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1144959626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00cdee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009840 tx=0x7f3ecc009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1144959626 shutdown_connections 2023-07-06T01:09:25.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1144959626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00cdee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1144959626 >> 172.21.15.71:0/1144959626 conn(0x7f3ed00cb440 msgr2=0x7f3ed00cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1144959626 shutdown_connections 2023-07-06T01:09:25.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.373+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1144959626 wait complete. 2023-07-06T01:09:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.375+0000 7f3ed81ff700 1 Processor -- start 2023-07-06T01:09:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.375+0000 7f3ed81ff700 1 -- start start 2023-07-06T01:09:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ed00c9010 0x7f3ed014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:25.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed81ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 0x7f3ed00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed81ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed81ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01f32f0 con 0x7f3ed00ce420 2023-07-06T01:09:25.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed81ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed014b3d0 con 0x7f3ed0158cd0 2023-07-06T01:09:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01f5c20 con 0x7f3ed00c9010 2023-07-06T01:09:25.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.376+0000 7f3ed579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 0x7f3ed00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 0x7f3ed00b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47504/0 (socket says 172.21.15.71:47504) 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 -- 172.21.15.71:0/1176781369 learned_addr learned my addr 172.21.15.71:0/1176781369 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed5f9b700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ed00c9010 0x7f3ed014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed679c700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 -- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ed00c9010 msgr2=0x7f3ed014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ed00c9010 0x7f3ed014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 -- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 msgr2=0x7f3ed00b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 -- 172.21.15.71:0/1176781369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0094a0 con 0x7f3ed00ce420 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed579a700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 0x7f3ed00b20a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c550 tx=0x7f3ec000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00054e0 con 0x7f3ed00ce420 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0003680 con 0x7f3ed00ce420 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0003a30 con 0x7f3ed00ce420 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.377+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed01f5f00 con 0x7f3ed00ce420 2023-07-06T01:09:25.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.378+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed01f64c0 con 0x7f3ed00ce420 2023-07-06T01:09:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.379+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed00008d0 con 0x7f3ed00ce420 2023-07-06T01:09:25.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.380+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ec0003b90 con 0x7f3ed00ce420 2023-07-06T01:09:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.381+0000 7f3ec67fc700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.381+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ec0088950 con 0x7f3ed00ce420 2023-07-06T01:09:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.381+0000 7f3ed5f9b700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.381+0000 7f3ed5f9b700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3eb406ace0 0x7f3eb406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009fd0 tx=0x7f3ecc01b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:25.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.385+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ec0053960 con 0x7f3ed00ce420 2023-07-06T01:09:25.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.625+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ed00adf10 con 0x7f3ed00ce420 2023-07-06T01:09:25.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.626+0000 7f3ec67fc700 1 -- 172.21.15.71:0/1176781369 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3ec0017030 con 0x7f3ed00ce420 2023-07-06T01:09:25.628 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T01:09:25.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3eb406ace0 msgr2=0x7f3eb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3eb406ace0 0x7f3eb406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009fd0 tx=0x7f3ecc01b040 comp rx=0 tx=0).stop 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 msgr2=0x7f3ed00b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 0x7f3ed00b20a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c550 tx=0x7f3ec000c910 comp rx=0 tx=0).stop 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 shutdown_connections 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3eb406ace0 0x7f3eb406d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ed0158cd0 0x7f3ed00b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ed00c9010 0x7f3ed014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 --2- 172.21.15.71:0/1176781369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ed00ce420 0x7f3ed00b20a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:25.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 >> 172.21.15.71:0/1176781369 conn(0x7f3ed00cb440 msgr2=0x7f3ed006f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:25.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 shutdown_connections 2023-07-06T01:09:25.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:25.628+0000 7f3ed81ff700 1 -- 172.21.15.71:0/1176781369 wait complete. 2023-07-06T01:09:25.648 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T01:09:25.649 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T01:09:25.649 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2023-07-06T01:09:25.649 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-06T01:09:25.649 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-06T01:09:25.650 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T01:09:25.650 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T01:09:25.650 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T01:09:25.650 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-06T01:09:25.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:25.651 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2023-07-06T01:09:25.698 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:25.698 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:25.699 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:25.699 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:25.699 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:25.699 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:25.699 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:25.699 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:25.700 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2023-07-06T01:09:25.700 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:25.700 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:25.700 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2023-07-06T01:09:25.700 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2023-07-06T01:09:25.701 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:25.702 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:09:25.702 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether f6:1f:d1:ee:89:d6 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:09:25.702 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T01:09:25.702 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:25.703 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::800b:b3ff:fe17:e97d/64 scope link 2023-07-06T01:09:25.703 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:25.703 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T01:09:25.704 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether f6:1f:d1:ee:89:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T01:09:25.704 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::f41f:d1ff:feee:89d6/64 scope link 2023-07-06T01:09:25.704 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:25.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:25.705 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T01:09:25.771 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-07-06T01:09:25.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:25.774 DEBUG:teuthology.orchestra.run.smithi194:> route 2023-07-06T01:09:25.823 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2023-07-06T01:09:25.823 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T01:09:25.823 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T01:09:25.823 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T01:09:25.823 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T01:09:25.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:25.824 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:25.824 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:25.825 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T01:09:25.825 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T01:09:25.825 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T01:09:25.825 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:25.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:25.993 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:09:26.038 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T01:09:26.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:26.040 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2023-07-06T01:09:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-06T01:09:26.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:26.127 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:26.127 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:26.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T01:09:26.128 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-06T01:09:26.128 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:26.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:26.307 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-06T01:09:26.376 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:26.376 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:26.376 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:26.376 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.377 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:26.377 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.377 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:09:26.378 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether ae:78:f7:df:fe:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T01:09:26.378 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T01:09:26.378 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.378 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ac78:f7ff:fedf:fee5/64 scope link 2023-07-06T01:09:26.378 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:26.380 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-06T01:09:26.449 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:09:26.451 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:09:26.451 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:09:26.451 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.451 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-07-06T01:09:26.452 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.452 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:09:26.453 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether ae:78:f7:df:fe:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T01:09:26.453 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T01:09:26.453 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.453 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ac78:f7ff:fedf:fee5/64 scope link 2023-07-06T01:09:26.454 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:09:26.455 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-06T01:09:26.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:26.457 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:26.457 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:26.458 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-06T01:09:26.458 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-06T01:09:26.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-06T01:09:26.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-06T01:09:26.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-06T01:09:26.460 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:26.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:26.703 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:09:26.704 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:09:26.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.1 up 2023-07-06T01:09:26.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.1 master ceph-brx 2023-07-06T01:09:26.704 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:09:26.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:26.882 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-06T01:09:26.927 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-06T01:09:26.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:09:26.928 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-06T01:09:27.011 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-07-06T01:09:27.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:27.012 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:27.155 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:27.156 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:27.184 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:09:27.184 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:09:27.184 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.194:3300,172.21.15.194:3301" 2023-07-06T01:09:27.184 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 3@2e134b12-52b2-40d1-8145-7c2e3ab16f64.cephfs=/ 2023-07-06T01:09:27.185 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.71:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2023-07-06T01:09:27.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T01:09:27.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:27.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-06T01:09:27.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:27.259 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:27.346 INFO:teuthology.orchestra.run.smithi194.stdout:client4514 2023-07-06T01:09:27.347 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:27.347 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:27.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:27.392 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:27.519 INFO:teuthology.orchestra.run.smithi194.stdout:client4514 2023-07-06T01:09:27.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:27.520 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:09:27.607 INFO:teuthology.orchestra.run.smithi194.stdout:client4514 2023-07-06T01:09:27.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:27.609 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2e134b12-52b2-40d1-8145-7c2e3ab16f64.client4514/status') 2023-07-06T01:09:27.715 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4514 (3)192.168.0.2:0/1155510402 2023-07-06T01:09:27.715 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2023-07-06T01:09:27.716 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2023-07-06T01:09:27.716 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2023-07-06T01:09:27.716 INFO:teuthology.orchestra.run.smithi194.stderr:69 bytes copied, 4.9785e-05 s, 1.4 MB/s 2023-07-06T01:09:27.718 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-06T01:09:27.735 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:27.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.939+0000 7f5dbf7ff700 1 Processor -- start 2023-07-06T01:09:27.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.939+0000 7f5dbf7ff700 1 -- start start 2023-07-06T01:09:27.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.940+0000 7f5dbf7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db815fca0 0x7f5db80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.940+0000 7f5dbf7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db80cf780 con 0x7f5db80b5c90 2023-07-06T01:09:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.940+0000 7f5dbf7ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db80cd490 con 0x7f5db80b6100 2023-07-06T01:09:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.940+0000 7f5dbf7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80cd770 con 0x7f5db815fca0 2023-07-06T01:09:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbcd9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5db80b5c90 0x7f5db80d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43520/0 (socket says 172.21.15.71:43520) 2023-07-06T01:09:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbcd9a700 1 -- 172.21.15.71:0/438009898 learned_addr learned my addr 172.21.15.71:0/438009898 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:27.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbd59b700 1 --2- 172.21.15.71:0/438009898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db815fca0 0x7f5db80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135629863 0 0) 0x7f5db80cf780 con 0x7f5db80b5c90 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da40035b0 con 0x7f5db80b5c90 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299642260 0 0) 0x7f5db80cd490 con 0x7f5db80b6100 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db80cf780 con 0x7f5db80b6100 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbd59b700 1 -- 172.21.15.71:0/438009898 >> v1:172.21.15.194:6789/0 conn(0x7f5db80b6100 legacy=0x7f5db80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbd59b700 1 -- 172.21.15.71:0/438009898 >> v1:172.21.15.71:6789/0 conn(0x7f5db80b5c90 legacy=0x7f5db80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:27.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbd59b700 1 -- 172.21.15.71:0/438009898 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80cda50 con 0x7f5db815fca0 2023-07-06T01:09:27.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.941+0000 7f5dbd59b700 1 --2- 172.21.15.71:0/438009898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db815fca0 0x7f5db80d1420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009870 tx=0x7f5db4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6faff81d54d68bd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011830 con 0x7f5db815fca0 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db4011990 con 0x7f5db815fca0 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5daffff700 1 -- 172.21.15.71:0/438009898 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db4011d20 con 0x7f5db815fca0 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/438009898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db815fca0 msgr2=0x7f5db80d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/438009898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db815fca0 0x7f5db80d1420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009870 tx=0x7f5db4009b80 comp rx=0 tx=0).stop 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/438009898 shutdown_connections 2023-07-06T01:09:27.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/438009898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db815fca0 0x7f5db80d1420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:27.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/438009898 >> 172.21.15.71:0/438009898 conn(0x7f5db806c150 msgr2=0x7f5db806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:27.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/438009898 shutdown_connections 2023-07-06T01:09:27.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.942+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/438009898 wait complete. 2023-07-06T01:09:27.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.944+0000 7f5dbf7ff700 1 Processor -- start 2023-07-06T01:09:27.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.944+0000 7f5dbf7ff700 1 -- start start 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbf7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 0x7f5db80c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbf7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5db80b6100 0x7f5db80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbf7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5db815fca0 0x7f5db815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbf7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80ca670 con 0x7f5db815fca0 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbf7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80cafd0 con 0x7f5db80b6100 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbf7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81f2c90 con 0x7f5db80b5c90 2023-07-06T01:09:27.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbd59b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 0x7f5db80c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.945+0000 7f5dbdd9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5db815fca0 0x7f5db815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 0x7f5db80c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:58182/0 (socket says 172.21.15.71:58182) 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 -- 172.21.15.71:0/3369985339 learned_addr learned my addr 172.21.15.71:0/3369985339 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbcd9a700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5db80b6100 0x7f5db80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 -- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5db80b6100 msgr2=0x7f5db80caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5db80b6100 0x7f5db80caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 -- 172.21.15.71:0/3369985339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5db815fca0 msgr2=0x7f5db815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5db815fca0 0x7f5db815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 -- 172.21.15.71:0/3369985339 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40094a0 con 0x7f5db80b5c90 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbdd9c700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5db815fca0 0x7f5db815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbd59b700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 0x7f5db80c8cb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009bc0 tx=0x7f5db4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db401a6e0 con 0x7f5db80b5c90 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db401a860 con 0x7f5db80b5c90 2023-07-06T01:09:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.946+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db81f2f70 con 0x7f5db80b5c90 2023-07-06T01:09:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.947+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db401ac10 con 0x7f5db80b5c90 2023-07-06T01:09:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.947+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db80ca290 con 0x7f5db80b5c90 2023-07-06T01:09:27.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.948+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db80ca420 con 0x7f5db80b5c90 2023-07-06T01:09:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.949+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5db4022070 con 0x7f5db80b5c90 2023-07-06T01:09:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.949+0000 7f5dadffb700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5d9c06ace0 0x7f5d9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.950+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5db408a3d0 con 0x7f5db80b5c90 2023-07-06T01:09:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.950+0000 7f5dbcd9a700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5d9c06ace0 0x7f5d9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.950+0000 7f5dbcd9a700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5d9c06ace0 0x7f5d9c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5db815f6b0 tx=0x7f5da8007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:27.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:27.955+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5db4055590 con 0x7f5db80b5c90 2023-07-06T01:09:28.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.148+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5db80008d0 con 0x7f5db80b5c90 2023-07-06T01:09:28.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.151+0000 7f5dadffb700 1 -- 172.21.15.71:0/3369985339 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f5db4058bb0 con 0x7f5db80b5c90 2023-07-06T01:09:28.153 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:28.154 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:28.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5d9c06ace0 msgr2=0x7f5d9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5d9c06ace0 0x7f5d9c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5db815f6b0 tx=0x7f5da8007de0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 msgr2=0x7f5db80c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 0x7f5db80c8cb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009bc0 tx=0x7f5db4004750 comp rx=0 tx=0).stop 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 shutdown_connections 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f5d9c06ace0 0x7f5d9c06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5db815fca0 0x7f5db815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5db80b5c90 0x7f5db80c8cb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 --2- 172.21.15.71:0/3369985339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5db80b6100 0x7f5db80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 >> 172.21.15.71:0/3369985339 conn(0x7f5db806c150 msgr2=0x7f5db80b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:28.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 shutdown_connections 2023-07-06T01:09:28.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.153+0000 7f5dbf7ff700 1 -- 172.21.15.71:0/3369985339 wait complete. 2023-07-06T01:09:28.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:28.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.369+0000 7fea651ff700 1 Processor -- start 2023-07-06T01:09:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.369+0000 7fea651ff700 1 -- start start 2023-07-06T01:09:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea651ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fea6015fca0 0x7fea600d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea651ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fea600b5c90 0x7fea600d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea651ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b6110 0x7fea600d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea651ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600cf780 con 0x7fea600b5c90 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea651ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600cd490 con 0x7fea6015fca0 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea651ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600cd770 con 0x7fea600b6110 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fea600b5c90 0x7fea600d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fea600b5c90 0x7fea600d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47532/0 (socket says 172.21.15.71:47532) 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 -- 172.21.15.71:0/1077693887 learned_addr learned my addr 172.21.15.71:0/1077693887 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea5ed9d700 1 --2- 172.21.15.71:0/1077693887 >> v2:172.21.15.194:3300/0 conn(0x7fea6015fca0 0x7fea600d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea5f59e700 1 --2- 172.21.15.71:0/1077693887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b6110 0x7fea600d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 -- 172.21.15.71:0/1077693887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b6110 msgr2=0x7fea600d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 --2- 172.21.15.71:0/1077693887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b6110 0x7fea600d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 -- 172.21.15.71:0/1077693887 >> v2:172.21.15.194:3300/0 conn(0x7fea6015fca0 msgr2=0x7fea600d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:28.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 --2- 172.21.15.71:0/1077693887 >> v2:172.21.15.194:3300/0 conn(0x7fea6015fca0 0x7fea600d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.371+0000 7fea57fff700 1 -- 172.21.15.71:0/1077693887 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600cda50 con 0x7fea600b5c90 2023-07-06T01:09:28.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea57fff700 1 --2- 172.21.15.71:0/1077693887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b5c90 0x7fea600d2d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea600d0930 tx=0x7fea48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26e39395b276947 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea5e59c700 1 -- 172.21.15.71:0/1077693887 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800b870 con 0x7fea600b5c90 2023-07-06T01:09:28.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea5e59c700 1 -- 172.21.15.71:0/1077693887 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4800b9d0 con 0x7fea600b5c90 2023-07-06T01:09:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea5e59c700 1 -- 172.21.15.71:0/1077693887 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4800bd60 con 0x7fea600b5c90 2023-07-06T01:09:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 -- 172.21.15.71:0/1077693887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b5c90 msgr2=0x7fea600d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 --2- 172.21.15.71:0/1077693887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b5c90 0x7fea600d2d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea600d0930 tx=0x7fea48009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 -- 172.21.15.71:0/1077693887 shutdown_connections 2023-07-06T01:09:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 --2- 172.21.15.71:0/1077693887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b6110 0x7fea600d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 --2- 172.21.15.71:0/1077693887 >> v2:172.21.15.194:3300/0 conn(0x7fea6015fca0 0x7fea600d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 --2- 172.21.15.71:0/1077693887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b5c90 0x7fea600d2d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 -- 172.21.15.71:0/1077693887 >> 172.21.15.71:0/1077693887 conn(0x7fea6006c150 msgr2=0x7fea6006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.372+0000 7fea651ff700 1 -- 172.21.15.71:0/1077693887 shutdown_connections 2023-07-06T01:09:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.373+0000 7fea651ff700 1 -- 172.21.15.71:0/1077693887 wait complete. 2023-07-06T01:09:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.374+0000 7fea651ff700 1 Processor -- start 2023-07-06T01:09:28.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.374+0000 7fea651ff700 1 -- start start 2023-07-06T01:09:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea651ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b5c90 0x7fea6014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea651ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea600b6110 0x7fea601f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea651ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 0x7fea601f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea651ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b4af0 con 0x7fea6015fca0 2023-07-06T01:09:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea651ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea601e6e90 con 0x7fea600b6110 2023-07-06T01:09:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea651ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea601e6bb0 con 0x7fea600b5c90 2023-07-06T01:09:28.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.375+0000 7fea5f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 0x7fea601f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 0x7fea601f3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47536/0 (socket says 172.21.15.71:47536) 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 -- 172.21.15.71:0/2439065160 learned_addr learned my addr 172.21.15.71:0/2439065160 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5ed9d700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b5c90 0x7fea6014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea57fff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea600b6110 0x7fea601f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 -- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b5c90 msgr2=0x7fea6014b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b5c90 0x7fea6014b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 -- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea600b6110 msgr2=0x7fea601f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea600b6110 0x7fea601f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 -- 172.21.15.71:0/2439065160 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48009550 con 0x7fea6015fca0 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea57fff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea600b6110 0x7fea601f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5ed9d700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b5c90 0x7fea6014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea5f59e700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 0x7fea601f3610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea58007e90 tx=0x7fea5800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800eea0 con 0x7fea6015fca0 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58014420 con 0x7fea6015fca0 2023-07-06T01:09:28.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea580147f0 con 0x7fea6015fca0 2023-07-06T01:09:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.376+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea600b44a0 con 0x7fea6015fca0 2023-07-06T01:09:28.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.377+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6014bb30 con 0x7fea6015fca0 2023-07-06T01:09:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.378+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea600b4ca0 con 0x7fea6015fca0 2023-07-06T01:09:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.378+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea58014950 con 0x7fea6015fca0 2023-07-06T01:09:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.379+0000 7fea577fe700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fea4006ad30 0x7fea4006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.379+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea58089c00 con 0x7fea6015fca0 2023-07-06T01:09:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.380+0000 7fea5ed9d700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fea4006ad30 0x7fea4006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.380+0000 7fea5ed9d700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fea4006ad30 0x7fea4006d1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea600b5970 tx=0x7fea50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:28.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.384+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fea600b4ca0 con 0x7fea6015fca0 2023-07-06T01:09:28.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.578+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea600b4ca0 con 0x7fea6015fca0 2023-07-06T01:09:28.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.578+0000 7fea577fe700 1 -- 172.21.15.71:0/2439065160 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea600b4ca0 con 0x7fea6015fca0 2023-07-06T01:09:28.581 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fea4006ad30 msgr2=0x7fea4006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fea4006ad30 0x7fea4006d1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea600b5970 tx=0x7fea50008040 comp rx=0 tx=0).stop 2023-07-06T01:09:28.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 msgr2=0x7fea601f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 0x7fea601f3610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea58007e90 tx=0x7fea5800e3c0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 shutdown_connections 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fea4006ad30 0x7fea4006d1e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea6015fca0 0x7fea601f3610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea600b5c90 0x7fea6014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 --2- 172.21.15.71:0/2439065160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea600b6110 0x7fea601f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.580+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 >> 172.21.15.71:0/2439065160 conn(0x7fea6006c150 msgr2=0x7fea600cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.581+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 shutdown_connections 2023-07-06T01:09:28.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.581+0000 7fea651ff700 1 -- 172.21.15.71:0/2439065160 wait complete. 2023-07-06T01:09:28.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.795+0000 7f1c50dff700 1 Processor -- start 2023-07-06T01:09:28.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.796+0000 7f1c50dff700 1 -- start start 2023-07-06T01:09:28.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c50dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c0b5c90 0x7f1c4c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c50dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1c4c0b60e0 0x7f1c4c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c50dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0cf780 con 0x7f1c4c15fca0 2023-07-06T01:09:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c50dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c0cd490 con 0x7f1c4c0b60e0 2023-07-06T01:09:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c50dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0cd770 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c4a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1c4c15fca0 0x7f1c4c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:43526/0 (socket says 172.21.15.71:43526) 2023-07-06T01:09:28.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c4a59c700 1 -- 172.21.15.71:0/1256463643 learned_addr learned my addr 172.21.15.71:0/1256463643 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c4ad9d700 1 --2- 172.21.15.71:0/1256463643 >> v2:172.21.15.194:3300/0 conn(0x7f1c4c0b60e0 0x7f1c4c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c49d9b700 1 --2- 172.21.15.71:0/1256463643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c0b5c90 0x7f1c4c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c4959a700 1 -- 172.21.15.71:0/1256463643 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470822753 0 0) 0x7f1c4c0cf780 con 0x7f1c4c15fca0 2023-07-06T01:09:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.797+0000 7f1c4959a700 1 -- 172.21.15.71:0/1256463643 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c340035b0 con 0x7f1c4c15fca0 2023-07-06T01:09:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c49d9b700 1 -- 172.21.15.71:0/1256463643 >> v2:172.21.15.194:3300/0 conn(0x7f1c4c0b60e0 msgr2=0x7f1c4c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:28.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c49d9b700 1 --2- 172.21.15.71:0/1256463643 >> v2:172.21.15.194:3300/0 conn(0x7f1c4c0b60e0 0x7f1c4c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c49d9b700 1 -- 172.21.15.71:0/1256463643 >> v1:172.21.15.71:6789/0 conn(0x7f1c4c15fca0 legacy=0x7f1c4c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c49d9b700 1 -- 172.21.15.71:0/1256463643 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0cda50 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c49d9b700 1 --2- 172.21.15.71:0/1256463643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c0b5c90 0x7f1c4c0d2d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009840 tx=0x7f1c40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68fef4d450fcf539 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c4959a700 1 -- 172.21.15.71:0/1256463643 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011830 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c4959a700 1 -- 172.21.15.71:0/1256463643 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c40011990 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.798+0000 7f1c4959a700 1 -- 172.21.15.71:0/1256463643 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011d20 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 -- 172.21.15.71:0/1256463643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c0b5c90 msgr2=0x7f1c4c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1256463643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c0b5c90 0x7f1c4c0d2d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009840 tx=0x7f1c40009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 -- 172.21.15.71:0/1256463643 shutdown_connections 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1256463643 >> v2:172.21.15.194:3300/0 conn(0x7f1c4c0b60e0 0x7f1c4c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1256463643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c0b5c90 0x7f1c4c0d2d40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 -- 172.21.15.71:0/1256463643 >> 172.21.15.71:0/1256463643 conn(0x7f1c4c06c150 msgr2=0x7f1c4c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 -- 172.21.15.71:0/1256463643 shutdown_connections 2023-07-06T01:09:28.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.799+0000 7f1c50dff700 1 -- 172.21.15.71:0/1256463643 wait complete. 2023-07-06T01:09:28.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.801+0000 7f1c50dff700 1 Processor -- start 2023-07-06T01:09:28.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.802+0000 7f1c50dff700 1 -- start start 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c50dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 0x7f1c4c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c50dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c4c0b60e0 0x7f1c4c1e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c50dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c15fca0 0x7f1c4c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c50dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c159410 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c50dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c159660 con 0x7f1c4c0b60e0 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c50dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c159940 con 0x7f1c4c15fca0 2023-07-06T01:09:28.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 0x7f1c4c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 0x7f1c4c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47548/0 (socket says 172.21.15.71:47548) 2023-07-06T01:09:28.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 -- 172.21.15.71:0/1135040111 learned_addr learned my addr 172.21.15.71:0/1135040111 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 -- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c15fca0 msgr2=0x7f1c4c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c15fca0 0x7f1c4c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 -- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c4c0b60e0 msgr2=0x7f1c4c1e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c49d9b700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c4c0b60e0 0x7f1c4c1e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c4c0b60e0 0x7f1c4c1e7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.803+0000 7f1c4a59c700 1 -- 172.21.15.71:0/1135040111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400094a0 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.804+0000 7f1c4a59c700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 0x7f1c4c15a420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c001eb0 tx=0x7f1c3c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.804+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c005d70 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.804+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0070d0 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.804+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c007460 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.804+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c159c20 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.804+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c15a960 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.805+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c15a140 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.806+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c3c0075c0 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.807+0000 7f1c3affd700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1c2c06ace0 0x7f1c2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.807+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c3c0889a0 con 0x7f1c4c0b5c90 2023-07-06T01:09:28.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.807+0000 7f1c49d9b700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1c2c06ace0 0x7f1c2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:28.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.808+0000 7f1c49d9b700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1c2c06ace0 0x7f1c2c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0ccb00 tx=0x7f1c40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:28.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:28.811+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c4c15a140 con 0x7f1c4c0b5c90 2023-07-06T01:09:29.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.006+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c4c15a140 con 0x7f1c4c0b5c90 2023-07-06T01:09:29.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.007+0000 7f1c3affd700 1 -- 172.21.15.71:0/1135040111 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1c4c15a140 con 0x7f1c4c0b5c90 2023-07-06T01:09:29.010 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:29.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1c2c06ace0 msgr2=0x7f1c2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1c2c06ace0 0x7f1c2c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0ccb00 tx=0x7f1c40008030 comp rx=0 tx=0).stop 2023-07-06T01:09:29.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 msgr2=0x7f1c4c15a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 0x7f1c4c15a420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c001eb0 tx=0x7f1c3c00c7e0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 shutdown_connections 2023-07-06T01:09:29.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1c2c06ace0 0x7f1c2c06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c4c15fca0 0x7f1c4c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c4c0b5c90 0x7f1c4c15a420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 --2- 172.21.15.71:0/1135040111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c4c0b60e0 0x7f1c4c1e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 >> 172.21.15.71:0/1135040111 conn(0x7f1c4c06c150 msgr2=0x7f1c4c15ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 shutdown_connections 2023-07-06T01:09:29.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.009+0000 7f1c50dff700 1 -- 172.21.15.71:0/1135040111 wait complete. 2023-07-06T01:09:29.030 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:29.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.224+0000 7ff99cdff700 1 Processor -- start 2023-07-06T01:09:29.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.224+0000 7ff99cdff700 1 -- start start 2023-07-06T01:09:29.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff99cdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9980b5c90 0x7ff9980d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff99cdff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff9980b6110 0x7ff9980d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff99cdff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980cf780 con 0x7ff99815fca0 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff99cdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980cd490 con 0x7ff9980b5c90 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff99cdff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980cd770 con 0x7ff9980b6110 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9980b5c90 0x7ff9980d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff9980b5c90 0x7ff9980d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47560/0 (socket says 172.21.15.71:47560) 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 -- 172.21.15.71:0/1286739780 learned_addr learned my addr 172.21.15.71:0/1286739780 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:29.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff996d9d700 1 --2- 172.21.15.71:0/1286739780 >> v2:172.21.15.194:3300/0 conn(0x7ff9980b6110 0x7ff9980d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 -- 172.21.15.71:0/1286739780 >> v2:172.21.15.194:3300/0 conn(0x7ff9980b6110 msgr2=0x7ff9980d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:29.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 --2- 172.21.15.71:0/1286739780 >> v2:172.21.15.194:3300/0 conn(0x7ff9980b6110 0x7ff9980d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 -- 172.21.15.71:0/1286739780 >> v1:172.21.15.194:6789/0 conn(0x7ff99815fca0 legacy=0x7ff9980d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff98ffff700 1 -- 172.21.15.71:0/1286739780 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9980cda50 con 0x7ff9980b5c90 2023-07-06T01:09:29.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.226+0000 7ff996d9d700 1 --2- 172.21.15.71:0/1286739780 >> v2:172.21.15.194:3300/0 conn(0x7ff9980b6110 0x7ff9980d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:29.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff98ffff700 1 --2- 172.21.15.71:0/1286739780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9980b5c90 0x7ff9980d2d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9980cd410 tx=0x7ff980009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aee025493fe4733 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff995d9b700 1 -- 172.21.15.71:0/1286739780 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000b870 con 0x7ff9980b5c90 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff995d9b700 1 -- 172.21.15.71:0/1286739780 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000b9d0 con 0x7ff9980b5c90 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff995d9b700 1 -- 172.21.15.71:0/1286739780 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000bd60 con 0x7ff9980b5c90 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 -- 172.21.15.71:0/1286739780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9980b5c90 msgr2=0x7ff9980d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 --2- 172.21.15.71:0/1286739780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9980b5c90 0x7ff9980d2d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9980cd410 tx=0x7ff980009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 -- 172.21.15.71:0/1286739780 shutdown_connections 2023-07-06T01:09:29.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 --2- 172.21.15.71:0/1286739780 >> v2:172.21.15.194:3300/0 conn(0x7ff9980b6110 0x7ff9980d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 --2- 172.21.15.71:0/1286739780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9980b5c90 0x7ff9980d2d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 -- 172.21.15.71:0/1286739780 >> 172.21.15.71:0/1286739780 conn(0x7ff99806c150 msgr2=0x7ff99806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 -- 172.21.15.71:0/1286739780 shutdown_connections 2023-07-06T01:09:29.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.227+0000 7ff99cdff700 1 -- 172.21.15.71:0/1286739780 wait complete. 2023-07-06T01:09:29.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.229+0000 7ff99cdff700 1 Processor -- start 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.229+0000 7ff99cdff700 1 -- start start 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff99cdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9980b5c90 0x7ff9980cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff99cdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9980b6110 0x7ff9981577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff99cdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 0x7ff9980c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff99cdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980ca3e0 con 0x7ff99815fca0 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff99cdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff998157d20 con 0x7ff9980b6110 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff99cdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981f3120 con 0x7ff9980b5c90 2023-07-06T01:09:29.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.230+0000 7ff996d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 0x7ff9980c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 0x7ff9980c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47574/0 (socket says 172.21.15.71:47574) 2023-07-06T01:09:29.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 -- 172.21.15.71:0/3006908913 learned_addr learned my addr 172.21.15.71:0/3006908913 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:29.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff99659c700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9980b5c90 0x7ff9980cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff98ffff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9980b6110 0x7ff9981577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 -- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9980b5c90 msgr2=0x7ff9980cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9980b5c90 0x7ff9980cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 -- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9980b6110 msgr2=0x7ff9981577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9980b6110 0x7ff9981577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 -- 172.21.15.71:0/3006908913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980009550 con 0x7ff99815fca0 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff996d9d700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 0x7ff9980c7310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff990007ef0 tx=0x7ff99000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99000dd80 con 0x7ff99815fca0 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99000f040 con 0x7ff99815fca0 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990003c60 con 0x7ff99815fca0 2023-07-06T01:09:29.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.231+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9980c80c0 con 0x7ff99815fca0 2023-07-06T01:09:29.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.232+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9980c7850 con 0x7ff99815fca0 2023-07-06T01:09:29.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.233+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9980008d0 con 0x7ff99815fca0 2023-07-06T01:09:29.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.234+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff990004030 con 0x7ff99815fca0 2023-07-06T01:09:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.234+0000 7ff98effd700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff97806ace0 0x7ff97806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.235+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff990089490 con 0x7ff99815fca0 2023-07-06T01:09:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.235+0000 7ff99659c700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff97806ace0 0x7ff97806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.236+0000 7ff99659c700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff97806ace0 0x7ff97806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9980cbf00 tx=0x7ff988009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:29.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.239+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff9900545d0 con 0x7ff99815fca0 2023-07-06T01:09:29.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.435+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff99815f4c0 con 0x7ff99815fca0 2023-07-06T01:09:29.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.435+0000 7ff98effd700 1 -- 172.21.15.71:0/3006908913 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff990057bf0 con 0x7ff99815fca0 2023-07-06T01:09:29.438 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.437+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff97806ace0 msgr2=0x7ff97806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.437+0000 7ff99cdff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff97806ace0 0x7ff97806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9980cbf00 tx=0x7ff988009040 comp rx=0 tx=0).stop 2023-07-06T01:09:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.437+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 msgr2=0x7ff9980c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.437+0000 7ff99cdff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 0x7ff9980c7310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff990007ef0 tx=0x7ff99000d3b0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 shutdown_connections 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff97806ace0 0x7ff97806d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff99815fca0 0x7ff9980c7310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9980b5c90 0x7ff9980cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 --2- 172.21.15.71:0/3006908913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9980b6110 0x7ff9981577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 >> 172.21.15.71:0/3006908913 conn(0x7ff99806c150 msgr2=0x7ff9980b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:29.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 shutdown_connections 2023-07-06T01:09:29.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.438+0000 7ff99cdff700 1 -- 172.21.15.71:0/3006908913 wait complete. 2023-07-06T01:09:29.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.654+0000 7f8b15bff700 1 Processor -- start 2023-07-06T01:09:29.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.654+0000 7f8b15bff700 1 -- start start 2023-07-06T01:09:29.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b15bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8b1015fca0 0x7f8b100d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b15bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8b100b6110 0x7f8b100cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b15bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100cf780 con 0x7f8b100b5c90 2023-07-06T01:09:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b15bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100cd490 con 0x7f8b1015fca0 2023-07-06T01:09:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b15bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100cd770 con 0x7f8b100b6110 2023-07-06T01:09:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b0f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8b1015fca0 0x7f8b100d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b0f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8b1015fca0 0x7f8b100d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47580/0 (socket says 172.21.15.71:47580) 2023-07-06T01:09:29.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.655+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/61519142 learned_addr learned my addr 172.21.15.71:0/61519142 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/61519142 >> v2:172.21.15.194:3300/0 conn(0x7f8b100b6110 0x7f8b100cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/61519142 >> v2:172.21.15.194:3300/0 conn(0x7f8b100b6110 msgr2=0x7f8b100cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/61519142 >> v2:172.21.15.194:3300/0 conn(0x7f8b100b6110 0x7f8b100cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/61519142 >> v1:172.21.15.71:6789/0 conn(0x7f8b100b5c90 legacy=0x7f8b100d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0f7fe700 1 -- 172.21.15.71:0/61519142 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100cda50 con 0x7f8b1015fca0 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/61519142 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134126485 0 0) 0x7f8b100cf780 con 0x7f8b100b5c90 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/61519142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1015fca0 0x7f8b100d1420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b100cd410 tx=0x7f8b00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1454c02b3f0033f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/61519142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000b870 con 0x7f8b1015fca0 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/61519142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0000b9d0 con 0x7f8b1015fca0 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.656+0000 7f8b0e7fc700 1 -- 172.21.15.71:0/61519142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0000bd60 con 0x7f8b1015fca0 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 -- 172.21.15.71:0/61519142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1015fca0 msgr2=0x7f8b100d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 --2- 172.21.15.71:0/61519142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1015fca0 0x7f8b100d1420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8b100cd410 tx=0x7f8b00009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 -- 172.21.15.71:0/61519142 shutdown_connections 2023-07-06T01:09:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 --2- 172.21.15.71:0/61519142 >> v2:172.21.15.194:3300/0 conn(0x7f8b100b6110 0x7f8b100cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 --2- 172.21.15.71:0/61519142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b1015fca0 0x7f8b100d1420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 -- 172.21.15.71:0/61519142 >> 172.21.15.71:0/61519142 conn(0x7f8b1006c150 msgr2=0x7f8b1006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 -- 172.21.15.71:0/61519142 shutdown_connections 2023-07-06T01:09:29.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.657+0000 7f8b15bff700 1 -- 172.21.15.71:0/61519142 wait complete. 2023-07-06T01:09:29.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.659+0000 7f8b15bff700 1 Processor -- start 2023-07-06T01:09:29.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.659+0000 7f8b15bff700 1 -- start start 2023-07-06T01:09:29.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b15bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b100b5c90 0x7f8b101e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b15bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 0x7f8b101596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b15bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b1015fca0 0x7f8b100c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b15bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c7f20 con 0x7f8b100b6110 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b15bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c6e50 con 0x7f8b1015fca0 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b15bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100c70d0 con 0x7f8b100b5c90 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 0x7f8b101596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 0x7f8b101596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47592/0 (socket says 172.21.15.71:47592) 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 -- 172.21.15.71:0/1242190600 learned_addr learned my addr 172.21.15.71:0/1242190600 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:29.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b1015fca0 0x7f8b100c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b100b5c90 0x7f8b101e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 -- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b100b5c90 msgr2=0x7f8b101e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b100b5c90 0x7f8b101e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 -- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b1015fca0 msgr2=0x7f8b100c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b1015fca0 0x7f8b100c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0effd700 1 -- 172.21.15.71:0/1242190600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00009550 con 0x7f8b100b6110 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.660+0000 7f8b0ffff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b1015fca0 0x7f8b100c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:29.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.661+0000 7f8b0effd700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 0x7f8b101596f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c750 tx=0x7f8b0400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.661+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040054e0 con 0x7f8b100b6110 2023-07-06T01:09:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.661+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04003680 con 0x7f8b100b6110 2023-07-06T01:09:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.661+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b100c73b0 con 0x7f8b100b6110 2023-07-06T01:09:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.661+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04003a30 con 0x7f8b100b6110 2023-07-06T01:09:29.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.661+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100c7970 con 0x7f8b100b6110 2023-07-06T01:09:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.662+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100c8090 con 0x7f8b100b6110 2023-07-06T01:09:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.663+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b04003b90 con 0x7f8b100b6110 2023-07-06T01:09:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.664+0000 7f8af7fff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8afc06ace0 0x7f8afc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.664+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b040888c0 con 0x7f8b100b6110 2023-07-06T01:09:29.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.664+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8afc06ace0 0x7f8afc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:29.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.665+0000 7f8b0f7fe700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8afc06ace0 0x7f8afc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8b00014040 tx=0x7f8b00008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:29.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.668+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b100c8090 con 0x7f8b100b6110 2023-07-06T01:09:29.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.865+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b100c8060 con 0x7f8b100b6110 2023-07-06T01:09:29.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.865+0000 7f8af7fff700 1 -- 172.21.15.71:0/1242190600 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b040170a0 con 0x7f8b100b6110 2023-07-06T01:09:29.868 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:29.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.867+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8afc06ace0 msgr2=0x7f8afc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.867+0000 7f8b15bff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8afc06ace0 0x7f8afc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8b00014040 tx=0x7f8b00008030 comp rx=0 tx=0).stop 2023-07-06T01:09:29.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.867+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 msgr2=0x7f8b101596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:29.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.867+0000 7f8b15bff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 0x7f8b101596f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c750 tx=0x7f8b0400ca60 comp rx=0 tx=0).stop 2023-07-06T01:09:29.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 shutdown_connections 2023-07-06T01:09:29.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8afc06ace0 0x7f8afc06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b1015fca0 0x7f8b100c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b100b5c90 0x7f8b101e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 --2- 172.21.15.71:0/1242190600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b100b6110 0x7f8b101596f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:29.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 >> 172.21.15.71:0/1242190600 conn(0x7f8b1006c150 msgr2=0x7f8b100b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:29.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 shutdown_connections 2023-07-06T01:09:29.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:29.868+0000 7f8b15bff700 1 -- 172.21.15.71:0/1242190600 wait complete. 2023-07-06T01:09:29.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:30.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.080+0000 7f6532bff700 1 Processor -- start 2023-07-06T01:09:30.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.080+0000 7f6532bff700 1 -- start start 2023-07-06T01:09:30.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f6532bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f652c15fca0 0x7f652c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f6532bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b5c90 0x7f652c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f6532bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f652c0b60e0 0x7f652c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f6532bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c0cf780 con 0x7f652c15fca0 2023-07-06T01:09:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f6532bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c0cd490 con 0x7f652c0b60e0 2023-07-06T01:09:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f6532bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0cd770 con 0x7f652c0b5c90 2023-07-06T01:09:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.081+0000 7f653099b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f652c15fca0 0x7f652c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f652c15fca0 0x7f652c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47596/0 (socket says 172.21.15.71:47596) 2023-07-06T01:09:30.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 -- 172.21.15.71:0/3106993571 learned_addr learned my addr 172.21.15.71:0/3106993571 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653119c700 1 --2- 172.21.15.71:0/3106993571 >> v2:172.21.15.194:3300/0 conn(0x7f652c0b60e0 0x7f652c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f652bfff700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b5c90 0x7f652c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 -- 172.21.15.71:0/3106993571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b5c90 msgr2=0x7f652c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b5c90 0x7f652c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 -- 172.21.15.71:0/3106993571 >> v2:172.21.15.194:3300/0 conn(0x7f652c0b60e0 msgr2=0x7f652c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 --2- 172.21.15.71:0/3106993571 >> v2:172.21.15.194:3300/0 conn(0x7f652c0b60e0 0x7f652c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 -- 172.21.15.71:0/3106993571 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0cda50 con 0x7f652c15fca0 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653119c700 1 --2- 172.21.15.71:0/3106993571 >> v2:172.21.15.194:3300/0 conn(0x7f652c0b60e0 0x7f652c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:30.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f652bfff700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b5c90 0x7f652c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f653099b700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0d1420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f652c0b8f80 tx=0x7f6520009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e56d24e92ce5af server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.082+0000 7f652b7fe700 1 -- 172.21.15.71:0/3106993571 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000b870 con 0x7f652c15fca0 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f652b7fe700 1 -- 172.21.15.71:0/3106993571 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652000b9d0 con 0x7f652c15fca0 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f652b7fe700 1 -- 172.21.15.71:0/3106993571 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652000bd60 con 0x7f652c15fca0 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 -- 172.21.15.71:0/3106993571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 msgr2=0x7f652c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0d1420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f652c0b8f80 tx=0x7f6520009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 -- 172.21.15.71:0/3106993571 shutdown_connections 2023-07-06T01:09:30.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 --2- 172.21.15.71:0/3106993571 >> v2:172.21.15.194:3300/0 conn(0x7f652c0b60e0 0x7f652c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0d1420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 --2- 172.21.15.71:0/3106993571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b5c90 0x7f652c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 -- 172.21.15.71:0/3106993571 >> 172.21.15.71:0/3106993571 conn(0x7f652c06c150 msgr2=0x7f652c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 -- 172.21.15.71:0/3106993571 shutdown_connections 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.083+0000 7f6532bff700 1 -- 172.21.15.71:0/3106993571 wait complete. 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.085+0000 7f6532bff700 1 Processor -- start 2023-07-06T01:09:30.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.085+0000 7f6532bff700 1 -- start start 2023-07-06T01:09:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f6532bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f652c0b5c90 0x7f652c1f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f6532bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b60e0 0x7f652c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f6532bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f6532bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c1578f0 con 0x7f652c15fca0 2023-07-06T01:09:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f6532bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0b3720 con 0x7f652c0b5c90 2023-07-06T01:09:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f6532bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0b28c0 con 0x7f652c0b60e0 2023-07-06T01:09:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.086+0000 7f653119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47610/0 (socket says 172.21.15.71:47610) 2023-07-06T01:09:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 -- 172.21.15.71:0/3639721369 learned_addr learned my addr 172.21.15.71:0/3639721369 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653099b700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f652c0b5c90 0x7f652c1f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f652bfff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b60e0 0x7f652c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 -- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b60e0 msgr2=0x7f652c1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b60e0 0x7f652c1573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 -- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f652c0b5c90 msgr2=0x7f652c1f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f652c0b5c90 0x7f652c1f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 -- 172.21.15.71:0/3639721369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6520009550 con 0x7f652c15fca0 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f653119c700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0b41c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f652400ce80 tx=0x7f652400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400ad40 con 0x7f652c15fca0 2023-07-06T01:09:30.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6524015440 con 0x7f652c15fca0 2023-07-06T01:09:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c0b2ba0 con 0x7f652c15fca0 2023-07-06T01:09:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.087+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400aea0 con 0x7f652c15fca0 2023-07-06T01:09:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.088+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c0b3160 con 0x7f652c15fca0 2023-07-06T01:09:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.089+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c0008d0 con 0x7f652c15fca0 2023-07-06T01:09:30.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.090+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f652400d430 con 0x7f652c15fca0 2023-07-06T01:09:30.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.091+0000 7f65297fa700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f651006ace0 0x7f651006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.091+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6524089900 con 0x7f652c15fca0 2023-07-06T01:09:30.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.091+0000 7f653099b700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f651006ace0 0x7f651006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.092+0000 7f653099b700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f651006ace0 0x7f651006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6520014040 tx=0x7f6520008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.095+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f65240549b0 con 0x7f652c15fca0 2023-07-06T01:09:30.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.292+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f652c0b6c80 con 0x7f652c15fca0 2023-07-06T01:09:30.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.294+0000 7f65297fa700 1 -- 172.21.15.71:0/3639721369 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f652401a090 con 0x7f652c15fca0 2023-07-06T01:09:30.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:30.297 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:08:52.542849+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f651006ace0 msgr2=0x7f651006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f651006ace0 0x7f651006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6520014040 tx=0x7f6520008030 comp rx=0 tx=0).stop 2023-07-06T01:09:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 msgr2=0x7f652c0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0b41c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f652400ce80 tx=0x7f652400ceb0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 shutdown_connections 2023-07-06T01:09:30.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f651006ace0 0x7f651006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f652c15fca0 0x7f652c0b41c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f652c0b5c90 0x7f652c1f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 --2- 172.21.15.71:0/3639721369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652c0b60e0 0x7f652c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 >> 172.21.15.71:0/3639721369 conn(0x7f652c06c150 msgr2=0x7f652c0b86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 shutdown_connections 2023-07-06T01:09:30.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.296+0000 7f6532bff700 1 -- 172.21.15.71:0/3639721369 wait complete. 2023-07-06T01:09:30.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:30.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.522+0000 7fbea81ff700 1 Processor -- start 2023-07-06T01:09:30.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.522+0000 7fbea81ff700 1 -- start start 2023-07-06T01:09:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00b3660 0x7fbea00d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea81ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbea00d0f10 0x7fbea00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea81ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea00d1370 con 0x7fbea00b8920 2023-07-06T01:09:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea81ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea015cea0 con 0x7fbea00d0f10 2023-07-06T01:09:30.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00b00a0 con 0x7fbea00b3660 2023-07-06T01:09:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbea00d0f10 0x7fbea00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea679c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbea00d0f10 0x7fbea00b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47616/0 (socket says 172.21.15.71:47616) 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea679c700 1 -- 172.21.15.71:0/3950508168 learned_addr learned my addr 172.21.15.71:0/3950508168 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.523+0000 7fbea579a700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00b3660 0x7fbea00d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea679c700 1 -- 172.21.15.71:0/3950508168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00b3660 msgr2=0x7fbea00d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea679c700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00b3660 0x7fbea00d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea679c700 1 -- 172.21.15.71:0/3950508168 >> v1:172.21.15.194:6789/0 conn(0x7fbea00b8920 legacy=0x7fbea00af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea679c700 1 -- 172.21.15.71:0/3950508168 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00b8cf0 con 0x7fbea00d0f10 2023-07-06T01:09:30.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea579a700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00b3660 0x7fbea00d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea679c700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00d0f10 0x7fbea00b13a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe980098f0 tx=0x7fbe98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e894fa55f72e1f91 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea4f99700 1 -- 172.21.15.71:0/3950508168 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800b8a0 con 0x7fbea00d0f10 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea4f99700 1 -- 172.21.15.71:0/3950508168 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800ba00 con 0x7fbea00d0f10 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.524+0000 7fbea4f99700 1 -- 172.21.15.71:0/3950508168 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800bd90 con 0x7fbea00d0f10 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 -- 172.21.15.71:0/3950508168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00d0f10 msgr2=0x7fbea00b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00d0f10 0x7fbea00b13a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe980098f0 tx=0x7fbe98009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:30.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 -- 172.21.15.71:0/3950508168 shutdown_connections 2023-07-06T01:09:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00d0f10 0x7fbea00b13a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 --2- 172.21.15.71:0/3950508168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00b3660 0x7fbea00d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 -- 172.21.15.71:0/3950508168 >> 172.21.15.71:0/3950508168 conn(0x7fbea009c130 msgr2=0x7fbea00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 -- 172.21.15.71:0/3950508168 shutdown_connections 2023-07-06T01:09:30.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.525+0000 7fbea81ff700 1 -- 172.21.15.71:0/3950508168 wait complete. 2023-07-06T01:09:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.527+0000 7fbea81ff700 1 Processor -- start 2023-07-06T01:09:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.527+0000 7fbea81ff700 1 -- start start 2023-07-06T01:09:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea81ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea00b3660 0x7fbea014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea81ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 0x7fbea00b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00d0f10 0x7fbea00b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea81ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea014a3f0 con 0x7fbea00b8920 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea81ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea01497e0 con 0x7fbea00b3660 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0149ac0 con 0x7fbea00d0f10 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 0x7fbea00b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 0x7fbea00b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47630/0 (socket says 172.21.15.71:47630) 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 -- 172.21.15.71:0/1726774227 learned_addr learned my addr 172.21.15.71:0/1726774227 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea679c700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00d0f10 0x7fbea00b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea5f9b700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea00b3660 0x7fbea014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 -- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00d0f10 msgr2=0x7fbea00b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00d0f10 0x7fbea00b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 -- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea00b3660 msgr2=0x7fbea014cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea00b3660 0x7fbea014cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea579a700 1 -- 172.21.15.71:0/1726774227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009550 con 0x7fbea00b8920 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.528+0000 7fbea679c700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00d0f10 0x7fbea00b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.529+0000 7fbea579a700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 0x7fbea00b4e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000e810 tx=0x7fbe9000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.529+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90004230 con 0x7fbea00b8920 2023-07-06T01:09:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.529+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe90004390 con 0x7fbea00b8920 2023-07-06T01:09:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.529+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea0149da0 con 0x7fbea00b8920 2023-07-06T01:09:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.529+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe900036a0 con 0x7fbea00b8920 2023-07-06T01:09:30.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.529+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea00b4220 con 0x7fbea00b8920 2023-07-06T01:09:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.530+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea004eb90 con 0x7fbea00b8920 2023-07-06T01:09:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.531+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe90003800 con 0x7fbea00b8920 2023-07-06T01:09:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.532+0000 7fbe967fc700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbe8406ace0 0x7fbe8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.532+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe90088fc0 con 0x7fbea00b8920 2023-07-06T01:09:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.533+0000 7fbea5f9b700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbe8406ace0 0x7fbe8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.533+0000 7fbea5f9b700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbe8406ace0 0x7fbe8406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c001330 tx=0x7fbe9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.536+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe90054070 con 0x7fbea00b8920 2023-07-06T01:09:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.734+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbea014a530 con 0x7fbea00b8920 2023-07-06T01:09:30.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.734+0000 7fbe967fc700 1 -- 172.21.15.71:0/1726774227 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbea014a530 con 0x7fbea00b8920 2023-07-06T01:09:30.737 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:30.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbe8406ace0 msgr2=0x7fbe8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbe8406ace0 0x7fbe8406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c001330 tx=0x7fbe9c009040 comp rx=0 tx=0).stop 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 msgr2=0x7fbea00b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 0x7fbea00b4e00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000e810 tx=0x7fbe9000ebd0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 shutdown_connections 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbe8406ace0 0x7fbe8406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea00d0f10 0x7fbea00b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea00b3660 0x7fbea014cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 --2- 172.21.15.71:0/1726774227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbea00b8920 0x7fbea00b4e00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 >> 172.21.15.71:0/1726774227 conn(0x7fbea009c130 msgr2=0x7fbea00b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 shutdown_connections 2023-07-06T01:09:30.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.737+0000 7fbea81ff700 1 -- 172.21.15.71:0/1726774227 wait complete. 2023-07-06T01:09:30.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.955+0000 7ff8b73ff700 1 Processor -- start 2023-07-06T01:09:30.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.956+0000 7ff8b73ff700 1 -- start start 2023-07-06T01:09:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b73ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff8b015fca0 0x7ff8b00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b73ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff8b00b6110 0x7ff8b00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b73ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00cf780 con 0x7ff8b00b5c90 2023-07-06T01:09:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b73ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00cd490 con 0x7ff8b00b6110 2023-07-06T01:09:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b73ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00cd770 con 0x7ff8b015fca0 2023-07-06T01:09:30.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff8b00b6110 0x7ff8b00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff8b00b6110 0x7ff8b00cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47632/0 (socket says 172.21.15.71:47632) 2023-07-06T01:09:30.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 -- 172.21.15.71:0/1995458432 learned_addr learned my addr 172.21.15.71:0/1995458432 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:30.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b519b700 1 --2- 172.21.15.71:0/1995458432 >> v2:172.21.15.194:3300/0 conn(0x7ff8b015fca0 0x7ff8b00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 -- 172.21.15.71:0/1995458432 >> v2:172.21.15.194:3300/0 conn(0x7ff8b015fca0 msgr2=0x7ff8b00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:30.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 --2- 172.21.15.71:0/1995458432 >> v2:172.21.15.194:3300/0 conn(0x7ff8b015fca0 0x7ff8b00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 -- 172.21.15.71:0/1995458432 >> v1:172.21.15.194:6789/0 conn(0x7ff8b00b5c90 legacy=0x7ff8b00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:30.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.957+0000 7ff8b599c700 1 -- 172.21.15.71:0/1995458432 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00cda50 con 0x7ff8b00b6110 2023-07-06T01:09:30.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b599c700 1 --2- 172.21.15.71:0/1995458432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b00b6110 0x7ff8b00cfc10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00d0930 tx=0x7ff8a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce545f45d127c05e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8a7fff700 1 -- 172.21.15.71:0/1995458432 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800e070 con 0x7ff8b00b6110 2023-07-06T01:09:30.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8a7fff700 1 -- 172.21.15.71:0/1995458432 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8003a20 con 0x7ff8b00b6110 2023-07-06T01:09:30.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8a7fff700 1 -- 172.21.15.71:0/1995458432 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8003dd0 con 0x7ff8b00b6110 2023-07-06T01:09:30.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b73ff700 1 -- 172.21.15.71:0/1995458432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b00b6110 msgr2=0x7ff8b00cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/1995458432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b00b6110 0x7ff8b00cfc10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00d0930 tx=0x7ff8a800b330 comp rx=0 tx=0).stop 2023-07-06T01:09:30.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b73ff700 1 -- 172.21.15.71:0/1995458432 shutdown_connections 2023-07-06T01:09:30.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/1995458432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b00b6110 0x7ff8b00cfc10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/1995458432 >> v2:172.21.15.194:3300/0 conn(0x7ff8b015fca0 0x7ff8b00d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.958+0000 7ff8b73ff700 1 -- 172.21.15.71:0/1995458432 >> 172.21.15.71:0/1995458432 conn(0x7ff8b006c150 msgr2=0x7ff8b006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:30.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.959+0000 7ff8b73ff700 1 -- 172.21.15.71:0/1995458432 shutdown_connections 2023-07-06T01:09:30.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.959+0000 7ff8b73ff700 1 -- 172.21.15.71:0/1995458432 wait complete. 2023-07-06T01:09:30.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.961+0000 7ff8b73ff700 1 Processor -- start 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.961+0000 7ff8b73ff700 1 -- start start 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.962+0000 7ff8b73ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8b00b5c90 0x7ff8b01e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.962+0000 7ff8b73ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8b00b6110 0x7ff8b00cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.962+0000 7ff8b73ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 0x7ff8b0153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.962+0000 7ff8b73ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0153b60 con 0x7ff8b015fca0 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.962+0000 7ff8b73ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01e6ff0 con 0x7ff8b00b5c90 2023-07-06T01:09:30.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.962+0000 7ff8b73ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00c6ff0 con 0x7ff8b00b6110 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 0x7ff8b0153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 0x7ff8b0153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47634/0 (socket says 172.21.15.71:47634) 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 -- 172.21.15.71:0/2515433148 learned_addr learned my addr 172.21.15.71:0/2515433148 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b499a700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8b00b6110 0x7ff8b00cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b519b700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8b00b5c90 0x7ff8b01e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 -- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8b00b6110 msgr2=0x7ff8b00cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8b00b6110 0x7ff8b00cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 -- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8b00b5c90 msgr2=0x7ff8b01e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8b00b5c90 0x7ff8b01e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 -- 172.21.15.71:0/2515433148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009b30 con 0x7ff8b015fca0 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b519b700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8b00b5c90 0x7ff8b01e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.963+0000 7ff8b599c700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 0x7ff8b0153620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b370 tx=0x7ff8a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.964+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8004440 con 0x7ff8b015fca0 2023-07-06T01:09:30.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.964+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80045c0 con 0x7ff8b015fca0 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.964+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b00c72d0 con 0x7ff8b015fca0 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.964+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8004970 con 0x7ff8b015fca0 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.964+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b00c6c10 con 0x7ff8b015fca0 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.965+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b00c6e60 con 0x7ff8b015fca0 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.966+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8a8012430 con 0x7ff8b015fca0 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.967+0000 7ff8a5ffb700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff89406ace0 0x7ff89406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:30.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.967+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8a808a880 con 0x7ff8b015fca0 2023-07-06T01:09:30.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.967+0000 7ff8b519b700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff89406ace0 0x7ff89406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:30.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.968+0000 7ff8b519b700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff89406ace0 0x7ff89406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac007a50 tx=0x7ff8ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:30.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:30.971+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8a80593b0 con 0x7ff8b015fca0 2023-07-06T01:09:31.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.164+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff8b00008d0 con 0x7ff8b015fca0 2023-07-06T01:09:31.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.164+0000 7ff8a5ffb700 1 -- 172.21.15.71:0/2515433148 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff8a8058f40 con 0x7ff8b015fca0 2023-07-06T01:09:31.167 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:31.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.166+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff89406ace0 msgr2=0x7ff89406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.166+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff89406ace0 0x7ff89406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac007a50 tx=0x7ff8ac008040 comp rx=0 tx=0).stop 2023-07-06T01:09:31.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 msgr2=0x7ff8b0153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 0x7ff8b0153620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b370 tx=0x7ff8a8004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 shutdown_connections 2023-07-06T01:09:31.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff89406ace0 0x7ff89406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8b015fca0 0x7ff8b0153620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8b00b5c90 0x7ff8b01e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 --2- 172.21.15.71:0/2515433148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8b00b6110 0x7ff8b00cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 >> 172.21.15.71:0/2515433148 conn(0x7ff8b006c150 msgr2=0x7ff8b00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:31.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 shutdown_connections 2023-07-06T01:09:31.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.167+0000 7ff8b73ff700 1 -- 172.21.15.71:0/2515433148 wait complete. 2023-07-06T01:09:31.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:31.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.381+0000 7ff8abfff700 1 Processor -- start 2023-07-06T01:09:31.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.381+0000 7ff8abfff700 1 -- start start 2023-07-06T01:09:31.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8abfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff8a40b3660 0x7ff8a40d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8abfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40b00a0 con 0x7ff8a40d0f10 2023-07-06T01:09:31.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8abfff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40b8cf0 con 0x7ff8a40b8920 2023-07-06T01:09:31.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8abfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a415cea0 con 0x7ff8a40b3660 2023-07-06T01:09:31.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a959a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff8a40b3660 0x7ff8a40d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a959a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff8a40b3660 0x7ff8a40d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47648/0 (socket says 172.21.15.71:47648) 2023-07-06T01:09:31.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a959a700 1 -- 172.21.15.71:0/3954038462 learned_addr learned my addr 172.21.15.71:0/3954038462 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:31.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a959a700 1 -- 172.21.15.71:0/3954038462 >> v1:172.21.15.194:6789/0 conn(0x7ff8a40b8920 legacy=0x7ff8a40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a959a700 1 -- 172.21.15.71:0/3954038462 >> v1:172.21.15.71:6789/0 conn(0x7ff8a40d0f10 legacy=0x7ff8a40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a959a700 1 -- 172.21.15.71:0/3954038462 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40d1310 con 0x7ff8a40b3660 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.383+0000 7ff8a8d99700 1 -- 172.21.15.71:0/3954038462 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045125836 0 0) 0x7ff8a40b00a0 con 0x7ff8a40d0f10 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.384+0000 7ff8a959a700 1 --2- 172.21.15.71:0/3954038462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40b3660 0x7ff8a40d09d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8940098f0 tx=0x7ff894009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76293ad1410803c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.384+0000 7ff8a8d99700 1 -- 172.21.15.71:0/3954038462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400b8a0 con 0x7ff8a40b3660 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.384+0000 7ff8a8d99700 1 -- 172.21.15.71:0/3954038462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400ba00 con 0x7ff8a40b3660 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.384+0000 7ff8a8d99700 1 -- 172.21.15.71:0/3954038462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bd90 con 0x7ff8a40b3660 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.384+0000 7ff8abfff700 1 -- 172.21.15.71:0/3954038462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40b3660 msgr2=0x7ff8a40d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.384+0000 7ff8abfff700 1 --2- 172.21.15.71:0/3954038462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40b3660 0x7ff8a40d09d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8940098f0 tx=0x7ff894009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.385+0000 7ff8abfff700 1 -- 172.21.15.71:0/3954038462 shutdown_connections 2023-07-06T01:09:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.385+0000 7ff8abfff700 1 --2- 172.21.15.71:0/3954038462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40b3660 0x7ff8a40d09d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.385+0000 7ff8abfff700 1 -- 172.21.15.71:0/3954038462 >> 172.21.15.71:0/3954038462 conn(0x7ff8a409c130 msgr2=0x7ff8a40d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.385+0000 7ff8abfff700 1 -- 172.21.15.71:0/3954038462 shutdown_connections 2023-07-06T01:09:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.385+0000 7ff8abfff700 1 -- 172.21.15.71:0/3954038462 wait complete. 2023-07-06T01:09:31.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.386+0000 7ff8abfff700 1 Processor -- start 2023-07-06T01:09:31.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.386+0000 7ff8abfff700 1 -- start start 2023-07-06T01:09:31.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.387+0000 7ff8abfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a40b3660 0x7ff8a41f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.387+0000 7ff8abfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8a40b8920 0x7ff8a40c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.387+0000 7ff8abfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 0x7ff8a41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.387+0000 7ff8abfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4157240 con 0x7ff8a40d0f10 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.387+0000 7ff8abfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a4156ef0 con 0x7ff8a40b3660 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.387+0000 7ff8abfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a415bae0 con 0x7ff8a40b8920 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 0x7ff8a41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 0x7ff8a41598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47660/0 (socket says 172.21.15.71:47660) 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 -- 172.21.15.71:0/1636009718 learned_addr learned my addr 172.21.15.71:0/1636009718 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:31.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8a959a700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8a40b8920 0x7ff8a40c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8a9d9b700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a40b3660 0x7ff8a41f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 -- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8a40b8920 msgr2=0x7ff8a40c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8a40b8920 0x7ff8a40c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 -- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a40b3660 msgr2=0x7ff8a41f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a40b3660 0x7ff8a41f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 -- 172.21.15.71:0/1636009718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894009550 con 0x7ff8a40d0f10 2023-07-06T01:09:31.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8a959a700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8a40b8920 0x7ff8a40c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:31.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff8aa59c700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 0x7ff8a41598b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001560 tx=0x7ff89c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:31.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.388+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c003e30 con 0x7ff8a40d0f10 2023-07-06T01:09:31.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.389+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c005070 con 0x7ff8a40d0f10 2023-07-06T01:09:31.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.389+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a415bdc0 con 0x7ff8a40d0f10 2023-07-06T01:09:31.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.389+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c005420 con 0x7ff8a40d0f10 2023-07-06T01:09:31.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.389+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a415b720 con 0x7ff8a40d0f10 2023-07-06T01:09:31.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.390+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a4157380 con 0x7ff8a40d0f10 2023-07-06T01:09:31.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.391+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff89c005580 con 0x7ff8a40d0f10 2023-07-06T01:09:31.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.391+0000 7ff89a7fc700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff88806ace0 0x7ff88806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.392+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff89c088d20 con 0x7ff8a40d0f10 2023-07-06T01:09:31.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.392+0000 7ff8a9d9b700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff88806ace0 0x7ff88806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.393+0000 7ff8a9d9b700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff88806ace0 0x7ff88806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000fb0 tx=0x7ff8a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:31.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.396+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8a4157380 con 0x7ff8a40d0f10 2023-07-06T01:09:31.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.600+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8a4157380 con 0x7ff8a40d0f10 2023-07-06T01:09:31.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.601+0000 7ff89a7fc700 1 -- 172.21.15.71:0/1636009718 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff89c017020 con 0x7ff8a40d0f10 2023-07-06T01:09:31.604 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:31.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff88806ace0 msgr2=0x7ff88806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff88806ace0 0x7ff88806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000fb0 tx=0x7ff8a0009040 comp rx=0 tx=0).stop 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 msgr2=0x7ff8a41598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 0x7ff8a41598b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff89c001560 tx=0x7ff89c00cc00 comp rx=0 tx=0).stop 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 shutdown_connections 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff88806ace0 0x7ff88806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.603+0000 7ff8abfff700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff8a40d0f10 0x7ff8a41598b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.604+0000 7ff8abfff700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a40b3660 0x7ff8a41f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.604+0000 7ff8abfff700 1 --2- 172.21.15.71:0/1636009718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff8a40b8920 0x7ff8a40c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.604+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 >> 172.21.15.71:0/1636009718 conn(0x7ff8a409c130 msgr2=0x7ff8a406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:31.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.604+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 shutdown_connections 2023-07-06T01:09:31.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.604+0000 7ff8abfff700 1 -- 172.21.15.71:0/1636009718 wait complete. 2023-07-06T01:09:31.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:31.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.820+0000 7ff6b89ff700 1 Processor -- start 2023-07-06T01:09:31.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.820+0000 7ff6b89ff700 1 -- start start 2023-07-06T01:09:31.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.821+0000 7ff6b89ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 0x7ff6b40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b89ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff6b40b6100 0x7ff6b40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b89ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40cf780 con 0x7ff6b40b5c90 2023-07-06T01:09:31.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b89ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b40cd490 con 0x7ff6b40b6100 2023-07-06T01:09:31.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b89ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40cd770 con 0x7ff6b415fca0 2023-07-06T01:09:31.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b259c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 0x7ff6b40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b259c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 0x7ff6b40d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:58302/0 (socket says 172.21.15.71:58302) 2023-07-06T01:09:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b2d9d700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff6b40b6100 0x7ff6b40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.822+0000 7ff6b259c700 1 -- 172.21.15.71:0/4158358911 learned_addr learned my addr 172.21.15.71:0/4158358911 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b259c700 1 -- 172.21.15.71:0/4158358911 >> v2:172.21.15.194:3300/0 conn(0x7ff6b40b6100 msgr2=0x7ff6b40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b259c700 1 --2- 172.21.15.71:0/4158358911 >> v2:172.21.15.194:3300/0 conn(0x7ff6b40b6100 0x7ff6b40cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b259c700 1 -- 172.21.15.71:0/4158358911 >> v1:172.21.15.194:6789/0 conn(0x7ff6b40b5c90 legacy=0x7ff6b40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b1d9b700 1 -- 172.21.15.71:0/4158358911 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122275259 0 0) 0x7ff6b40cf780 con 0x7ff6b40b5c90 2023-07-06T01:09:31.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b259c700 1 -- 172.21.15.71:0/4158358911 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40cda50 con 0x7ff6b415fca0 2023-07-06T01:09:31.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b259c700 1 --2- 172.21.15.71:0/4158358911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 0x7ff6b40d1420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5732e4863fd41c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:31.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b1d9b700 1 -- 172.21.15.71:0/4158358911 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011830 con 0x7ff6b415fca0 2023-07-06T01:09:31.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b1d9b700 1 -- 172.21.15.71:0/4158358911 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4011990 con 0x7ff6b415fca0 2023-07-06T01:09:31.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.823+0000 7ff6b1d9b700 1 -- 172.21.15.71:0/4158358911 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4011d20 con 0x7ff6b415fca0 2023-07-06T01:09:31.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 -- 172.21.15.71:0/4158358911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 msgr2=0x7ff6b40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/4158358911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 0x7ff6b40d1420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40098f0 tx=0x7ff6a4009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:31.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 -- 172.21.15.71:0/4158358911 shutdown_connections 2023-07-06T01:09:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/4158358911 >> v2:172.21.15.194:3300/0 conn(0x7ff6b40b6100 0x7ff6b40cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/4158358911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b415fca0 0x7ff6b40d1420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 -- 172.21.15.71:0/4158358911 >> 172.21.15.71:0/4158358911 conn(0x7ff6b406c150 msgr2=0x7ff6b406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 -- 172.21.15.71:0/4158358911 shutdown_connections 2023-07-06T01:09:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.824+0000 7ff6b89ff700 1 -- 172.21.15.71:0/4158358911 wait complete. 2023-07-06T01:09:31.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.826+0000 7ff6b89ff700 1 Processor -- start 2023-07-06T01:09:31.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.826+0000 7ff6b89ff700 1 -- start start 2023-07-06T01:09:31.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b89ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 0x7ff6b40b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b89ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b40b6100 0x7ff6b4153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b89ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6b415fca0 0x7ff6b4153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b89ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b3880 con 0x7ff6b415fca0 2023-07-06T01:09:31.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b89ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b3b60 con 0x7ff6b40b5c90 2023-07-06T01:09:31.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b89ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b3e40 con 0x7ff6b40b6100 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 0x7ff6b40b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 0x7ff6b40b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:45102/0 (socket says 172.21.15.71:45102) 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 -- 172.21.15.71:0/1559762933 learned_addr learned my addr 172.21.15.71:0/1559762933 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6abfff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b40b6100 0x7ff6b4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b2d9d700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6b415fca0 0x7ff6b4153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 -- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b40b6100 msgr2=0x7ff6b4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b40b6100 0x7ff6b4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 -- 172.21.15.71:0/1559762933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6b415fca0 msgr2=0x7ff6b4153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6b415fca0 0x7ff6b4153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.827+0000 7ff6b259c700 1 -- 172.21.15.71:0/1559762933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a4009550 con 0x7ff6b40b5c90 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.828+0000 7ff6b259c700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 0x7ff6b40b2fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4014040 tx=0x7ff6a4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.828+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4004380 con 0x7ff6b40b5c90 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.828+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a401f070 con 0x7ff6b40b5c90 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.828+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40b4120 con 0x7ff6b40b5c90 2023-07-06T01:09:31.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.828+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40036a0 con 0x7ff6b40b5c90 2023-07-06T01:09:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.828+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40b4920 con 0x7ff6b40b5c90 2023-07-06T01:09:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.829+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40b4640 con 0x7ff6b40b5c90 2023-07-06T01:09:31.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.830+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6a4021030 con 0x7ff6b40b5c90 2023-07-06T01:09:31.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.831+0000 7ff6aaffd700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff69406ace0 0x7ff69406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:31.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.831+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff6a408ac30 con 0x7ff6b40b5c90 2023-07-06T01:09:31.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.832+0000 7ff6abfff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff69406ace0 0x7ff69406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:31.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.832+0000 7ff6abfff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff69406ace0 0x7ff69406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40d0c40 tx=0x7ff69c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:31.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:31.835+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6a4055d10 con 0x7ff6b40b5c90 2023-07-06T01:09:32.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.027+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6b40008d0 con 0x7ff6b40b5c90 2023-07-06T01:09:32.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.028+0000 7ff6aaffd700 1 -- 172.21.15.71:0/1559762933 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6a4015020 con 0x7ff6b40b5c90 2023-07-06T01:09:32.031 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff69406ace0 msgr2=0x7ff69406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff69406ace0 0x7ff69406d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40d0c40 tx=0x7ff69c009040 comp rx=0 tx=0).stop 2023-07-06T01:09:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 msgr2=0x7ff6b40b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 0x7ff6b40b2fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4014040 tx=0x7ff6a4004750 comp rx=0 tx=0).stop 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 shutdown_connections 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff69406ace0 0x7ff69406d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6b415fca0 0x7ff6b4153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6b40b5c90 0x7ff6b40b2fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 --2- 172.21.15.71:0/1559762933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6b40b6100 0x7ff6b4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.030+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 >> 172.21.15.71:0/1559762933 conn(0x7ff6b406c150 msgr2=0x7ff6b406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.031+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 shutdown_connections 2023-07-06T01:09:32.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.031+0000 7ff6b89ff700 1 -- 172.21.15.71:0/1559762933 wait complete. 2023-07-06T01:09:32.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:32.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.240+0000 7f676c5ff700 1 Processor -- start 2023-07-06T01:09:32.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.241+0000 7f676c5ff700 1 -- start start 2023-07-06T01:09:32.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676c5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f676415fca0 0x7f67640d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676c5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b5c90 0x7f67640d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676c5ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640cf780 con 0x7f67640b60e0 2023-07-06T01:09:32.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676c5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640cd490 con 0x7f676415fca0 2023-07-06T01:09:32.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676c5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640cd770 con 0x7f67640b5c90 2023-07-06T01:09:32.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f676415fca0 0x7f67640d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f676415fca0 0x7f67640d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47684/0 (socket says 172.21.15.71:47684) 2023-07-06T01:09:32.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 -- 172.21.15.71:0/2968402295 learned_addr learned my addr 172.21.15.71:0/2968402295 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:32.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f6769b9a700 1 --2- 172.21.15.71:0/2968402295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b5c90 0x7f67640d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 -- 172.21.15.71:0/2968402295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b5c90 msgr2=0x7f67640d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 --2- 172.21.15.71:0/2968402295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b5c90 0x7f67640d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 -- 172.21.15.71:0/2968402295 >> v1:172.21.15.71:6789/0 conn(0x7f67640b60e0 legacy=0x7f67640cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f676a39b700 1 -- 172.21.15.71:0/2968402295 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640cda50 con 0x7f676415fca0 2023-07-06T01:09:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.242+0000 7f6769399700 1 -- 172.21.15.71:0/2968402295 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590702662 0 0) 0x7f67640cf780 con 0x7f67640b60e0 2023-07-06T01:09:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.243+0000 7f676a39b700 1 --2- 172.21.15.71:0/2968402295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67640d1420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f67600098f0 tx=0x7f6760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cab4e6672a58960 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.243+0000 7f6769399700 1 -- 172.21.15.71:0/2968402295 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000b8a0 con 0x7f676415fca0 2023-07-06T01:09:32.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.243+0000 7f6769399700 1 -- 172.21.15.71:0/2968402295 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676000ba00 con 0x7f676415fca0 2023-07-06T01:09:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.243+0000 7f6769399700 1 -- 172.21.15.71:0/2968402295 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000bd90 con 0x7f676415fca0 2023-07-06T01:09:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.243+0000 7f676c5ff700 1 -- 172.21.15.71:0/2968402295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 msgr2=0x7f67640d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.243+0000 7f676c5ff700 1 --2- 172.21.15.71:0/2968402295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67640d1420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f67600098f0 tx=0x7f6760009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.244+0000 7f676c5ff700 1 -- 172.21.15.71:0/2968402295 shutdown_connections 2023-07-06T01:09:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.244+0000 7f676c5ff700 1 --2- 172.21.15.71:0/2968402295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67640d1420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.244+0000 7f676c5ff700 1 --2- 172.21.15.71:0/2968402295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b5c90 0x7f67640d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.244+0000 7f676c5ff700 1 -- 172.21.15.71:0/2968402295 >> 172.21.15.71:0/2968402295 conn(0x7f676406c150 msgr2=0x7f676406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.244+0000 7f676c5ff700 1 -- 172.21.15.71:0/2968402295 shutdown_connections 2023-07-06T01:09:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.244+0000 7f676c5ff700 1 -- 172.21.15.71:0/2968402295 wait complete. 2023-07-06T01:09:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.245+0000 7f676c5ff700 1 Processor -- start 2023-07-06T01:09:32.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.245+0000 7f676c5ff700 1 -- start start 2023-07-06T01:09:32.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.246+0000 7f676c5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67640b5c90 0x7f6764159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.246+0000 7f676c5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b60e0 0x7f67640cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.246+0000 7f676c5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67641f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.246+0000 7f676c5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764159440 con 0x7f676415fca0 2023-07-06T01:09:32.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.246+0000 7f676c5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641588c0 con 0x7f67640b5c90 2023-07-06T01:09:32.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.246+0000 7f676c5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6764158ba0 con 0x7f67640b60e0 2023-07-06T01:09:32.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67641f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67641f11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47690/0 (socket says 172.21.15.71:47690) 2023-07-06T01:09:32.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 -- 172.21.15.71:0/1015992758 learned_addr learned my addr 172.21.15.71:0/1015992758 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:32.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f6769b9a700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b60e0 0x7f67640cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676a39b700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67640b5c90 0x7f6764159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 -- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b60e0 msgr2=0x7f67640cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b60e0 0x7f67640cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 -- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67640b5c90 msgr2=0x7f6764159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67640b5c90 0x7f6764159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 -- 172.21.15.71:0/1015992758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760009550 con 0x7f676415fca0 2023-07-06T01:09:32.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f6769b9a700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b60e0 0x7f67640cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:32.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f676ab9c700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67641f11c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c820 tx=0x7f675c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:32.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.247+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c003e30 con 0x7f676415fca0 2023-07-06T01:09:32.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.248+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c0050f0 con 0x7f676415fca0 2023-07-06T01:09:32.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.248+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6764158e80 con 0x7f676415fca0 2023-07-06T01:09:32.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.248+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c0054a0 con 0x7f676415fca0 2023-07-06T01:09:32.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.248+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6764158550 con 0x7f676415fca0 2023-07-06T01:09:32.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.249+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640008d0 con 0x7f676415fca0 2023-07-06T01:09:32.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.250+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f675c005600 con 0x7f676415fca0 2023-07-06T01:09:32.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.251+0000 7f675affd700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f674806ace0 0x7f674806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.251+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f675c088c80 con 0x7f676415fca0 2023-07-06T01:09:32.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.252+0000 7f676a39b700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f674806ace0 0x7f674806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.252+0000 7f676a39b700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f674806ace0 0x7f674806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6760014040 tx=0x7f6760008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:32.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.256+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f675c053d80 con 0x7f676415fca0 2023-07-06T01:09:32.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.452+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67640b2b80 con 0x7f676415fca0 2023-07-06T01:09:32.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.453+0000 7f675affd700 1 -- 172.21.15.71:0/1015992758 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f675c017090 con 0x7f676415fca0 2023-07-06T01:09:32.457 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:32.457 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":24,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:31.539630+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f674806ace0 msgr2=0x7f674806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f674806ace0 0x7f674806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6760014040 tx=0x7f6760008030 comp rx=0 tx=0).stop 2023-07-06T01:09:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 msgr2=0x7f67641f11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67641f11c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c820 tx=0x7f675c00cbe0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 shutdown_connections 2023-07-06T01:09:32.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f674806ace0 0x7f674806d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f676415fca0 0x7f67641f11c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67640b5c90 0x7f6764159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 --2- 172.21.15.71:0/1015992758 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67640b60e0 0x7f67640cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 >> 172.21.15.71:0/1015992758 conn(0x7f676406c150 msgr2=0x7f67640d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 shutdown_connections 2023-07-06T01:09:32.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.456+0000 7f676c5ff700 1 -- 172.21.15.71:0/1015992758 wait complete. 2023-07-06T01:09:32.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:32.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:32.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.672+0000 7fcd77dff700 1 Processor -- start 2023-07-06T01:09:32.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.673+0000 7fcd77dff700 1 -- start start 2023-07-06T01:09:32.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd77dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd700b0440 0x7fcd70143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd77dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd7015df60 0x7fcd700b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd77dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7015b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd77dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd701441f0 con 0x7fcd700b0440 2023-07-06T01:09:32.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd77dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7015e3e0 con 0x7fcd7015df60 2023-07-06T01:09:32.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd77dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7015a930 con 0x7fcd7015b0e0 2023-07-06T01:09:32.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd75b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd700b0440 0x7fcd70143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd75b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd700b0440 0x7fcd70143900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47702/0 (socket says 172.21.15.71:47702) 2023-07-06T01:09:32.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd75b9b700 1 -- 172.21.15.71:0/2650517490 learned_addr learned my addr 172.21.15.71:0/2650517490 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:32.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd7539a700 1 --2- 172.21.15.71:0/2650517490 >> v2:172.21.15.194:3300/0 conn(0x7fcd7015df60 0x7fcd700b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd7639c700 1 --2- 172.21.15.71:0/2650517490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.674+0000 7fcd75b9b700 1 -- 172.21.15.71:0/2650517490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 msgr2=0x7fcd7015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:32.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd75b9b700 1 --2- 172.21.15.71:0/2650517490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd75b9b700 1 -- 172.21.15.71:0/2650517490 >> v2:172.21.15.194:3300/0 conn(0x7fcd7015df60 msgr2=0x7fcd700b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:32.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd75b9b700 1 --2- 172.21.15.71:0/2650517490 >> v2:172.21.15.194:3300/0 conn(0x7fcd7015df60 0x7fcd700b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd75b9b700 1 -- 172.21.15.71:0/2650517490 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700b0d50 con 0x7fcd700b0440 2023-07-06T01:09:32.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd75b9b700 1 --2- 172.21.15.71:0/2650517490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd700b0440 0x7fcd70143900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ce890 tx=0x7fcd6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8a6ea7e0a45484 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd74b99700 1 -- 172.21.15.71:0/2650517490 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00b870 con 0x7fcd700b0440 2023-07-06T01:09:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd74b99700 1 -- 172.21.15.71:0/2650517490 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c00b9d0 con 0x7fcd700b0440 2023-07-06T01:09:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd74b99700 1 -- 172.21.15.71:0/2650517490 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c00bd60 con 0x7fcd700b0440 2023-07-06T01:09:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd77dff700 1 -- 172.21.15.71:0/2650517490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd700b0440 msgr2=0x7fcd70143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.675+0000 7fcd77dff700 1 --2- 172.21.15.71:0/2650517490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd700b0440 0x7fcd70143900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ce890 tx=0x7fcd6c009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 -- 172.21.15.71:0/2650517490 shutdown_connections 2023-07-06T01:09:32.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 --2- 172.21.15.71:0/2650517490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 --2- 172.21.15.71:0/2650517490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd700b0440 0x7fcd70143900 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 --2- 172.21.15.71:0/2650517490 >> v2:172.21.15.194:3300/0 conn(0x7fcd7015df60 0x7fcd700b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 -- 172.21.15.71:0/2650517490 >> 172.21.15.71:0/2650517490 conn(0x7fcd700cb440 msgr2=0x7fcd700cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 -- 172.21.15.71:0/2650517490 shutdown_connections 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.676+0000 7fcd77dff700 1 -- 172.21.15.71:0/2650517490 wait complete. 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.678+0000 7fcd77dff700 1 Processor -- start 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.678+0000 7fcd77dff700 1 -- start start 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.679+0000 7fcd77dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd700b0440 0x7fcd700ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.679+0000 7fcd77dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.679+0000 7fcd77dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 0x7fcd701f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.679+0000 7fcd77dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700acdc0 con 0x7fcd7015df60 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.679+0000 7fcd77dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700ad2d0 con 0x7fcd700b0440 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd77dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700acff0 con 0x7fcd7015b0e0 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 0x7fcd701f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 0x7fcd701f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47716/0 (socket says 172.21.15.71:47716) 2023-07-06T01:09:32.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 -- 172.21.15.71:0/3609793155 learned_addr learned my addr 172.21.15.71:0/3609793155 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:32.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd75b9b700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd700b0440 0x7fcd700ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7539a700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 -- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 msgr2=0x7fcd7006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 -- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd700b0440 msgr2=0x7fcd700ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd700b0440 0x7fcd700ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 -- 172.21.15.71:0/3609793155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c009550 con 0x7fcd7015df60 2023-07-06T01:09:32.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.680+0000 7fcd7639c700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 0x7fcd701f5a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd68007d20 tx=0x7fcd6800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:32.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.681+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800ed30 con 0x7fcd7015df60 2023-07-06T01:09:32.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.681+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68007e70 con 0x7fcd7015df60 2023-07-06T01:09:32.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.681+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd700cc6c0 con 0x7fcd7015df60 2023-07-06T01:09:32.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.681+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68014640 con 0x7fcd7015df60 2023-07-06T01:09:32.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.681+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd700ccc80 con 0x7fcd7015df60 2023-07-06T01:09:32.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.682+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7006fa50 con 0x7fcd7015df60 2023-07-06T01:09:32.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.683+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd680147a0 con 0x7fcd7015df60 2023-07-06T01:09:32.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.684+0000 7fcd667fc700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd5406ace0 0x7fcd5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:32.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.684+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fcd680899f0 con 0x7fcd7015df60 2023-07-06T01:09:32.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.684+0000 7fcd75b9b700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd5406ace0 0x7fcd5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:32.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.685+0000 7fcd75b9b700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd5406ace0 0x7fcd5406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c014040 tx=0x7fcd6c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:32.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.688+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd68054a50 con 0x7fcd7015df60 2023-07-06T01:09:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.886+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd700008d0 con 0x7fcd7015df60 2023-07-06T01:09:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.887+0000 7fcd667fc700 1 -- 172.21.15.71:0/3609793155 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd68058070 con 0x7fcd7015df60 2023-07-06T01:09:32.890 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd5406ace0 msgr2=0x7fcd5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd5406ace0 0x7fcd5406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c014040 tx=0x7fcd6c008030 comp rx=0 tx=0).stop 2023-07-06T01:09:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 msgr2=0x7fcd701f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 0x7fcd701f5a90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcd68007d20 tx=0x7fcd6800e3c0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 shutdown_connections 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcd5406ace0 0x7fcd5406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd7015df60 0x7fcd701f5a90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd700b0440 0x7fcd700ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 --2- 172.21.15.71:0/3609793155 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd7015b0e0 0x7fcd7006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 >> 172.21.15.71:0/3609793155 conn(0x7fcd700cb440 msgr2=0x7fcd70159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 shutdown_connections 2023-07-06T01:09:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:32.889+0000 7fcd77dff700 1 -- 172.21.15.71:0/3609793155 wait complete. 2023-07-06T01:09:32.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:33.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.104+0000 7fc520dff700 1 Processor -- start 2023-07-06T01:09:33.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.104+0000 7fc520dff700 1 -- start start 2023-07-06T01:09:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.105+0000 7fc520dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc51c15fca0 0x7fc51c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc520dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc51c0b6110 0x7fc51c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc520dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c0cf780 con 0x7fc51c0b5c90 2023-07-06T01:09:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc520dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0cd490 con 0x7fc51c0b6110 2023-07-06T01:09:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc520dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0cd770 con 0x7fc51c15fca0 2023-07-06T01:09:33.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc51c0b6110 0x7fc51c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc51c0b6110 0x7fc51c0cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44540/0 (socket says 172.21.15.71:44540) 2023-07-06T01:09:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 -- 172.21.15.71:0/1544558022 learned_addr learned my addr 172.21.15.71:0/1544558022 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:33.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51a59c700 1 --2- 172.21.15.71:0/1544558022 >> v2:172.21.15.194:3300/0 conn(0x7fc51c15fca0 0x7fc51c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 -- 172.21.15.71:0/1544558022 >> v2:172.21.15.194:3300/0 conn(0x7fc51c15fca0 msgr2=0x7fc51c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 --2- 172.21.15.71:0/1544558022 >> v2:172.21.15.194:3300/0 conn(0x7fc51c15fca0 0x7fc51c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 -- 172.21.15.71:0/1544558022 >> v1:172.21.15.194:6789/0 conn(0x7fc51c0b5c90 legacy=0x7fc51c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.106+0000 7fc51ad9d700 1 -- 172.21.15.71:0/1544558022 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0cda50 con 0x7fc51c0b6110 2023-07-06T01:09:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc51ad9d700 1 --2- 172.21.15.71:0/1544558022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c0b6110 0x7fc51c0cfc10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0d0930 tx=0x7fc51400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60b76455cd83674 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc519d9b700 1 -- 172.21.15.71:0/1544558022 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400e070 con 0x7fc51c0b6110 2023-07-06T01:09:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc519d9b700 1 -- 172.21.15.71:0/1544558022 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51400b910 con 0x7fc51c0b6110 2023-07-06T01:09:33.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc519d9b700 1 -- 172.21.15.71:0/1544558022 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51400bcc0 con 0x7fc51c0b6110 2023-07-06T01:09:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc520dff700 1 -- 172.21.15.71:0/1544558022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c0b6110 msgr2=0x7fc51c0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc520dff700 1 --2- 172.21.15.71:0/1544558022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c0b6110 0x7fc51c0cfc10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0d0930 tx=0x7fc51400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc520dff700 1 -- 172.21.15.71:0/1544558022 shutdown_connections 2023-07-06T01:09:33.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc520dff700 1 --2- 172.21.15.71:0/1544558022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c0b6110 0x7fc51c0cfc10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc520dff700 1 --2- 172.21.15.71:0/1544558022 >> v2:172.21.15.194:3300/0 conn(0x7fc51c15fca0 0x7fc51c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.107+0000 7fc520dff700 1 -- 172.21.15.71:0/1544558022 >> 172.21.15.71:0/1544558022 conn(0x7fc51c06c150 msgr2=0x7fc51c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:33.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.108+0000 7fc520dff700 1 -- 172.21.15.71:0/1544558022 shutdown_connections 2023-07-06T01:09:33.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.108+0000 7fc520dff700 1 -- 172.21.15.71:0/1544558022 wait complete. 2023-07-06T01:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.109+0000 7fc520dff700 1 Processor -- start 2023-07-06T01:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.109+0000 7fc520dff700 1 -- start start 2023-07-06T01:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.110+0000 7fc520dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc51c0b5c90 0x7fc51c1ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.110+0000 7fc520dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc51c0b6110 0x7fc51c1f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.110+0000 7fc520dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 0x7fc51c1f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.110+0000 7fc520dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0c6930 con 0x7fc51c15fca0 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.110+0000 7fc520dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1f2bf0 con 0x7fc51c0b5c90 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.110+0000 7fc520dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c1f2ed0 con 0x7fc51c0b6110 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 0x7fc51c1f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 0x7fc51c1f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44544/0 (socket says 172.21.15.71:44544) 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 -- 172.21.15.71:0/4176862501 learned_addr learned my addr 172.21.15.71:0/4176862501 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51a59c700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc51c0b5c90 0x7fc51c1ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc513fff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc51c0b6110 0x7fc51c1f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 -- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc51c0b6110 msgr2=0x7fc51c1f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc51c0b6110 0x7fc51c1f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 -- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc51c0b5c90 msgr2=0x7fc51c1ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc51c0b5c90 0x7fc51c1ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 -- 172.21.15.71:0/4176862501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc514009b30 con 0x7fc51c15fca0 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.111+0000 7fc51ad9d700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 0x7fc51c1f20b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc51c06d0f0 tx=0x7fc514004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.112+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514004880 con 0x7fc51c15fca0 2023-07-06T01:09:33.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.112+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140099b0 con 0x7fc51c15fca0 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.112+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51401c680 con 0x7fc51c15fca0 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.112+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c0c6b80 con 0x7fc51c15fca0 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.112+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c0cbf10 con 0x7fc51c15fca0 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.113+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51c0008d0 con 0x7fc51c15fca0 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.114+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc51401c7e0 con 0x7fc51c15fca0 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.115+0000 7fc512ffd700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc4fc06ace0 0x7fc4fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.115+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc51408b0d0 con 0x7fc51c15fca0 2023-07-06T01:09:33.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.115+0000 7fc51a59c700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc4fc06ace0 0x7fc4fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.116+0000 7fc51a59c700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc4fc06ace0 0x7fc4fc06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009b40 tx=0x7fc50c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.119+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc514056130 con 0x7fc51c15fca0 2023-07-06T01:09:33.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.315+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc51c1f3090 con 0x7fc51c15fca0 2023-07-06T01:09:33.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.315+0000 7fc512ffd700 1 -- 172.21.15.71:0/4176862501 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc514059750 con 0x7fc51c15fca0 2023-07-06T01:09:33.318 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc4fc06ace0 msgr2=0x7fc4fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc4fc06ace0 0x7fc4fc06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009b40 tx=0x7fc50c009210 comp rx=0 tx=0).stop 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 msgr2=0x7fc51c1f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 0x7fc51c1f20b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc51c06d0f0 tx=0x7fc514004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 shutdown_connections 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc4fc06ace0 0x7fc4fc06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc51c15fca0 0x7fc51c1f20b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc51c0b5c90 0x7fc51c1ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 --2- 172.21.15.71:0/4176862501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc51c0b6110 0x7fc51c1f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 >> 172.21.15.71:0/4176862501 conn(0x7fc51c06c150 msgr2=0x7fc51c0b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:33.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 shutdown_connections 2023-07-06T01:09:33.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.318+0000 7fc520dff700 1 -- 172.21.15.71:0/4176862501 wait complete. 2023-07-06T01:09:33.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:33.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.537+0000 7f3c121ff700 1 Processor -- start 2023-07-06T01:09:33.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.537+0000 7f3c121ff700 1 -- start start 2023-07-06T01:09:33.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c121ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c15fca0 0x7f3c0c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c121ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c0c0b5c90 0x7f3c0c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c121ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c0cf780 con 0x7f3c0c0b6100 2023-07-06T01:09:33.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c121ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0cd490 con 0x7f3c0c0b5c90 2023-07-06T01:09:33.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c121ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0cd770 con 0x7f3c0c15fca0 2023-07-06T01:09:33.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c0affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c0c0b5c90 0x7f3c0c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c0affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c0c0b5c90 0x7f3c0c0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44550/0 (socket says 172.21.15.71:44550) 2023-07-06T01:09:33.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.538+0000 7f3c0affd700 1 -- 172.21.15.71:0/4017200203 learned_addr learned my addr 172.21.15.71:0/4017200203 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:33.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0b7fe700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c15fca0 0x7f3c0c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0affd700 1 -- 172.21.15.71:0/4017200203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c15fca0 msgr2=0x7f3c0c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0affd700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c15fca0 0x7f3c0c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0affd700 1 -- 172.21.15.71:0/4017200203 >> v1:172.21.15.194:6789/0 conn(0x7f3c0c0b6100 legacy=0x7f3c0c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0affd700 1 -- 172.21.15.71:0/4017200203 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0cda50 con 0x7f3c0c0b5c90 2023-07-06T01:09:33.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0b7fe700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c15fca0 0x7f3c0c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:33.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0affd700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c0b5c90 0x7f3c0c0d2d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c000098f0 tx=0x7f3c00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32812372ae788db3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/4017200203 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00004230 con 0x7f3c0c0b5c90 2023-07-06T01:09:33.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/4017200203 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00004390 con 0x7f3c0c0b5c90 2023-07-06T01:09:33.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.539+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/4017200203 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c000036a0 con 0x7f3c0c0b5c90 2023-07-06T01:09:33.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 -- 172.21.15.71:0/4017200203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c0b5c90 msgr2=0x7f3c0c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c0b5c90 0x7f3c0c0d2d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3c000098f0 tx=0x7f3c00009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:33.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 -- 172.21.15.71:0/4017200203 shutdown_connections 2023-07-06T01:09:33.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c15fca0 0x7f3c0c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 --2- 172.21.15.71:0/4017200203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c0b5c90 0x7f3c0c0d2d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 -- 172.21.15.71:0/4017200203 >> 172.21.15.71:0/4017200203 conn(0x7f3c0c06c150 msgr2=0x7f3c0c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:33.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 -- 172.21.15.71:0/4017200203 shutdown_connections 2023-07-06T01:09:33.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.540+0000 7f3c121ff700 1 -- 172.21.15.71:0/4017200203 wait complete. 2023-07-06T01:09:33.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.542+0000 7f3c121ff700 1 Processor -- start 2023-07-06T01:09:33.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.542+0000 7f3c121ff700 1 -- start start 2023-07-06T01:09:33.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c121ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c0b5c90 0x7f3c0c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c121ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0c0b6100 0x7f3c0c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c121ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 0x7f3c0c0b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c121ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c149dd0 con 0x7f3c0c15fca0 2023-07-06T01:09:33.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c121ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c157fc0 con 0x7f3c0c0b6100 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c121ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c1582a0 con 0x7f3c0c0b5c90 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 0x7f3c0c0b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 0x7f3c0c0b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44554/0 (socket says 172.21.15.71:44554) 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 -- 172.21.15.71:0/806783964 learned_addr learned my addr 172.21.15.71:0/806783964 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0affd700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0c0b6100 0x7f3c0c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0b7fe700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c0b5c90 0x7f3c0c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 -- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c0b5c90 msgr2=0x7f3c0c158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c0b5c90 0x7f3c0c158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 -- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0c0b6100 msgr2=0x7f3c0c1f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0c0b6100 0x7f3c0c1f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.543+0000 7f3c0bfff700 1 -- 172.21.15.71:0/806783964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009550 con 0x7f3c0c15fca0 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.544+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 0x7f3c0c0b7b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400cba0 tx=0x7f3c0400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.544+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400aad0 con 0x7f3c0c15fca0 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.544+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400ac30 con 0x7f3c0c15fca0 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.544+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04012420 con 0x7f3c0c15fca0 2023-07-06T01:09:33.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.544+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c158580 con 0x7f3c0c15fca0 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.544+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c1f1b00 con 0x7f3c0c15fca0 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.545+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c0008d0 con 0x7f3c0c15fca0 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.546+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c04012580 con 0x7f3c0c15fca0 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.547+0000 7f3bf3fff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf806ace0 0x7f3bf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.547+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3c04089b80 con 0x7f3c0c15fca0 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.547+0000 7f3c0b7fe700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf806ace0 0x7f3bf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.548+0000 7f3c0b7fe700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf806ace0 0x7f3bf806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc006fd0 tx=0x7f3bfc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.551+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c04054be0 con 0x7f3c0c15fca0 2023-07-06T01:09:33.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.745+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c0c0d2450 con 0x7f3c0c15fca0 2023-07-06T01:09:33.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.746+0000 7f3bf3fff700 1 -- 172.21.15.71:0/806783964 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c04089e60 con 0x7f3c0c15fca0 2023-07-06T01:09:33.749 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:33.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf806ace0 msgr2=0x7f3bf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf806ace0 0x7f3bf806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc006fd0 tx=0x7f3bfc008040 comp rx=0 tx=0).stop 2023-07-06T01:09:33.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 msgr2=0x7f3c0c0b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 0x7f3c0c0b7b30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400cba0 tx=0x7f3c0400ceb0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 shutdown_connections 2023-07-06T01:09:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf806ace0 0x7f3bf806d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c0c15fca0 0x7f3c0c0b7b30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0c0b5c90 0x7f3c0c158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 --2- 172.21.15.71:0/806783964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0c0b6100 0x7f3c0c1f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 >> 172.21.15.71:0/806783964 conn(0x7f3c0c06c150 msgr2=0x7f3c0c0d2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:33.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 shutdown_connections 2023-07-06T01:09:33.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.748+0000 7f3c121ff700 1 -- 172.21.15.71:0/806783964 wait complete. 2023-07-06T01:09:33.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:33.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.962+0000 7f1e83fff700 1 Processor -- start 2023-07-06T01:09:33.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.962+0000 7f1e83fff700 1 -- start start 2023-07-06T01:09:33.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e83fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 0x7f1e7c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e83fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e7c0b6100 0x7f1e7c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e83fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c0cf780 con 0x7f1e7c0b5c90 2023-07-06T01:09:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e83fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cd490 con 0x7f1e7c0b6100 2023-07-06T01:09:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e83fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cd770 con 0x7f1e7c15fca0 2023-07-06T01:09:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e8159a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1e7c0b5c90 0x7f1e7c0d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37838/0 (socket says 172.21.15.71:37838) 2023-07-06T01:09:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e8159a700 1 -- 172.21.15.71:0/1572150002 learned_addr learned my addr 172.21.15.71:0/1572150002 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:33.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e81d9b700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 0x7f1e7c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e8259c700 1 --2- 172.21.15.71:0/1572150002 >> v2:172.21.15.194:3300/0 conn(0x7f1e7c0b6100 0x7f1e7c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054345135 0 0) 0x7f1e7c0cf780 con 0x7f1e7c0b5c90 2023-07-06T01:09:33.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.964+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e680035b0 con 0x7f1e7c0b5c90 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1680027975 0 0) 0x7f1e680035b0 con 0x7f1e7c0b5c90 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 msgr2=0x7f1e7c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 0x7f1e7c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 >> v2:172.21.15.194:3300/0 conn(0x7f1e7c0b6100 msgr2=0x7f1e7c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 --2- 172.21.15.71:0/1572150002 >> v2:172.21.15.194:3300/0 conn(0x7f1e7c0b6100 0x7f1e7c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0cda50 con 0x7f1e7c0b5c90 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f1e6c001670 con 0x7f1e7c0b5c90 2023-07-06T01:09:33.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 >> v1:172.21.15.71:6789/0 conn(0x7f1e7c0b5c90 legacy=0x7f1e7c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 0x7f1e68003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e68003f80 0x7f1e68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e68004d90 0x7f1e68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cd490 con 0x7f1e68003f80 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0cd770 con 0x7f1e68004d90 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6800ba10 con 0x7f1e7c15fca0 2023-07-06T01:09:33.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e8159a700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e68003f80 0x7f1e68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e81d9b700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 0x7f1e68003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.965+0000 7f1e8259c700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e68004d90 0x7f1e68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8159a700 1 -- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 msgr2=0x7f1e68003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8159a700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e7c15fca0 0x7f1e68003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8159a700 1 -- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e68004d90 msgr2=0x7f1e68005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8159a700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e68004d90 0x7f1e68005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8159a700 1 -- 172.21.15.71:0/1572150002 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e680035b0 con 0x7f1e68003f80 2023-07-06T01:09:33.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8159a700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e68003f80 0x7f1e68004850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c320 tx=0x7f1e68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70be1d475ff1c90f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00ce60 con 0x7f1e68003f80 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c005960 con 0x7f1e68003f80 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e80d99700 1 -- 172.21.15.71:0/1572150002 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c005cf0 con 0x7f1e68003f80 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e83fff700 1 -- 172.21.15.71:0/1572150002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e68003f80 msgr2=0x7f1e68004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e83fff700 1 --2- 172.21.15.71:0/1572150002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e68003f80 0x7f1e68004850 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00c320 tx=0x7f1e68005880 comp rx=0 tx=0).stop 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.966+0000 7f1e8259c700 1 -- 172.21.15.71:0/1572150002 reap_dead start 2023-07-06T01:09:33.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.967+0000 7f1e83fff700 1 -- 172.21.15.71:0/1572150002 shutdown_connections 2023-07-06T01:09:33.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.967+0000 7f1e83fff700 1 -- 172.21.15.71:0/1572150002 >> 172.21.15.71:0/1572150002 conn(0x7f1e7c06c150 msgr2=0x7f1e7c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:33.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.967+0000 7f1e83fff700 1 -- 172.21.15.71:0/1572150002 shutdown_connections 2023-07-06T01:09:33.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.967+0000 7f1e83fff700 1 -- 172.21.15.71:0/1572150002 wait complete. 2023-07-06T01:09:33.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.968+0000 7f1e83fff700 1 Processor -- start 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 -- start start 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e68003f80 0x7f1e7c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e7c15c240 0x7f1e7c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 0x7f1e7c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0c7a90 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0c7d00 con 0x7f1e7c15c240 2023-07-06T01:09:33.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.969+0000 7f1e83fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c0c7fe0 con 0x7f1e68003f80 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 0x7f1e7c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 0x7f1e7c158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44564/0 (socket says 172.21.15.71:44564) 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 -- 172.21.15.71:0/3244622049 learned_addr learned my addr 172.21.15.71:0/3244622049 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e81d9b700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e68003f80 0x7f1e7c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8159a700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e7c15c240 0x7f1e7c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 -- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e68003f80 msgr2=0x7f1e7c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e68003f80 0x7f1e7c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 -- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e7c15c240 msgr2=0x7f1e7c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e7c15c240 0x7f1e7c0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 -- 172.21.15.71:0/3244622049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c0c82c0 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e8259c700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 0x7f1e7c158f80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0d3ed0 tx=0x7f1e74011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.970+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400e040 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.971+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400f040 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.971+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c15cbb0 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.971+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400fcf0 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.971+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c0cc8b0 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.972+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c0c84e0 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.973+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e74015430 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.974+0000 7f1e727fc700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e6006ace0 0x7f1e6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.974+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1e74089b80 con 0x7f1e7c0c8d20 2023-07-06T01:09:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.974+0000 7f1e81d9b700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e6006ace0 0x7f1e6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.975+0000 7f1e81d9b700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e6006ace0 0x7f1e6006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009b80 tx=0x7f1e78009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:33.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:33.978+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e74058670 con 0x7f1e7c0c8d20 2023-07-06T01:09:34.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.173+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e7c0cc8b0 con 0x7f1e7c0c8d20 2023-07-06T01:09:34.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.173+0000 7f1e727fc700 1 -- 172.21.15.71:0/3244622049 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e7c0cc8b0 con 0x7f1e7c0c8d20 2023-07-06T01:09:34.176 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e6006ace0 msgr2=0x7f1e6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e6006ace0 0x7f1e6006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009b80 tx=0x7f1e78009210 comp rx=0 tx=0).stop 2023-07-06T01:09:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 msgr2=0x7f1e7c158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 0x7f1e7c158f80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c0d3ed0 tx=0x7f1e74011f80 comp rx=0 tx=0).stop 2023-07-06T01:09:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 shutdown_connections 2023-07-06T01:09:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e6006ace0 0x7f1e6006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e7c0c8d20 0x7f1e7c158f80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e68003f80 0x7f1e7c0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 --2- 172.21.15.71:0/3244622049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e7c15c240 0x7f1e7c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 >> 172.21.15.71:0/3244622049 conn(0x7f1e7c06c150 msgr2=0x7f1e7c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 shutdown_connections 2023-07-06T01:09:34.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.176+0000 7f1e83fff700 1 -- 172.21.15.71:0/3244622049 wait complete. 2023-07-06T01:09:34.196 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:34.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.387+0000 7f014a9ff700 1 Processor -- start 2023-07-06T01:09:34.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.387+0000 7f014a9ff700 1 -- start start 2023-07-06T01:09:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f014a9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f014415fca0 0x7f01440d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f014a9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01440b5c90 0x7f01440d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f014a9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01440d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f014a9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01440cf780 con 0x7f014415fca0 2023-07-06T01:09:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f014a9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01440cd490 con 0x7f01440b5c90 2023-07-06T01:09:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f014a9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440cd770 con 0x7f01440b6110 2023-07-06T01:09:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f014415fca0 0x7f01440d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f014415fca0 0x7f01440d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44580/0 (socket says 172.21.15.71:44580) 2023-07-06T01:09:34.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 -- 172.21.15.71:0/1133164800 learned_addr learned my addr 172.21.15.71:0/1133164800 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:34.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0148f9c700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01440d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 -- 172.21.15.71:0/1133164800 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 msgr2=0x7f01440d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f013bfff700 1 --2- 172.21.15.71:0/1133164800 >> v2:172.21.15.194:3300/0 conn(0x7f01440b5c90 0x7f01440d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01440d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 -- 172.21.15.71:0/1133164800 >> v2:172.21.15.194:3300/0 conn(0x7f01440b5c90 msgr2=0x7f01440d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 --2- 172.21.15.71:0/1133164800 >> v2:172.21.15.194:3300/0 conn(0x7f01440b5c90 0x7f01440d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0143fff700 1 -- 172.21.15.71:0/1133164800 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440cda50 con 0x7f014415fca0 2023-07-06T01:09:34.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f0148f9c700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01440d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.389+0000 7f013bfff700 1 --2- 172.21.15.71:0/1133164800 >> v2:172.21.15.194:3300/0 conn(0x7f01440b5c90 0x7f01440d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f0143fff700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f014415fca0 0x7f01440d1420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f014406b6f0 tx=0x7f0134009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e459de887edde953 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f01437fe700 1 -- 172.21.15.71:0/1133164800 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400b870 con 0x7f014415fca0 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f01437fe700 1 -- 172.21.15.71:0/1133164800 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400b9d0 con 0x7f014415fca0 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f01437fe700 1 -- 172.21.15.71:0/1133164800 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400bd60 con 0x7f014415fca0 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 -- 172.21.15.71:0/1133164800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f014415fca0 msgr2=0x7f01440d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f014415fca0 0x7f01440d1420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f014406b6f0 tx=0x7f0134009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 -- 172.21.15.71:0/1133164800 shutdown_connections 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01440d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 --2- 172.21.15.71:0/1133164800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f014415fca0 0x7f01440d1420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 --2- 172.21.15.71:0/1133164800 >> v2:172.21.15.194:3300/0 conn(0x7f01440b5c90 0x7f01440d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 -- 172.21.15.71:0/1133164800 >> 172.21.15.71:0/1133164800 conn(0x7f014406c150 msgr2=0x7f014406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.390+0000 7f014a9ff700 1 -- 172.21.15.71:0/1133164800 shutdown_connections 2023-07-06T01:09:34.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.391+0000 7f014a9ff700 1 -- 172.21.15.71:0/1133164800 wait complete. 2023-07-06T01:09:34.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.392+0000 7f014a9ff700 1 Processor -- start 2023-07-06T01:09:34.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.392+0000 7f014a9ff700 1 -- start start 2023-07-06T01:09:34.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f014a9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 0x7f01440b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f014a9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01441f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f014a9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014415fca0 0x7f01441f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f014a9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440b3f40 con 0x7f01440b5c90 2023-07-06T01:09:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f014a9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440b3370 con 0x7f014415fca0 2023-07-06T01:09:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f014a9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440b3610 con 0x7f01440b6110 2023-07-06T01:09:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.393+0000 7f0143fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 0x7f01440b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 0x7f01440b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44590/0 (socket says 172.21.15.71:44590) 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 -- 172.21.15.71:0/924301750 learned_addr learned my addr 172.21.15.71:0/924301750 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f013bfff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01441f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0148f9c700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014415fca0 0x7f01441f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 -- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 msgr2=0x7f01441f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01441f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 -- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014415fca0 msgr2=0x7f01441f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014415fca0 0x7f01441f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 -- 172.21.15.71:0/924301750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134009550 con 0x7f01440b5c90 2023-07-06T01:09:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0148f9c700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014415fca0 0x7f01441f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f0143fff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 0x7f01440b4b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f014406d0f0 tx=0x7f0134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134004310 con 0x7f01440b5c90 2023-07-06T01:09:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013401f070 con 0x7f01440b5c90 2023-07-06T01:09:34.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440b38f0 con 0x7f01440b5c90 2023-07-06T01:09:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.394+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340036a0 con 0x7f01440b5c90 2023-07-06T01:09:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.395+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440b5050 con 0x7f01440b5c90 2023-07-06T01:09:34.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.395+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01440b4220 con 0x7f01440b5c90 2023-07-06T01:09:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.396+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0134021030 con 0x7f01440b5c90 2023-07-06T01:09:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.397+0000 7f01417fa700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f012406ace0 0x7f012406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.397+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f013408a980 con 0x7f01440b5c90 2023-07-06T01:09:34.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.398+0000 7f013bfff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f012406ace0 0x7f012406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.399+0000 7f013bfff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f012406ace0 0x7f012406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01440b8030 tx=0x7f012c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:34.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.401+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f01340559e0 con 0x7f01440b5c90 2023-07-06T01:09:34.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.596+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01440b52a0 con 0x7f01440b5c90 2023-07-06T01:09:34.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.598+0000 7f01417fa700 1 -- 172.21.15.71:0/924301750 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f0134059000 con 0x7f01440b5c90 2023-07-06T01:09:34.600 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:34.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f012406ace0 msgr2=0x7f012406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f012406ace0 0x7f012406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01440b8030 tx=0x7f012c008040 comp rx=0 tx=0).stop 2023-07-06T01:09:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 msgr2=0x7f01440b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 0x7f01440b4b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f014406d0f0 tx=0x7f0134004750 comp rx=0 tx=0).stop 2023-07-06T01:09:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 shutdown_connections 2023-07-06T01:09:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f012406ace0 0x7f012406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f014415fca0 0x7f01441f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01440b5c90 0x7f01440b4b10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 --2- 172.21.15.71:0/924301750 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01440b6110 0x7f01441f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 >> 172.21.15.71:0/924301750 conn(0x7f014406c150 msgr2=0x7f01440d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 shutdown_connections 2023-07-06T01:09:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.600+0000 7f014a9ff700 1 -- 172.21.15.71:0/924301750 wait complete. 2023-07-06T01:09:34.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:34.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.816+0000 7fe7c99ff700 1 Processor -- start 2023-07-06T01:09:34.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.816+0000 7fe7c99ff700 1 -- start start 2023-07-06T01:09:34.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c99ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7c415fca0 0x7fe7c40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c99ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe7c40b5c90 0x7fe7c40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c99ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40cf780 con 0x7fe7c40b6110 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c99ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd490 con 0x7fe7c415fca0 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c99ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd770 con 0x7fe7c40b5c90 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7c415fca0 0x7fe7c40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7c415fca0 0x7fe7c40d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44592/0 (socket says 172.21.15.71:44592) 2023-07-06T01:09:34.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.817+0000 7fe7c2ffd700 1 -- 172.21.15.71:0/2875329663 learned_addr learned my addr 172.21.15.71:0/2875329663 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c27fc700 1 --2- 172.21.15.71:0/2875329663 >> v2:172.21.15.194:3300/0 conn(0x7fe7c40b5c90 0x7fe7c40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c2ffd700 1 -- 172.21.15.71:0/2875329663 >> v2:172.21.15.194:3300/0 conn(0x7fe7c40b5c90 msgr2=0x7fe7c40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c2ffd700 1 --2- 172.21.15.71:0/2875329663 >> v2:172.21.15.194:3300/0 conn(0x7fe7c40b5c90 0x7fe7c40d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c2ffd700 1 -- 172.21.15.71:0/2875329663 >> v1:172.21.15.71:6789/0 conn(0x7fe7c40b6110 legacy=0x7fe7c40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c2ffd700 1 -- 172.21.15.71:0/2875329663 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40cda50 con 0x7fe7c415fca0 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c27fc700 1 --2- 172.21.15.71:0/2875329663 >> v2:172.21.15.194:3300/0 conn(0x7fe7c40b5c90 0x7fe7c40d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c1ffb700 1 -- 172.21.15.71:0/2875329663 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176831539 0 0) 0x7fe7c40cf780 con 0x7fe7c40b6110 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c2ffd700 1 --2- 172.21.15.71:0/2875329663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c40d1420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7c406b6f0 tx=0x7fe7b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d5bd4bbbaa1629 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c1ffb700 1 -- 172.21.15.71:0/2875329663 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400b870 con 0x7fe7c415fca0 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c1ffb700 1 -- 172.21.15.71:0/2875329663 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b400b9d0 con 0x7fe7c415fca0 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.818+0000 7fe7c1ffb700 1 -- 172.21.15.71:0/2875329663 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400bd60 con 0x7fe7c415fca0 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2875329663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 msgr2=0x7fe7c40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2875329663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c40d1420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7c406b6f0 tx=0x7fe7b4009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2875329663 shutdown_connections 2023-07-06T01:09:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2875329663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c40d1420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2875329663 >> v2:172.21.15.194:3300/0 conn(0x7fe7c40b5c90 0x7fe7c40d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2875329663 >> 172.21.15.71:0/2875329663 conn(0x7fe7c406c150 msgr2=0x7fe7c406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2875329663 shutdown_connections 2023-07-06T01:09:34.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.819+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2875329663 wait complete. 2023-07-06T01:09:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.821+0000 7fe7c99ff700 1 Processor -- start 2023-07-06T01:09:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.821+0000 7fe7c99ff700 1 -- start start 2023-07-06T01:09:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c99ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7c40b5c90 0x7fe7c415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c99ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c40b6110 0x7fe7c40b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c99ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c99ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41f65f0 con 0x7fe7c415fca0 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c99ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41f5a70 con 0x7fe7c40b6110 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c99ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41f5d50 con 0x7fe7c40b5c90 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44598/0 (socket says 172.21.15.71:44598) 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 -- 172.21.15.71:0/2889082570 learned_addr learned my addr 172.21.15.71:0/2889082570 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:34.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c27fc700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c40b6110 0x7fe7c40b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c2ffd700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7c40b5c90 0x7fe7c415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 -- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7c40b5c90 msgr2=0x7fe7c415b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7c40b5c90 0x7fe7c415b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 -- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c40b6110 msgr2=0x7fe7c40b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c40b6110 0x7fe7c40b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 -- 172.21.15.71:0/2889082570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4009550 con 0x7fe7c415fca0 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c27fc700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c40b6110 0x7fe7c40b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:34.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.822+0000 7fe7c37fe700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c415cac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc001560 tx=0x7fe7bc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.823+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc003e30 con 0x7fe7c415fca0 2023-07-06T01:09:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.823+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc005070 con 0x7fe7c415fca0 2023-07-06T01:09:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.823+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc005420 con 0x7fe7c415fca0 2023-07-06T01:09:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.823+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c41f6030 con 0x7fe7c415fca0 2023-07-06T01:09:34.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.823+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c415bc70 con 0x7fe7c415fca0 2023-07-06T01:09:34.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.824+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c40008d0 con 0x7fe7c415fca0 2023-07-06T01:09:34.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.825+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7bc005580 con 0x7fe7c415fca0 2023-07-06T01:09:34.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.826+0000 7fe7abfff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe7b006ace0 0x7fe7b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:34.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.826+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe7bc088cb0 con 0x7fe7c415fca0 2023-07-06T01:09:34.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.826+0000 7fe7c2ffd700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe7b006ace0 0x7fe7b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:34.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.827+0000 7fe7c2ffd700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe7b006ace0 0x7fe7b006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4014040 tx=0x7fe7b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:34.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:34.830+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7bc053d10 con 0x7fe7c415fca0 2023-07-06T01:09:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.024+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7c406a3c0 con 0x7fe7c415fca0 2023-07-06T01:09:35.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.024+0000 7fe7abfff700 1 -- 172.21.15.71:0/2889082570 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7bc0170a0 con 0x7fe7c415fca0 2023-07-06T01:09:35.027 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:35.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe7b006ace0 msgr2=0x7fe7b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe7b006ace0 0x7fe7b006d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4014040 tx=0x7fe7b4008030 comp rx=0 tx=0).stop 2023-07-06T01:09:35.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 msgr2=0x7fe7c415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c415cac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc001560 tx=0x7fe7bc00cc00 comp rx=0 tx=0).stop 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 shutdown_connections 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe7b006ace0 0x7fe7b006d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7c415fca0 0x7fe7c415cac0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7c40b5c90 0x7fe7c415b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 --2- 172.21.15.71:0/2889082570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7c40b6110 0x7fe7c40b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.026+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 >> 172.21.15.71:0/2889082570 conn(0x7fe7c406c150 msgr2=0x7fe7c40b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:35.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.027+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 shutdown_connections 2023-07-06T01:09:35.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.027+0000 7fe7c99ff700 1 -- 172.21.15.71:0/2889082570 wait complete. 2023-07-06T01:09:35.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.242+0000 7fc5d6fff700 1 Processor -- start 2023-07-06T01:09:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.242+0000 7fc5d6fff700 1 -- start start 2023-07-06T01:09:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.243+0000 7fc5d6fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc5d015fca0 0x7fc5d00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.243+0000 7fc5d6fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.243+0000 7fc5d6fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d00cf780 con 0x7fc5d00b60e0 2023-07-06T01:09:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.243+0000 7fc5d6fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d00cd490 con 0x7fc5d015fca0 2023-07-06T01:09:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.243+0000 7fc5d6fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00cd770 con 0x7fc5d00b5c90 2023-07-06T01:09:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc5d015fca0 0x7fc5d00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc5d015fca0 0x7fc5d00d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44610/0 (socket says 172.21.15.71:44610) 2023-07-06T01:09:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 -- 172.21.15.71:0/3292814326 learned_addr learned my addr 172.21.15.71:0/3292814326 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5cffff700 1 --2- 172.21.15.71:0/3292814326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 -- 172.21.15.71:0/3292814326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 msgr2=0x7fc5d00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 --2- 172.21.15.71:0/3292814326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d00d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 -- 172.21.15.71:0/3292814326 >> v1:172.21.15.71:6789/0 conn(0x7fc5d00b60e0 legacy=0x7fc5d00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 -- 172.21.15.71:0/3292814326 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00cda50 con 0x7fc5d015fca0 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5cf7fe700 1 -- 172.21.15.71:0/3292814326 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520121747 0 0) 0x7fc5d00cf780 con 0x7fc5d00b60e0 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.244+0000 7fc5d4d9b700 1 --2- 172.21.15.71:0/3292814326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d1420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40098f0 tx=0x7fc5c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4d9dd83036d063 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5cf7fe700 1 -- 172.21.15.71:0/3292814326 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400b8a0 con 0x7fc5d015fca0 2023-07-06T01:09:35.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5cf7fe700 1 -- 172.21.15.71:0/3292814326 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400ba00 con 0x7fc5d015fca0 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5cf7fe700 1 -- 172.21.15.71:0/3292814326 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400bd90 con 0x7fc5d015fca0 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 -- 172.21.15.71:0/3292814326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d015fca0 msgr2=0x7fc5d00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/3292814326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d1420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40098f0 tx=0x7fc5c4009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 -- 172.21.15.71:0/3292814326 shutdown_connections 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/3292814326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d1420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/3292814326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 -- 172.21.15.71:0/3292814326 >> 172.21.15.71:0/3292814326 conn(0x7fc5d006c150 msgr2=0x7fc5d006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 -- 172.21.15.71:0/3292814326 shutdown_connections 2023-07-06T01:09:35.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.245+0000 7fc5d6fff700 1 -- 172.21.15.71:0/3292814326 wait complete. 2023-07-06T01:09:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.247+0000 7fc5d6fff700 1 Processor -- start 2023-07-06T01:09:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.247+0000 7fc5d6fff700 1 -- start start 2023-07-06T01:09:35.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5d6fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5d6fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 0x7fc5d00c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5d6fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5d6fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00cc1a0 con 0x7fc5d00b60e0 2023-07-06T01:09:35.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5d6fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d014c470 con 0x7fc5d015fca0 2023-07-06T01:09:35.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5d6fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00cb520 con 0x7fc5d00b5c90 2023-07-06T01:09:35.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5cffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 0x7fc5d00c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5cffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 0x7fc5d00c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44618/0 (socket says 172.21.15.71:44618) 2023-07-06T01:09:35.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.248+0000 7fc5cffff700 1 -- 172.21.15.71:0/937191773 learned_addr learned my addr 172.21.15.71:0/937191773 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:35.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5d559c700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5d4d9b700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cffff700 1 -- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 msgr2=0x7fc5d014c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cffff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d014c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cffff700 1 -- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5d015fca0 msgr2=0x7fc5d00d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cffff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cffff700 1 -- 172.21.15.71:0/937191773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4009550 con 0x7fc5d00b60e0 2023-07-06T01:09:35.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5d559c700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:35.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cffff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 0x7fc5d00c8a60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00e810 tx=0x7fc5bc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:35.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc013610 con 0x7fc5d00b60e0 2023-07-06T01:09:35.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc013770 con 0x7fc5d00b60e0 2023-07-06T01:09:35.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc013b20 con 0x7fc5d00b60e0 2023-07-06T01:09:35.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d00cb800 con 0x7fc5d00b60e0 2023-07-06T01:09:35.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.249+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d00cbdc0 con 0x7fc5d00b60e0 2023-07-06T01:09:35.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.251+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d00cc410 con 0x7fc5d00b60e0 2023-07-06T01:09:35.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.251+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5bc013c80 con 0x7fc5d00b60e0 2023-07-06T01:09:35.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.253+0000 7fc5cd7fa700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5b406ace0 0x7fc5b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.253+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc5bc089260 con 0x7fc5d00b60e0 2023-07-06T01:09:35.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.254+0000 7fc5d4d9b700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5b406ace0 0x7fc5b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.255+0000 7fc5d4d9b700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5b406ace0 0x7fc5b406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4014040 tx=0x7fc5c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:35.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.258+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5bc054240 con 0x7fc5d00b60e0 2023-07-06T01:09:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.452+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5d00cf3f0 con 0x7fc5d00b60e0 2023-07-06T01:09:35.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.453+0000 7fc5cd7fa700 1 -- 172.21.15.71:0/937191773 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5d00cf3f0 con 0x7fc5d00b60e0 2023-07-06T01:09:35.455 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:35.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5b406ace0 msgr2=0x7fc5b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5b406ace0 0x7fc5b406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4014040 tx=0x7fc5c4008030 comp rx=0 tx=0).stop 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 msgr2=0x7fc5d00c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 0x7fc5d00c8a60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00e810 tx=0x7fc5bc00ebd0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 shutdown_connections 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5b406ace0 0x7fc5b406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5d015fca0 0x7fc5d00d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc5d00b5c90 0x7fc5d014c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 --2- 172.21.15.71:0/937191773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc5d00b60e0 0x7fc5d00c8a60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 >> 172.21.15.71:0/937191773 conn(0x7fc5d006c150 msgr2=0x7fc5d00b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:35.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 shutdown_connections 2023-07-06T01:09:35.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.455+0000 7fc5d6fff700 1 -- 172.21.15.71:0/937191773 wait complete. 2023-07-06T01:09:35.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:35.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.670+0000 7fdf82bff700 1 Processor -- start 2023-07-06T01:09:35.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.670+0000 7fdf82bff700 1 -- start start 2023-07-06T01:09:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.671+0000 7fdf82bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7c0b5c90 0x7fdf7c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.671+0000 7fdf82bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdf7c0b6110 0x7fdf7c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf82bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0cf780 con 0x7fdf7c15fca0 2023-07-06T01:09:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf82bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cd490 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf82bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cd770 con 0x7fdf7c0b6110 2023-07-06T01:09:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7c0b5c90 0x7fdf7c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf7c0b5c90 0x7fdf7c0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44622/0 (socket says 172.21.15.71:44622) 2023-07-06T01:09:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 -- 172.21.15.71:0/1271983944 learned_addr learned my addr 172.21.15.71:0/1271983944 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:35.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf8099b700 1 --1- 172.21.15.71:0/1271983944 >> v1:172.21.15.71:6789/0 conn(0x7fdf7c15fca0 0x7fdf7c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37874/0 (socket says 172.21.15.71:37874) 2023-07-06T01:09:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 -- 172.21.15.71:0/1271983944 >> v2:172.21.15.194:3300/0 conn(0x7fdf7c0b6110 msgr2=0x7fdf7c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf8119c700 1 --2- 172.21.15.71:0/1271983944 >> v2:172.21.15.194:3300/0 conn(0x7fdf7c0b6110 0x7fdf7c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 --2- 172.21.15.71:0/1271983944 >> v2:172.21.15.194:3300/0 conn(0x7fdf7c0b6110 0x7fdf7c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7b7fe700 1 -- 172.21.15.71:0/1271983944 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179662014 0 0) 0x7fdf7c0cf780 con 0x7fdf7c15fca0 2023-07-06T01:09:35.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 -- 172.21.15.71:0/1271983944 >> v1:172.21.15.71:6789/0 conn(0x7fdf7c15fca0 legacy=0x7fdf7c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf7bfff700 1 -- 172.21.15.71:0/1271983944 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0cda50 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.672+0000 7fdf8119c700 1 --2- 172.21.15.71:0/1271983944 >> v2:172.21.15.194:3300/0 conn(0x7fdf7c0b6110 0x7fdf7c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf7bfff700 1 --2- 172.21.15.71:0/1271983944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c0d2d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0cd410 tx=0x7fdf68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521f8cdf623671f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf7b7fe700 1 -- 172.21.15.71:0/1271983944 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800b870 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf7b7fe700 1 -- 172.21.15.71:0/1271983944 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800b9d0 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf7b7fe700 1 -- 172.21.15.71:0/1271983944 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800bd60 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 -- 172.21.15.71:0/1271983944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 msgr2=0x7fdf7c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 --2- 172.21.15.71:0/1271983944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c0d2d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0cd410 tx=0x7fdf68009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 -- 172.21.15.71:0/1271983944 shutdown_connections 2023-07-06T01:09:35.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 --2- 172.21.15.71:0/1271983944 >> v2:172.21.15.194:3300/0 conn(0x7fdf7c0b6110 0x7fdf7c0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 --2- 172.21.15.71:0/1271983944 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c0d2d40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 -- 172.21.15.71:0/1271983944 >> 172.21.15.71:0/1271983944 conn(0x7fdf7c06c150 msgr2=0x7fdf7c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.673+0000 7fdf82bff700 1 -- 172.21.15.71:0/1271983944 shutdown_connections 2023-07-06T01:09:35.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.674+0000 7fdf82bff700 1 -- 172.21.15.71:0/1271983944 wait complete. 2023-07-06T01:09:35.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.675+0000 7fdf82bff700 1 Processor -- start 2023-07-06T01:09:35.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.675+0000 7fdf82bff700 1 -- start start 2023-07-06T01:09:35.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.676+0000 7fdf82bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.676+0000 7fdf82bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7c0b6110 0x7fdf7c1f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.676+0000 7fdf82bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7c15fca0 0x7fdf7c0d2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.676+0000 7fdf82bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c1f69a0 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.676+0000 7fdf82bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0ccb40 con 0x7fdf7c0b6110 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.676+0000 7fdf82bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c157410 con 0x7fdf7c15fca0 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c1565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44636/0 (socket says 172.21.15.71:44636) 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 -- 172.21.15.71:0/642950529 learned_addr learned my addr 172.21.15.71:0/642950529 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:35.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf7bfff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7c0b6110 0x7fdf7c1f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8119c700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7c15fca0 0x7fdf7c0d2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 -- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7c15fca0 msgr2=0x7fdf7c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7c15fca0 0x7fdf7c0d2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 -- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7c0b6110 msgr2=0x7fdf7c1f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7c0b6110 0x7fdf7c1f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 -- 172.21.15.71:0/642950529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf68009550 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf7bfff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7c0b6110 0x7fdf7c1f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf8099b700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c1565b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c550 tx=0x7fdf7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.677+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70004c80 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.678+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70004e00 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.678+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70007310 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.678+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c0cc080 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.678+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c0cc860 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.679+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c0008d0 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.680+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf70007470 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.681+0000 7fdf797fa700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdf6006ace0 0x7fdf6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:35.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.681+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fdf70089200 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.681+0000 7fdf7bfff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdf6006ace0 0x7fdf6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:35.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.682+0000 7fdf7bfff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdf6006ace0 0x7fdf6006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c157a80 tx=0x7fdf68008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:35.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.685+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf70054270 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.877+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf7c0cc360 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.878+0000 7fdf797fa700 1 -- 172.21.15.71:0/642950529 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf70057890 con 0x7fdf7c0b5c90 2023-07-06T01:09:35.881 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdf6006ace0 msgr2=0x7fdf6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdf6006ace0 0x7fdf6006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c157a80 tx=0x7fdf68008030 comp rx=0 tx=0).stop 2023-07-06T01:09:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 msgr2=0x7fdf7c1565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c1565b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c550 tx=0x7fdf7000c910 comp rx=0 tx=0).stop 2023-07-06T01:09:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 shutdown_connections 2023-07-06T01:09:35.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdf6006ace0 0x7fdf6006d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7c15fca0 0x7fdf7c0d2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf7c0b5c90 0x7fdf7c1565b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 --2- 172.21.15.71:0/642950529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7c0b6110 0x7fdf7c1f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 >> 172.21.15.71:0/642950529 conn(0x7fdf7c06c150 msgr2=0x7fdf7c0b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 shutdown_connections 2023-07-06T01:09:35.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:35.880+0000 7fdf82bff700 1 -- 172.21.15.71:0/642950529 wait complete. 2023-07-06T01:09:35.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:36.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.095+0000 7fd8b13ff700 1 Processor -- start 2023-07-06T01:09:36.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.095+0000 7fd8b13ff700 1 -- start start 2023-07-06T01:09:36.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.096+0000 7fd8b13ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8ac15fca0 0x7fd8ac0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8b13ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8b13ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0cf780 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8b13ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ac0cd490 con 0x7fd8ac15fca0 2023-07-06T01:09:36.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8b13ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0cd770 con 0x7fd8ac0b6110 2023-07-06T01:09:36.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8a3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd8ac0b5c90 0x7fd8ac0d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37890/0 (socket says 172.21.15.71:37890) 2023-07-06T01:09:36.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8a3fff700 1 -- 172.21.15.71:0/2394803446 learned_addr learned my addr 172.21.15.71:0/2394803446 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:36.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8aaffd700 1 --2- 172.21.15.71:0/2394803446 >> v2:172.21.15.194:3300/0 conn(0x7fd8ac15fca0 0x7fd8ac0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8ab7fe700 1 --2- 172.21.15.71:0/2394803446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8aa7fc700 1 -- 172.21.15.71:0/2394803446 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335691230 0 0) 0x7fd8ac0cf780 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.097+0000 7fd8aa7fc700 1 -- 172.21.15.71:0/2394803446 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8980035b0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8ab7fe700 1 -- 172.21.15.71:0/2394803446 >> v2:172.21.15.194:3300/0 conn(0x7fd8ac15fca0 msgr2=0x7fd8ac0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8ab7fe700 1 --2- 172.21.15.71:0/2394803446 >> v2:172.21.15.194:3300/0 conn(0x7fd8ac15fca0 0x7fd8ac0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8aa7fc700 1 -- 172.21.15.71:0/2394803446 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3159364305 0 0) 0x7fd8980035b0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8ab7fe700 1 -- 172.21.15.71:0/2394803446 >> v1:172.21.15.71:6789/0 conn(0x7fd8ac0b5c90 legacy=0x7fd8ac0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8ab7fe700 1 -- 172.21.15.71:0/2394803446 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac0cda50 con 0x7fd8ac0b6110 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8aaffd700 1 --2- 172.21.15.71:0/2394803446 >> v2:172.21.15.194:3300/0 conn(0x7fd8ac15fca0 0x7fd8ac0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8ab7fe700 1 --2- 172.21.15.71:0/2394803446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0cfc10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009d90 tx=0x7fd8a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a614636270c2d985 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:36.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8aa7fc700 1 -- 172.21.15.71:0/2394803446 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400e070 con 0x7fd8ac0b6110 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8aa7fc700 1 -- 172.21.15.71:0/2394803446 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4003a20 con 0x7fd8ac0b6110 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.098+0000 7fd8aa7fc700 1 -- 172.21.15.71:0/2394803446 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894001670 con 0x7fd8ac0b6110 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 -- 172.21.15.71:0/2394803446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 msgr2=0x7fd8ac0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/2394803446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0cfc10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009d90 tx=0x7fd8a400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 -- 172.21.15.71:0/2394803446 shutdown_connections 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/2394803446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0cfc10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/2394803446 >> v2:172.21.15.194:3300/0 conn(0x7fd8ac15fca0 0x7fd8ac0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 -- 172.21.15.71:0/2394803446 >> 172.21.15.71:0/2394803446 conn(0x7fd8ac06c150 msgr2=0x7fd8ac06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:36.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 -- 172.21.15.71:0/2394803446 shutdown_connections 2023-07-06T01:09:36.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.099+0000 7fd8b13ff700 1 -- 172.21.15.71:0/2394803446 wait complete. 2023-07-06T01:09:36.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.101+0000 7fd8b13ff700 1 Processor -- start 2023-07-06T01:09:36.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.101+0000 7fd8b13ff700 1 -- start start 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8b13ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 0x7fd8ac0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8b13ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8b13ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8ac15fca0 0x7fd8ac15da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8b13ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b47d0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8b13ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b3e00 con 0x7fd8ac15fca0 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8b13ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b31f0 con 0x7fd8ac0b6110 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 0x7fd8ac0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 0x7fd8ac0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44648/0 (socket says 172.21.15.71:44648) 2023-07-06T01:09:36.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 -- 172.21.15.71:0/1878992195 learned_addr learned my addr 172.21.15.71:0/1878992195 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:36.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 -- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 msgr2=0x7fd8ac0b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 -- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8ac15fca0 msgr2=0x7fd8ac15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8ac15fca0 0x7fd8ac15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 -- 172.21.15.71:0/1878992195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0094a0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.102+0000 7fd8aaffd700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 0x7fd8ac0b4290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00ebe0 tx=0x7fd89c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.103+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00c8b0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.103+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c00ca10 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.103+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a4009a70 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.103+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00cda0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.103+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac0b3a90 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.104+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ac0008d0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.105+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd89c013470 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.105+0000 7fd8a37fe700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd88c06ad10 0x7fd88c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.106+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd89c089580 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.106+0000 7fd8a3fff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd88c06ad10 0x7fd88c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.107+0000 7fd8a3fff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd88c06ad10 0x7fd88c06d1c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8940011e0 tx=0x7fd8940010f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:36.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.110+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd89c0545e0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.303+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8ac0b34d0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.304+0000 7fd8a37fe700 1 -- 172.21.15.71:0/1878992195 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8ac0b34d0 con 0x7fd8ac0b5c90 2023-07-06T01:09:36.307 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:36.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd88c06ad10 msgr2=0x7fd88c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd88c06ad10 0x7fd88c06d1c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd8940011e0 tx=0x7fd8940010f0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 msgr2=0x7fd8ac0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 0x7fd8ac0b4290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00ebe0 tx=0x7fd89c009e20 comp rx=0 tx=0).stop 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 shutdown_connections 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd88c06ad10 0x7fd88c06d1c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8ac15fca0 0x7fd8ac15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8ac0b5c90 0x7fd8ac0b4290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 --2- 172.21.15.71:0/1878992195 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8ac0b6110 0x7fd8ac0b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.306+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 >> 172.21.15.71:0/1878992195 conn(0x7fd8ac06c150 msgr2=0x7fd8ac0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:36.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.307+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 shutdown_connections 2023-07-06T01:09:36.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.307+0000 7fd8b13ff700 1 -- 172.21.15.71:0/1878992195 wait complete. 2023-07-06T01:09:36.339 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-07-06T01:09:36.340 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-07-06T01:09:36.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.531+0000 7f8a93fff700 1 Processor -- start 2023-07-06T01:09:36.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.531+0000 7f8a93fff700 1 -- start start 2023-07-06T01:09:36.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c0b5c90 0x7f8a8c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a93fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a8c0b60e0 0x7f8a8c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a93fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c0cf780 con 0x7f8a8c15fca0 2023-07-06T01:09:36.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a93fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0cd490 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a93fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0cd770 con 0x7f8a8c0b5c90 2023-07-06T01:09:36.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a9259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a8c0b60e0 0x7f8a8c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a9259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8a8c0b60e0 0x7f8a8c0d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44664/0 (socket says 172.21.15.71:44664) 2023-07-06T01:09:36.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a9259c700 1 -- 172.21.15.71:0/2471278162 learned_addr learned my addr 172.21.15.71:0/2471278162 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:36.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.532+0000 7f8a9159a700 1 --2- 172.21.15.71:0/2471278162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c0b5c90 0x7f8a8c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a9259c700 1 -- 172.21.15.71:0/2471278162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c0b5c90 msgr2=0x7f8a8c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:36.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a9259c700 1 --2- 172.21.15.71:0/2471278162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c0b5c90 0x7f8a8c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a9259c700 1 -- 172.21.15.71:0/2471278162 >> v1:172.21.15.194:6789/0 conn(0x7f8a8c15fca0 legacy=0x7f8a8c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a9259c700 1 -- 172.21.15.71:0/2471278162 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0cda50 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a9259c700 1 --2- 172.21.15.71:0/2471278162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c0d3280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009e50 tx=0x7f8a8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb5858a2fd0e5d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:36.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a90d99700 1 -- 172.21.15.71:0/2471278162 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400e070 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a90d99700 1 -- 172.21.15.71:0/2471278162 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8400b910 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.533+0000 7f8a90d99700 1 -- 172.21.15.71:0/2471278162 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400bcc0 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 -- 172.21.15.71:0/2471278162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 msgr2=0x7f8a8c0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 --2- 172.21.15.71:0/2471278162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c0d3280 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009e50 tx=0x7f8a8400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 -- 172.21.15.71:0/2471278162 shutdown_connections 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 --2- 172.21.15.71:0/2471278162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c0d3280 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 --2- 172.21.15.71:0/2471278162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c0b5c90 0x7f8a8c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 -- 172.21.15.71:0/2471278162 >> 172.21.15.71:0/2471278162 conn(0x7f8a8c06c150 msgr2=0x7f8a8c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:36.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 -- 172.21.15.71:0/2471278162 shutdown_connections 2023-07-06T01:09:36.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.534+0000 7f8a93fff700 1 -- 172.21.15.71:0/2471278162 wait complete. 2023-07-06T01:09:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.536+0000 7f8a93fff700 1 Processor -- start 2023-07-06T01:09:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.537+0000 7f8a93fff700 1 -- start start 2023-07-06T01:09:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a8c0b5c90 0x7f8a8c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a93fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c15fca0 0x7f8a8c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a93fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c1f2cb0 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a93fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c157a80 con 0x7f8a8c0b5c90 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a93fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c15d770 con 0x7f8a8c15fca0 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c1f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44666/0 (socket says 172.21.15.71:44666) 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9159a700 1 -- 172.21.15.71:0/3215813149 learned_addr learned my addr 172.21.15.71:0/3215813149 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:36.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a91d9b700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a8c0b5c90 0x7f8a8c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9259c700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c15fca0 0x7f8a8c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9159a700 1 -- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c15fca0 msgr2=0x7f8a8c157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9159a700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c15fca0 0x7f8a8c157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.538+0000 7f8a9159a700 1 -- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a8c0b5c90 msgr2=0x7f8a8c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a9159a700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a8c0b5c90 0x7f8a8c15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a9159a700 1 -- 172.21.15.71:0/3215813149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84009b30 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a9159a700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c1f2770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00e9b0 tx=0x7f8a7c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:36.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c009710 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c00ee50 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c15b860 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00ca50 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.539+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c15be20 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.540+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c0d3cf0 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.541+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a7c00cbb0 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.542+0000 7f8a827fc700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8a7006ace0 0x7f8a7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.542+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8a7c0894c0 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.543+0000 7f8a91d9b700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8a7006ace0 0x7f8a7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:36.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.544+0000 7f8a91d9b700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8a7006ace0 0x7f8a7006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0b7f00 tx=0x7f8a88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.546+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a7c057fb0 con 0x7f8a8c0b60e0 2023-07-06T01:09:36.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:36.821+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f8a8c0008d0 con 0x7f8a8c0b60e0 2023-07-06T01:09:37.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.585+0000 7f8a827fc700 1 -- 172.21.15.71:0/3215813149 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v64) v1 ==== 163+0+0 (secure 0 0 0) 0x7f8a7c00ce60 con 0x7f8a8c0b60e0 2023-07-06T01:09:37.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.588+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8a7006ace0 msgr2=0x7f8a7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:37.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.588+0000 7f8a93fff700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8a7006ace0 0x7f8a7006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0b7f00 tx=0x7f8a88009040 comp rx=0 tx=0).stop 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.588+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 msgr2=0x7f8a8c1f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.588+0000 7f8a93fff700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c1f2770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00e9b0 tx=0x7f8a7c00ecc0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 shutdown_connections 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8a7006ace0 0x7f8a7006d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a8c15fca0 0x7f8a8c157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a8c0b5c90 0x7f8a8c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 --2- 172.21.15.71:0/3215813149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a8c0b60e0 0x7f8a8c1f2770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 >> 172.21.15.71:0/3215813149 conn(0x7f8a8c06c150 msgr2=0x7f8a8c0b8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:37.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 shutdown_connections 2023-07-06T01:09:37.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.589+0000 7f8a93fff700 1 -- 172.21.15.71:0/3215813149 wait complete. 2023-07-06T01:09:37.611 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T01:09:37.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.811+0000 7f6d4a3ff700 1 Processor -- start 2023-07-06T01:09:37.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.811+0000 7f6d4a3ff700 1 -- start start 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4a3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d440d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4a3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6d440b60e0 0x7f6d440d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4a3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d440cf780 con 0x7f6d4415fca0 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4a3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d440cd490 con 0x7f6d440b60e0 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4a3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d440cd770 con 0x7f6d440b5c90 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6d440b60e0 0x7f6d440d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:37.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4899c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6d440b60e0 0x7f6d440d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44668/0 (socket says 172.21.15.71:44668) 2023-07-06T01:09:37.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.812+0000 7f6d4899c700 1 -- 172.21.15.71:0/542431098 learned_addr learned my addr 172.21.15.71:0/542431098 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:37.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d437fe700 1 --2- 172.21.15.71:0/542431098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d440d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:37.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d4899c700 1 -- 172.21.15.71:0/542431098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 msgr2=0x7f6d440d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:37.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d4899c700 1 --2- 172.21.15.71:0/542431098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d440d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d4899c700 1 -- 172.21.15.71:0/542431098 >> v1:172.21.15.194:6789/0 conn(0x7f6d4415fca0 legacy=0x7f6d440d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:37.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d4899c700 1 -- 172.21.15.71:0/542431098 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440cda50 con 0x7f6d440b60e0 2023-07-06T01:09:37.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d4899c700 1 --2- 172.21.15.71:0/542431098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440d3280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009e50 tx=0x7f6d3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab6a673cffaed97 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:37.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d42ffd700 1 -- 172.21.15.71:0/542431098 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00e070 con 0x7f6d440b60e0 2023-07-06T01:09:37.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d42ffd700 1 -- 172.21.15.71:0/542431098 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00b9c0 con 0x7f6d440b60e0 2023-07-06T01:09:37.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.813+0000 7f6d42ffd700 1 -- 172.21.15.71:0/542431098 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00bd70 con 0x7f6d440b60e0 2023-07-06T01:09:37.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/542431098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 msgr2=0x7f6d440d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:37.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/542431098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440d3280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009e50 tx=0x7f6d3c00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:37.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/542431098 shutdown_connections 2023-07-06T01:09:37.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/542431098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440d3280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/542431098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d440d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/542431098 >> 172.21.15.71:0/542431098 conn(0x7f6d4406c150 msgr2=0x7f6d4406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:37.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/542431098 shutdown_connections 2023-07-06T01:09:37.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.814+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/542431098 wait complete. 2023-07-06T01:09:37.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.816+0000 7f6d4a3ff700 1 Processor -- start 2023-07-06T01:09:37.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.816+0000 7f6d4a3ff700 1 -- start start 2023-07-06T01:09:37.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d4a3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d4415b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:37.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d4a3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:37.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d4a3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4415fca0 0x7f6d440b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:37.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d4a3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d441e84b0 con 0x7f6d440b60e0 2023-07-06T01:09:37.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d4a3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d441e8720 con 0x7f6d4415fca0 2023-07-06T01:09:37.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d4a3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d441e8a00 con 0x7f6d440b5c90 2023-07-06T01:09:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d437fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d437fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44672/0 (socket says 172.21.15.71:44672) 2023-07-06T01:09:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d437fe700 1 -- 172.21.15.71:0/3902601262 learned_addr learned my addr 172.21.15.71:0/3902601262 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.817+0000 7f6d43fff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d4415b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:37.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d4899c700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4415fca0 0x7f6d440b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d437fe700 1 -- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 msgr2=0x7f6d4415b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d437fe700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d4415b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d437fe700 1 -- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4415fca0 msgr2=0x7f6d440b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:37.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d437fe700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4415fca0 0x7f6d440b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d437fe700 1 -- 172.21.15.71:0/3902601262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c009b30 con 0x7f6d440b60e0 2023-07-06T01:09:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d437fe700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440b3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e810 tx=0x7f6d3800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:37.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38013610 con 0x7f6d440b60e0 2023-07-06T01:09:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38013770 con 0x7f6d440b60e0 2023-07-06T01:09:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38013b20 con 0x7f6d440b60e0 2023-07-06T01:09:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d440caac0 con 0x7f6d440b60e0 2023-07-06T01:09:37.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.818+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d44156d90 con 0x7f6d440b60e0 2023-07-06T01:09:37.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.819+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d440ca920 con 0x7f6d440b60e0 2023-07-06T01:09:37.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.820+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d38013c80 con 0x7f6d440b60e0 2023-07-06T01:09:37.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.821+0000 7f6d40ff9700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6d3006ace0 0x7f6d3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:37.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.821+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6d38089240 con 0x7f6d440b60e0 2023-07-06T01:09:37.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.822+0000 7f6d43fff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6d3006ace0 0x7f6d3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:37.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.822+0000 7f6d43fff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6d3006ace0 0x7f6d3006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6d34000f60 tx=0x7f6d34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:37.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:37.826+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6d440ca920 con 0x7f6d440b60e0 2023-07-06T01:09:38.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.021+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6d440ca920 con 0x7f6d440b60e0 2023-07-06T01:09:38.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.025+0000 7f6d40ff9700 1 -- 172.21.15.71:0/3902601262 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6d440ca920 con 0x7f6d440b60e0 2023-07-06T01:09:38.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.027+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6d3006ace0 msgr2=0x7f6d3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.027+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6d3006ace0 0x7f6d3006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6d34000f60 tx=0x7f6d34009040 comp rx=0 tx=0).stop 2023-07-06T01:09:38.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.027+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 msgr2=0x7f6d440b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.027+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440b3990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e810 tx=0x7f6d3800ebd0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 shutdown_connections 2023-07-06T01:09:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6d3006ace0 0x7f6d3006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d4415fca0 0x7f6d440b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d440b5c90 0x7f6d4415b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 --2- 172.21.15.71:0/3902601262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d440b60e0 0x7f6d440b3990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 >> 172.21.15.71:0/3902601262 conn(0x7f6d4406c150 msgr2=0x7f6d440b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 shutdown_connections 2023-07-06T01:09:38.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.028+0000 7f6d4a3ff700 1 -- 172.21.15.71:0/3902601262 wait complete. 2023-07-06T01:09:38.048 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T01:09:38.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T01:09:38.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T01:09:38.248 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T01:09:38.248 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:38.249 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:38.294 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:38.295 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:38.380 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:38.381 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:38.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.697+0000 7f42e51ff700 1 Processor -- start 2023-07-06T01:09:38.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.697+0000 7f42e51ff700 1 -- start start 2023-07-06T01:09:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.698+0000 7f42e51ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42e015fca0 0x7f42e00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.698+0000 7f42e51ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b6110 0x7f42e00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.698+0000 7f42e51ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00cf780 con 0x7f42e00b5c90 2023-07-06T01:09:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42e51ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e00cd490 con 0x7f42e015fca0 2023-07-06T01:09:38.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42e51ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e00cd770 con 0x7f42e00b6110 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42e015fca0 0x7f42e00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f42e015fca0 0x7f42e00d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44684/0 (socket says 172.21.15.71:44684) 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 -- 172.21.15.71:0/2728272700 learned_addr learned my addr 172.21.15.71:0/2728272700 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42df59e700 1 --2- 172.21.15.71:0/2728272700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b6110 0x7f42e00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 -- 172.21.15.71:0/2728272700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b6110 msgr2=0x7f42e00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 --2- 172.21.15.71:0/2728272700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b6110 0x7f42e00cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 -- 172.21.15.71:0/2728272700 >> v1:172.21.15.194:6789/0 conn(0x7f42e00b5c90 legacy=0x7f42e00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.699+0000 7f42ded9d700 1 -- 172.21.15.71:0/2728272700 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00cda50 con 0x7f42e015fca0 2023-07-06T01:09:38.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42ded9d700 1 --2- 172.21.15.71:0/2728272700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e00d1420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f42d00098f0 tx=0x7f42d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08adc951706c459 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:38.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42de59c700 1 -- 172.21.15.71:0/2728272700 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d000b8a0 con 0x7f42e015fca0 2023-07-06T01:09:38.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42de59c700 1 -- 172.21.15.71:0/2728272700 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d000ba00 con 0x7f42e015fca0 2023-07-06T01:09:38.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42de59c700 1 -- 172.21.15.71:0/2728272700 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d000bd90 con 0x7f42e015fca0 2023-07-06T01:09:38.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42e51ff700 1 -- 172.21.15.71:0/2728272700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 msgr2=0x7f42e00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2728272700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e00d1420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f42d00098f0 tx=0x7f42d0009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:38.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42e51ff700 1 -- 172.21.15.71:0/2728272700 shutdown_connections 2023-07-06T01:09:38.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2728272700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b6110 0x7f42e00cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2728272700 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e00d1420 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.700+0000 7f42e51ff700 1 -- 172.21.15.71:0/2728272700 >> 172.21.15.71:0/2728272700 conn(0x7f42e006c150 msgr2=0x7f42e006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:38.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.701+0000 7f42e51ff700 1 -- 172.21.15.71:0/2728272700 shutdown_connections 2023-07-06T01:09:38.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.701+0000 7f42e51ff700 1 -- 172.21.15.71:0/2728272700 wait complete. 2023-07-06T01:09:38.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.702+0000 7f42e51ff700 1 Processor -- start 2023-07-06T01:09:38.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.702+0000 7f42e51ff700 1 -- start start 2023-07-06T01:09:38.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.703+0000 7f42e51ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b5c90 0x7f42e00d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:38.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.703+0000 7f42e51ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42e00b6110 0x7f42e0156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:38.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.703+0000 7f42e51ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e0157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:38.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.703+0000 7f42e51ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0157970 con 0x7f42e015fca0 2023-07-06T01:09:38.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.703+0000 7f42e51ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01f2040 con 0x7f42e00b6110 2023-07-06T01:09:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.703+0000 7f42e51ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01f2320 con 0x7f42e00b5c90 2023-07-06T01:09:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e0157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e0157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44688/0 (socket says 172.21.15.71:44688) 2023-07-06T01:09:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 -- 172.21.15.71:0/2116949216 learned_addr learned my addr 172.21.15.71:0/2116949216 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42ded9d700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b5c90 0x7f42e00d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42d7fff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42e00b6110 0x7f42e0156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:38.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 -- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b5c90 msgr2=0x7f42e00d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b5c90 0x7f42e00d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 -- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42e00b6110 msgr2=0x7f42e0156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42e00b6110 0x7f42e0156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 -- 172.21.15.71:0/2116949216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d0009550 con 0x7f42e015fca0 2023-07-06T01:09:38.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.704+0000 7f42df59e700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e0157430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42d8007e40 tx=0x7f42d800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.705+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800ede0 con 0x7f42e015fca0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.705+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d8014420 con 0x7f42e015fca0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.705+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80147d0 con 0x7f42e015fca0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.705+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e01f2600 con 0x7f42e015fca0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.705+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01f2bc0 con 0x7f42e015fca0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.706+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e01f2de0 con 0x7f42e015fca0 2023-07-06T01:09:38.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.707+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42d8014930 con 0x7f42e015fca0 2023-07-06T01:09:38.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.708+0000 7f42d77fe700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42c006ace0 0x7f42c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:38.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.708+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f42d8089ce0 con 0x7f42e015fca0 2023-07-06T01:09:38.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.708+0000 7f42ded9d700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42c006ace0 0x7f42c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:38.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.709+0000 7f42ded9d700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42c006ace0 0x7f42c006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42d0014040 tx=0x7f42d0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:38.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.712+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42d8058740 con 0x7f42e015fca0 2023-07-06T01:09:38.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.911+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42e00cd150 con 0x7f42e015fca0 2023-07-06T01:09:38.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.912+0000 7f42d77fe700 1 -- 172.21.15.71:0/2116949216 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f42d80582d0 con 0x7f42e015fca0 2023-07-06T01:09:38.915 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:38.915 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:38.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42c006ace0 msgr2=0x7f42c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42c006ace0 0x7f42c006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42d0014040 tx=0x7f42d0008030 comp rx=0 tx=0).stop 2023-07-06T01:09:38.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 msgr2=0x7f42e0157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:38.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e0157430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42d8007e40 tx=0x7f42d800e3c0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 shutdown_connections 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42c006ace0 0x7f42c006d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42e015fca0 0x7f42e0157430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42e00b5c90 0x7f42e00d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 --2- 172.21.15.71:0/2116949216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42e00b6110 0x7f42e0156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.914+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 >> 172.21.15.71:0/2116949216 conn(0x7f42e006c150 msgr2=0x7f42e00b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:38.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.915+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 shutdown_connections 2023-07-06T01:09:38.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:38.915+0000 7f42e51ff700 1 -- 172.21.15.71:0/2116949216 wait complete. 2023-07-06T01:09:38.936 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:38.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:39.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.134+0000 7f30dcdff700 1 Processor -- start 2023-07-06T01:09:39.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.134+0000 7f30dcdff700 1 -- start start 2023-07-06T01:09:39.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.135+0000 7f30dcdff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f30d8143900 0x7f30d815df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.135+0000 7f30dcdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f30d815b0e0 0x7f30d815b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.135+0000 7f30dcdff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d81441f0 con 0x7f30d80b0440 2023-07-06T01:09:39.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.135+0000 7f30dcdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d815a930 con 0x7f30d815b0e0 2023-07-06T01:09:39.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.135+0000 7f30dcdff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d815e660 con 0x7f30d8143900 2023-07-06T01:09:39.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.135+0000 7f30d6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f30d815b0e0 0x7f30d815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f30d815b0e0 0x7f30d815b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44694/0 (socket says 172.21.15.71:44694) 2023-07-06T01:09:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 -- 172.21.15.71:0/3182150387 learned_addr learned my addr 172.21.15.71:0/3182150387 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30cffff700 1 --2- 172.21.15.71:0/3182150387 >> v2:172.21.15.194:3300/0 conn(0x7f30d8143900 0x7f30d815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 -- 172.21.15.71:0/3182150387 >> v2:172.21.15.194:3300/0 conn(0x7f30d8143900 msgr2=0x7f30d815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:39.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 --2- 172.21.15.71:0/3182150387 >> v2:172.21.15.194:3300/0 conn(0x7f30d8143900 0x7f30d815df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 -- 172.21.15.71:0/3182150387 >> v1:172.21.15.194:6789/0 conn(0x7f30d80b0440 legacy=0x7f30d80b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 -- 172.21.15.71:0/3182150387 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d815e940 con 0x7f30d815b0e0 2023-07-06T01:09:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d6d9d700 1 --2- 172.21.15.71:0/3182150387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d815b0e0 0x7f30d815b560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f30d80ce890 tx=0x7f30d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419fc57aba3e0ed2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d5d9b700 1 -- 172.21.15.71:0/3182150387 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000e070 con 0x7f30d815b0e0 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d5d9b700 1 -- 172.21.15.71:0/3182150387 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000b9c0 con 0x7f30d815b0e0 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.136+0000 7f30d5d9b700 1 -- 172.21.15.71:0/3182150387 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000bd70 con 0x7f30d815b0e0 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 -- 172.21.15.71:0/3182150387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d815b0e0 msgr2=0x7f30d815b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 --2- 172.21.15.71:0/3182150387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d815b0e0 0x7f30d815b560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f30d80ce890 tx=0x7f30d000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 -- 172.21.15.71:0/3182150387 shutdown_connections 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 --2- 172.21.15.71:0/3182150387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d815b0e0 0x7f30d815b560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 --2- 172.21.15.71:0/3182150387 >> v2:172.21.15.194:3300/0 conn(0x7f30d8143900 0x7f30d815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 -- 172.21.15.71:0/3182150387 >> 172.21.15.71:0/3182150387 conn(0x7f30d80cb440 msgr2=0x7f30d80cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:39.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 -- 172.21.15.71:0/3182150387 shutdown_connections 2023-07-06T01:09:39.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.137+0000 7f30dcdff700 1 -- 172.21.15.71:0/3182150387 wait complete. 2023-07-06T01:09:39.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.139+0000 7f30dcdff700 1 Processor -- start 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.139+0000 7f30dcdff700 1 -- start start 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30dcdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 0x7f30d80b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30dcdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8143900 0x7f30d80cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30dcdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30d815b0e0 0x7f30d80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30dcdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80b3150 con 0x7f30d80b0440 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30dcdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81f3660 con 0x7f30d8143900 2023-07-06T01:09:39.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30dcdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80b1e50 con 0x7f30d815b0e0 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 0x7f30d80b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 0x7f30d80b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44700/0 (socket says 172.21.15.71:44700) 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 -- 172.21.15.71:0/2691470987 learned_addr learned my addr 172.21.15.71:0/2691470987 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30cffff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8143900 0x7f30d80cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d6d9d700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30d815b0e0 0x7f30d80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 -- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30d815b0e0 msgr2=0x7f30d80ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30d815b0e0 0x7f30d80ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 -- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8143900 msgr2=0x7f30d80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8143900 0x7f30d80cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.140+0000 7f30d659c700 1 -- 172.21.15.71:0/2691470987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d0009b30 con 0x7f30d80b0440 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.141+0000 7f30d659c700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 0x7f30d80b2c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c450 tx=0x7f30c800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.141+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80052d0 con 0x7f30d80b0440 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.141+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c8005430 con 0x7f30d80b0440 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.141+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c80038c0 con 0x7f30d80b0440 2023-07-06T01:09:39.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.141+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d80b2130 con 0x7f30d80b0440 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.141+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d80b26f0 con 0x7f30d80b0440 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.142+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d806fa50 con 0x7f30d80b0440 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.143+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30c8003a20 con 0x7f30d80b0440 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.144+0000 7f30ceffd700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f30b806ace0 0x7f30b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.144+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f30c8088970 con 0x7f30d80b0440 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.144+0000 7f30cffff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f30b806ace0 0x7f30b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.145+0000 7f30cffff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f30b806ace0 0x7f30b806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30c000b9b0 tx=0x7f30c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.148+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30c80539d0 con 0x7f30d80b0440 2023-07-06T01:09:39.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.341+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30d80008d0 con 0x7f30d80b0440 2023-07-06T01:09:39.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.341+0000 7f30ceffd700 1 -- 172.21.15.71:0/2691470987 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30c8056ff0 con 0x7f30d80b0440 2023-07-06T01:09:39.344 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:39.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f30b806ace0 msgr2=0x7f30b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f30b806ace0 0x7f30b806d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30c000b9b0 tx=0x7f30c0008040 comp rx=0 tx=0).stop 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 msgr2=0x7f30d80b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 0x7f30d80b2c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30c800c450 tx=0x7f30c800c810 comp rx=0 tx=0).stop 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 shutdown_connections 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f30b806ace0 0x7f30b806d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30d815b0e0 0x7f30d80ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30d80b0440 0x7f30d80b2c10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 --2- 172.21.15.71:0/2691470987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8143900 0x7f30d80cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 >> 172.21.15.71:0/2691470987 conn(0x7f30d80cb440 msgr2=0x7f30d80b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:39.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 shutdown_connections 2023-07-06T01:09:39.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.344+0000 7f30dcdff700 1 -- 172.21.15.71:0/2691470987 wait complete. 2023-07-06T01:09:39.364 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:39.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.560+0000 7f8382bff700 1 Processor -- start 2023-07-06T01:09:39.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.561+0000 7f8382bff700 1 -- start start 2023-07-06T01:09:39.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f8382bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f837c0b6110 0x7f837c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f8382bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0cf780 con 0x7f837c15fca0 2023-07-06T01:09:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f8382bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0cd490 con 0x7f837c0b5c90 2023-07-06T01:09:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f8382bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0cd770 con 0x7f837c0b6110 2023-07-06T01:09:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f838099b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f837c15fca0 0x7f837c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37900/0 (socket says 172.21.15.71:37900) 2023-07-06T01:09:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f838099b700 1 -- 172.21.15.71:0/1094916386 learned_addr learned my addr 172.21.15.71:0/1094916386 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.562+0000 7f838119c700 1 --2- 172.21.15.71:0/1094916386 >> v2:172.21.15.194:3300/0 conn(0x7f837c0b6110 0x7f837c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213214121 0 0) 0x7f837c0cf780 con 0x7f837c15fca0 2023-07-06T01:09:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f836c0035b0 con 0x7f837c15fca0 2023-07-06T01:09:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714172640 0 0) 0x7f837c0cd490 con 0x7f837c0b5c90 2023-07-06T01:09:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f837c0cf780 con 0x7f837c0b5c90 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177909260 0 0) 0x7f836c0035b0 con 0x7f837c15fca0 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 >> v2:172.21.15.194:3300/0 conn(0x7f837c0b6110 msgr2=0x7f837c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 --2- 172.21.15.71:0/1094916386 >> v2:172.21.15.194:3300/0 conn(0x7f837c0b6110 0x7f837c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 >> v1:172.21.15.194:6789/0 conn(0x7f837c0b5c90 legacy=0x7f837c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0cda50 con 0x7f837c15fca0 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f8370001670 con 0x7f837c15fca0 2023-07-06T01:09:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 >> v1:172.21.15.71:6789/0 conn(0x7f837c15fca0 legacy=0x7f837c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c003be0 0x7f836c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c004850 0x7f836c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c005200 0x7f836c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0cd770 con 0x7f836c003be0 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c00c0e0 con 0x7f836c004850 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.563+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c00c270 con 0x7f836c005200 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c003be0 0x7f836c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f837bfff700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c004850 0x7f836c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838119c700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c005200 0x7f836c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 -- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c005200 msgr2=0x7f836c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c005200 0x7f836c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 -- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c004850 msgr2=0x7f836c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f836c004850 0x7f836c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 -- 172.21.15.71:0/1094916386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0035b0 con 0x7f836c003be0 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838119c700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c005200 0x7f836c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838119c700 1 -- 172.21.15.71:0/1094916386 reap_dead start 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.564+0000 7f838099b700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c003be0 0x7f836c003fd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f837000c0e0 tx=0x7f836c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f9c2f0b2f56ef3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000cc80 con 0x7f836c003be0 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000cde0 con 0x7f836c003be0 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f837b7fe700 1 -- 172.21.15.71:0/1094916386 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370005ba0 con 0x7f836c003be0 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 -- 172.21.15.71:0/1094916386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c003be0 msgr2=0x7f836c003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c003be0 0x7f836c003fd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f837000c0e0 tx=0x7f836c005880 comp rx=0 tx=0).stop 2023-07-06T01:09:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 -- 172.21.15.71:0/1094916386 shutdown_connections 2023-07-06T01:09:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 --2- 172.21.15.71:0/1094916386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f836c003be0 0x7f836c003fd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 -- 172.21.15.71:0/1094916386 >> 172.21.15.71:0/1094916386 conn(0x7f837c06c150 msgr2=0x7f837c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 -- 172.21.15.71:0/1094916386 shutdown_connections 2023-07-06T01:09:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.565+0000 7f8382bff700 1 -- 172.21.15.71:0/1094916386 wait complete. 2023-07-06T01:09:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.567+0000 7f8382bff700 1 Processor -- start 2023-07-06T01:09:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.567+0000 7f8382bff700 1 -- start start 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f8382bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c003be0 0x7f837c0b91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f8382bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 0x7f837c0c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f8382bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c0c9390 0x7f837c0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f8382bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0c9830 con 0x7f837c0b9730 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f8382bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c150aa0 con 0x7f837c0c9390 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f8382bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0c7db0 con 0x7f836c003be0 2023-07-06T01:09:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.568+0000 7f837bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 0x7f837c0c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 0x7f837c0c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44724/0 (socket says 172.21.15.71:44724) 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 -- 172.21.15.71:0/2761817602 learned_addr learned my addr 172.21.15.71:0/2761817602 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f838119c700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c0c9390 0x7f837c0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f838099b700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c003be0 0x7f837c0b91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 -- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c003be0 msgr2=0x7f837c0b91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c003be0 0x7f837c0b91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 -- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c0c9390 msgr2=0x7f837c0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c0c9390 0x7f837c0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 -- 172.21.15.71:0/2761817602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0c8090 con 0x7f837c0b9730 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f837bfff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 0x7f837c0c8e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8368007a30 tx=0x7f836800fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368005320 con 0x7f837c0b9730 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680054a0 con 0x7f837c0b9730 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c0c8370 con 0x7f837c0b9730 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368006aa0 con 0x7f837c0b9730 2023-07-06T01:09:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.569+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c0c8930 con 0x7f837c0b9730 2023-07-06T01:09:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.570+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c0c8b50 con 0x7f837c0b9730 2023-07-06T01:09:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.571+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8368006c00 con 0x7f837c0b9730 2023-07-06T01:09:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.573+0000 7f83797fa700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f836006ad10 0x7f836006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.573+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8368088d20 con 0x7f837c0b9730 2023-07-06T01:09:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.574+0000 7f838099b700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f836006ad10 0x7f836006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.574+0000 7f838099b700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f836006ad10 0x7f836006d1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f837000c0e0 tx=0x7f8370007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.577+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8368053d90 con 0x7f837c0b9730 2023-07-06T01:09:39.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.772+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f837c0008d0 con 0x7f837c0b9730 2023-07-06T01:09:39.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.773+0000 7f83797fa700 1 -- 172.21.15.71:0/2761817602 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83680573b0 con 0x7f837c0b9730 2023-07-06T01:09:39.776 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:39.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f836006ad10 msgr2=0x7f836006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f836006ad10 0x7f836006d1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f837000c0e0 tx=0x7f8370007000 comp rx=0 tx=0).stop 2023-07-06T01:09:39.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 msgr2=0x7f837c0c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:39.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 0x7f837c0c8e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8368007a30 tx=0x7f836800fb00 comp rx=0 tx=0).stop 2023-07-06T01:09:39.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 shutdown_connections 2023-07-06T01:09:39.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f836006ad10 0x7f836006d1c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f837c0c9390 0x7f837c0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f836c003be0 0x7f837c0b91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 --2- 172.21.15.71:0/2761817602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f837c0b9730 0x7f837c0c8e50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.775+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 >> 172.21.15.71:0/2761817602 conn(0x7f837c06c150 msgr2=0x7f837c0b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:39.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.776+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 shutdown_connections 2023-07-06T01:09:39.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.776+0000 7f8382bff700 1 -- 172.21.15.71:0/2761817602 wait complete. 2023-07-06T01:09:39.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:39.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.991+0000 7f94cadff700 1 Processor -- start 2023-07-06T01:09:39.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.992+0000 7f94cadff700 1 -- start start 2023-07-06T01:09:39.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94cadff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c4158cd0 0x7f94c40cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94cadff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f94c40c9010 0x7f94c406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94cadff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94c40ce420 0x7f94c406b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94cadff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40cbf50 con 0x7f94c40ce420 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94cadff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40cd7b0 con 0x7f94c40c9010 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94cadff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40cd370 con 0x7f94c4158cd0 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94c40ce420 0x7f94c406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f94c40ce420 0x7f94c406b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44726/0 (socket says 172.21.15.71:44726) 2023-07-06T01:09:39.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 -- 172.21.15.71:0/3605051040 learned_addr learned my addr 172.21.15.71:0/3605051040 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c3fff700 1 --2- 172.21.15.71:0/3605051040 >> v2:172.21.15.194:3300/0 conn(0x7f94c40c9010 0x7f94c406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c8b9b700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c4158cd0 0x7f94c40cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 -- 172.21.15.71:0/3605051040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c4158cd0 msgr2=0x7f94c40cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c4158cd0 0x7f94c40cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 -- 172.21.15.71:0/3605051040 >> v2:172.21.15.194:3300/0 conn(0x7f94c40c9010 msgr2=0x7f94c406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 --2- 172.21.15.71:0/3605051040 >> v2:172.21.15.194:3300/0 conn(0x7f94c40c9010 0x7f94c406b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c939c700 1 -- 172.21.15.71:0/3605051040 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40ad7f0 con 0x7f94c40ce420 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c8b9b700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c4158cd0 0x7f94c40cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.993+0000 7f94c3fff700 1 --2- 172.21.15.71:0/3605051040 >> v2:172.21.15.194:3300/0 conn(0x7f94c40c9010 0x7f94c406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94c939c700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c406b760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94c40b15b0 tx=0x7f94bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867faeba37540545 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94c37fe700 1 -- 172.21.15.71:0/3605051040 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc00e070 con 0x7f94c40ce420 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94c37fe700 1 -- 172.21.15.71:0/3605051040 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc00b9c0 con 0x7f94c40ce420 2023-07-06T01:09:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94c37fe700 1 -- 172.21.15.71:0/3605051040 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc00bd70 con 0x7f94c40ce420 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94cadff700 1 -- 172.21.15.71:0/3605051040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 msgr2=0x7f94c406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94cadff700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c406b760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94c40b15b0 tx=0x7f94bc00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94cadff700 1 -- 172.21.15.71:0/3605051040 shutdown_connections 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.994+0000 7f94cadff700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c4158cd0 0x7f94c40cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.995+0000 7f94cadff700 1 --2- 172.21.15.71:0/3605051040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c406b760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.995+0000 7f94cadff700 1 --2- 172.21.15.71:0/3605051040 >> v2:172.21.15.194:3300/0 conn(0x7f94c40c9010 0x7f94c406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.995+0000 7f94cadff700 1 -- 172.21.15.71:0/3605051040 >> 172.21.15.71:0/3605051040 conn(0x7f94c40cb440 msgr2=0x7f94c40cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:40.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.995+0000 7f94cadff700 1 -- 172.21.15.71:0/3605051040 shutdown_connections 2023-07-06T01:09:40.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.995+0000 7f94cadff700 1 -- 172.21.15.71:0/3605051040 wait complete. 2023-07-06T01:09:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.997+0000 7f94cadff700 1 Processor -- start 2023-07-06T01:09:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.997+0000 7f94cadff700 1 -- start start 2023-07-06T01:09:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.998+0000 7f94cadff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c40c9010 0x7f94c4159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.998+0000 7f94cadff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c4145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.998+0000 7f94cadff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94c4158cd0 0x7f94c4144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.998+0000 7f94cadff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4159a50 con 0x7f94c40ce420 2023-07-06T01:09:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.998+0000 7f94cadff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c4146000 con 0x7f94c4158cd0 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.998+0000 7f94cadff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c41462a0 con 0x7f94c40c9010 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c4145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c4145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44734/0 (socket says 172.21.15.71:44734) 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 -- 172.21.15.71:0/1210959675 learned_addr learned my addr 172.21.15.71:0/1210959675 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c8b9b700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c40c9010 0x7f94c4159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c939c700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94c4158cd0 0x7f94c4144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 -- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c40c9010 msgr2=0x7f94c4159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c40c9010 0x7f94c4159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 -- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94c4158cd0 msgr2=0x7f94c4144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94c4158cd0 0x7f94c4144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 -- 172.21.15.71:0/1210959675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc009b30 con 0x7f94c40ce420 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c939c700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94c4158cd0 0x7f94c4144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:39.999+0000 7f94c3fff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c4145ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c740 tx=0x7f94b000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.000+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0011800 con 0x7f94c40ce420 2023-07-06T01:09:40.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.000+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0011960 con 0x7f94c40ce420 2023-07-06T01:09:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.000+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0011cd0 con 0x7f94c40ce420 2023-07-06T01:09:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.000+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c4146580 con 0x7f94c40ce420 2023-07-06T01:09:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.000+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c4146e20 con 0x7f94c40ce420 2023-07-06T01:09:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.001+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c4147040 con 0x7f94c40ce420 2023-07-06T01:09:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.002+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94b0021350 con 0x7f94c40ce420 2023-07-06T01:09:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.003+0000 7f94c17fa700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f94a806ace0 0x7f94a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.003+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f94b0089400 con 0x7f94c40ce420 2023-07-06T01:09:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.003+0000 7f94c8b9b700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f94a806ace0 0x7f94a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.004+0000 7f94c8b9b700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f94a806ace0 0x7f94a806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f94c40c54f0 tx=0x7f94b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.007+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94b0057e60 con 0x7f94c40ce420 2023-07-06T01:09:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.199+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94c40008d0 con 0x7f94c40ce420 2023-07-06T01:09:40.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.200+0000 7f94c17fa700 1 -- 172.21.15.71:0/1210959675 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94b00579f0 con 0x7f94c40ce420 2023-07-06T01:09:40.203 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f94a806ace0 msgr2=0x7f94a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f94a806ace0 0x7f94a806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f94c40c54f0 tx=0x7f94b8008040 comp rx=0 tx=0).stop 2023-07-06T01:09:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 msgr2=0x7f94c4145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c4145ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c740 tx=0x7f94b000ca50 comp rx=0 tx=0).stop 2023-07-06T01:09:40.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 shutdown_connections 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f94a806ace0 0x7f94a806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94c4158cd0 0x7f94c4144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94c40c9010 0x7f94c4159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 --2- 172.21.15.71:0/1210959675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94c40ce420 0x7f94c4145ac0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 >> 172.21.15.71:0/1210959675 conn(0x7f94c40cb440 msgr2=0x7f94c406f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 shutdown_connections 2023-07-06T01:09:40.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.202+0000 7f94cadff700 1 -- 172.21.15.71:0/1210959675 wait complete. 2023-07-06T01:09:40.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:40.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.416+0000 7fe89e3ff700 1 Processor -- start 2023-07-06T01:09:40.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.416+0000 7fe89e3ff700 1 -- start start 2023-07-06T01:09:40.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89e3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89e3ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe8980b5c90 0x7fe8980d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89e3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe8980b6100 0x7fe8980d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89e3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8980cf780 con 0x7fe8980b6100 2023-07-06T01:09:40.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89e3ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8980cd490 con 0x7fe8980b5c90 2023-07-06T01:09:40.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89e3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980cd770 con 0x7fe89815fca0 2023-07-06T01:09:40.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89c99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe8980b6100 0x7fe8980d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89c99c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe8980b6100 0x7fe8980d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44748/0 (socket says 172.21.15.71:44748) 2023-07-06T01:09:40.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe89c99c700 1 -- 172.21.15.71:0/1663763746 learned_addr learned my addr 172.21.15.71:0/1663763746 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:40.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe8977fe700 1 --2- 172.21.15.71:0/1663763746 >> v2:172.21.15.194:3300/0 conn(0x7fe8980b5c90 0x7fe8980d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.417+0000 7fe897fff700 1 --2- 172.21.15.71:0/1663763746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe89c99c700 1 -- 172.21.15.71:0/1663763746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 msgr2=0x7fe8980d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:40.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe89c99c700 1 --2- 172.21.15.71:0/1663763746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe89c99c700 1 -- 172.21.15.71:0/1663763746 >> v2:172.21.15.194:3300/0 conn(0x7fe8980b5c90 msgr2=0x7fe8980d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe89c99c700 1 --2- 172.21.15.71:0/1663763746 >> v2:172.21.15.194:3300/0 conn(0x7fe8980b5c90 0x7fe8980d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe89c99c700 1 -- 172.21.15.71:0/1663763746 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8980cda50 con 0x7fe8980b6100 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe89c99c700 1 --2- 172.21.15.71:0/1663763746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b6100 0x7fe8980d3280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe89806cda0 tx=0x7fe89000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca4e7464a066a83 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe896ffd700 1 -- 172.21.15.71:0/1663763746 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000e070 con 0x7fe8980b6100 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe896ffd700 1 -- 172.21.15.71:0/1663763746 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89000b910 con 0x7fe8980b6100 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.418+0000 7fe896ffd700 1 -- 172.21.15.71:0/1663763746 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89000bcc0 con 0x7fe8980b6100 2023-07-06T01:09:40.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 -- 172.21.15.71:0/1663763746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b6100 msgr2=0x7fe8980d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/1663763746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b6100 0x7fe8980d3280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe89806cda0 tx=0x7fe89000b330 comp rx=0 tx=0).stop 2023-07-06T01:09:40.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 -- 172.21.15.71:0/1663763746 shutdown_connections 2023-07-06T01:09:40.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/1663763746 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/1663763746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b6100 0x7fe8980d3280 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/1663763746 >> v2:172.21.15.194:3300/0 conn(0x7fe8980b5c90 0x7fe8980d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 -- 172.21.15.71:0/1663763746 >> 172.21.15.71:0/1663763746 conn(0x7fe89806c150 msgr2=0x7fe89806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:40.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 -- 172.21.15.71:0/1663763746 shutdown_connections 2023-07-06T01:09:40.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.419+0000 7fe89e3ff700 1 -- 172.21.15.71:0/1663763746 wait complete. 2023-07-06T01:09:40.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.421+0000 7fe89e3ff700 1 Processor -- start 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.421+0000 7fe89e3ff700 1 -- start start 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe89e3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 0x7fe89814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe89e3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8980b6100 0x7fe8980b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe89e3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe89e3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89815be50 con 0x7fe8980b5c90 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe89e3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8980b49c0 con 0x7fe8980b6100 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe89e3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8981e7e10 con 0x7fe89815fca0 2023-07-06T01:09:40.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 0x7fe89814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 0x7fe89814a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44756/0 (socket says 172.21.15.71:44756) 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 -- 172.21.15.71:0/3858367136 learned_addr learned my addr 172.21.15.71:0/3858367136 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 -- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 msgr2=0x7fe8980b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 -- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8980b6100 msgr2=0x7fe8980b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8980b6100 0x7fe8980b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 -- 172.21.15.71:0/3858367136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890009b30 con 0x7fe8980b5c90 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.422+0000 7fe897fff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 0x7fe89814a1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe88800e9b0 tx=0x7fe88800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.423+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888009710 con 0x7fe8980b5c90 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.423+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800c850 con 0x7fe8980b5c90 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.423+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89814a700 con 0x7fe8980b5c90 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.423+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800cbc0 con 0x7fe8980b5c90 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.423+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8980b4120 con 0x7fe8980b5c90 2023-07-06T01:09:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.424+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8980008d0 con 0x7fe8980b5c90 2023-07-06T01:09:40.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.425+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe88800cd20 con 0x7fe8980b5c90 2023-07-06T01:09:40.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.426+0000 7fe894ff9700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe88406ace0 0x7fe88406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.426+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe8880895d0 con 0x7fe8980b5c90 2023-07-06T01:09:40.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.426+0000 7fe8977fe700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe88406ace0 0x7fe88406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.427+0000 7fe8977fe700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe88406ace0 0x7fe88406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe8980d2280 tx=0x7fe88c009500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.430+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8880580d0 con 0x7fe8980b5c90 2023-07-06T01:09:40.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.622+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe89815bf90 con 0x7fe8980b5c90 2023-07-06T01:09:40.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.622+0000 7fe894ff9700 1 -- 172.21.15.71:0/3858367136 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe888057c60 con 0x7fe8980b5c90 2023-07-06T01:09:40.626 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe88406ace0 msgr2=0x7fe88406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe88406ace0 0x7fe88406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe8980d2280 tx=0x7fe88c009500 comp rx=0 tx=0).stop 2023-07-06T01:09:40.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 msgr2=0x7fe89814a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 0x7fe89814a1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe88800e9b0 tx=0x7fe88800ed70 comp rx=0 tx=0).stop 2023-07-06T01:09:40.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 shutdown_connections 2023-07-06T01:09:40.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe88406ace0 0x7fe88406d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe89815fca0 0x7fe8980b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8980b5c90 0x7fe89814a1c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 --2- 172.21.15.71:0/3858367136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8980b6100 0x7fe8980b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 >> 172.21.15.71:0/3858367136 conn(0x7fe89806c150 msgr2=0x7fe8980d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:40.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 shutdown_connections 2023-07-06T01:09:40.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.625+0000 7fe89e3ff700 1 -- 172.21.15.71:0/3858367136 wait complete. 2023-07-06T01:09:40.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T01:09:40.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.838+0000 7fd39adff700 1 Processor -- start 2023-07-06T01:09:40.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.838+0000 7fd39adff700 1 -- start start 2023-07-06T01:09:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.839+0000 7fd39adff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd394158cd0 0x7fd3940cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.839+0000 7fd39adff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 0x7fd3940cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.839+0000 7fd39adff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940cd370 con 0x7fd3940c9010 2023-07-06T01:09:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39adff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3940cbf50 con 0x7fd394158cd0 2023-07-06T01:09:40.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39adff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940cd7b0 con 0x7fd3940ce420 2023-07-06T01:09:40.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd398b9b700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd394158cd0 0x7fd3940cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 0x7fd3940cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 0x7fd3940cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:32800/0 (socket says 172.21.15.71:32800) 2023-07-06T01:09:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 -- 172.21.15.71:0/3003114622 learned_addr learned my addr 172.21.15.71:0/3003114622 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 -- 172.21.15.71:0/3003114622 >> v2:172.21.15.194:3300/0 conn(0x7fd394158cd0 msgr2=0x7fd3940cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd3937fe700 1 -- 172.21.15.71:0/3003114622 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803891606 0 0) 0x7fd3940cd370 con 0x7fd3940c9010 2023-07-06T01:09:40.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 --2- 172.21.15.71:0/3003114622 >> v2:172.21.15.194:3300/0 conn(0x7fd394158cd0 0x7fd3940cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 -- 172.21.15.71:0/3003114622 >> v1:172.21.15.194:6789/0 conn(0x7fd3940c9010 legacy=0x7fd39406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd39939c700 1 -- 172.21.15.71:0/3003114622 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940ad7f0 con 0x7fd3940ce420 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.840+0000 7fd398b9b700 1 --2- 172.21.15.71:0/3003114622 >> v2:172.21.15.194:3300/0 conn(0x7fd394158cd0 0x7fd3940cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.841+0000 7fd39939c700 1 --2- 172.21.15.71:0/3003114622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 0x7fd3940cc590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00d150 tx=0x7fd38c00d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b9df3a68f5868ac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.841+0000 7fd3937fe700 1 -- 172.21.15.71:0/3003114622 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c010070 con 0x7fd3940ce420 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.841+0000 7fd3937fe700 1 -- 172.21.15.71:0/3003114622 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c00db00 con 0x7fd3940ce420 2023-07-06T01:09:40.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.841+0000 7fd3937fe700 1 -- 172.21.15.71:0/3003114622 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c016400 con 0x7fd3940ce420 2023-07-06T01:09:40.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 -- 172.21.15.71:0/3003114622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 msgr2=0x7fd3940cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 --2- 172.21.15.71:0/3003114622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 0x7fd3940cc590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00d150 tx=0x7fd38c00d460 comp rx=0 tx=0).stop 2023-07-06T01:09:40.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 -- 172.21.15.71:0/3003114622 shutdown_connections 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 --2- 172.21.15.71:0/3003114622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3940ce420 0x7fd3940cc590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 --2- 172.21.15.71:0/3003114622 >> v2:172.21.15.194:3300/0 conn(0x7fd394158cd0 0x7fd3940cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 -- 172.21.15.71:0/3003114622 >> 172.21.15.71:0/3003114622 conn(0x7fd3940cb440 msgr2=0x7fd3940cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 -- 172.21.15.71:0/3003114622 shutdown_connections 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.842+0000 7fd39adff700 1 -- 172.21.15.71:0/3003114622 wait complete. 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.844+0000 7fd39adff700 1 Processor -- start 2023-07-06T01:09:40.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.844+0000 7fd39adff700 1 -- start start 2023-07-06T01:09:40.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39adff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 0x7fd3940c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39adff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3940ce420 0x7fd394159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39adff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd394158cd0 0x7fd3941f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39adff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941f5470 con 0x7fd3940c9010 2023-07-06T01:09:40.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39adff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39406c890 con 0x7fd3940ce420 2023-07-06T01:09:40.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39adff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3941f59c0 con 0x7fd394158cd0 2023-07-06T01:09:40.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 0x7fd3940c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 0x7fd3940c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44770/0 (socket says 172.21.15.71:44770) 2023-07-06T01:09:40.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 -- 172.21.15.71:0/3269552733 learned_addr learned my addr 172.21.15.71:0/3269552733 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:40.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd393fff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3940ce420 0x7fd394159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd39939c700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd394158cd0 0x7fd3941f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 -- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd394158cd0 msgr2=0x7fd3941f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd394158cd0 0x7fd3941f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 -- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3940ce420 msgr2=0x7fd394159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3940ce420 0x7fd394159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.845+0000 7fd398b9b700 1 -- 172.21.15.71:0/3269552733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880094a0 con 0x7fd3940c9010 2023-07-06T01:09:40.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.846+0000 7fd398b9b700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 0x7fd3940c5060 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd38800ebe0 tx=0x7fd388009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.846+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800c910 con 0x7fd3940c9010 2023-07-06T01:09:40.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.846+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800ca70 con 0x7fd3940c9010 2023-07-06T01:09:40.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.846+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800cde0 con 0x7fd3940c9010 2023-07-06T01:09:40.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.846+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c00bd40 con 0x7fd3940c9010 2023-07-06T01:09:40.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.846+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39406cae0 con 0x7fd3940c9010 2023-07-06T01:09:40.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.847+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3941f5ca0 con 0x7fd3940c9010 2023-07-06T01:09:40.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.848+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd388013470 con 0x7fd3940c9010 2023-07-06T01:09:40.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.849+0000 7fd3917fa700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd37806ace0 0x7fd37806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:40.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.849+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd388089730 con 0x7fd3940c9010 2023-07-06T01:09:40.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.850+0000 7fd393fff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd37806ace0 0x7fd37806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:40.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.850+0000 7fd393fff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd37806ace0 0x7fd37806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd3940b0100 tx=0x7fd380009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:40.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:40.853+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd388054700 con 0x7fd3940c9010 2023-07-06T01:09:41.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.063+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3940008d0 con 0x7fd3940c9010 2023-07-06T01:09:41.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.063+0000 7fd3917fa700 1 -- 172.21.15.71:0/3269552733 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd388057d20 con 0x7fd3940c9010 2023-07-06T01:09:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd37806ace0 msgr2=0x7fd37806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd37806ace0 0x7fd37806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd3940b0100 tx=0x7fd380009040 comp rx=0 tx=0).stop 2023-07-06T01:09:41.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 msgr2=0x7fd3940c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 0x7fd3940c5060 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd38800ebe0 tx=0x7fd388009ec0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 shutdown_connections 2023-07-06T01:09:41.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd37806ace0 0x7fd37806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd394158cd0 0x7fd3941f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3940c9010 0x7fd3940c5060 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 --2- 172.21.15.71:0/3269552733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3940ce420 0x7fd394159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 >> 172.21.15.71:0/3269552733 conn(0x7fd3940cb440 msgr2=0x7fd3940cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 shutdown_connections 2023-07-06T01:09:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.065+0000 7fd39adff700 1 -- 172.21.15.71:0/3269552733 wait complete. 2023-07-06T01:09:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2023-07-06T01:09:41.086 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T01:09:41.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:41.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-06T01:09:41.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:09:41.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:41.178 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T01:09:41.233 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:41.234 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:41.287 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:41.288 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:41.335 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:41.335 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:41.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:41.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.615+0000 7f80a57ff700 1 Processor -- start 2023-07-06T01:09:41.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.615+0000 7f80a57ff700 1 -- start start 2023-07-06T01:09:41.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f80a57ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f80a015fca0 0x7f80a00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:41.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f80a57ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00cf780 con 0x7f80a00b5c90 2023-07-06T01:09:41.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f80a57ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00cd490 con 0x7f80a00b6110 2023-07-06T01:09:41.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f80a57ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a00cd770 con 0x7f80a015fca0 2023-07-06T01:09:41.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809e7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f80a00b5c90 0x7f80a00d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37912/0 (socket says 172.21.15.71:37912) 2023-07-06T01:09:41.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809e7fc700 1 -- 172.21.15.71:0/2451351777 learned_addr learned my addr 172.21.15.71:0/2451351777 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:41.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809effd700 1 --2- 172.21.15.71:0/2451351777 >> v2:172.21.15.194:3300/0 conn(0x7f80a015fca0 0x7f80a00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123141768 0 0) 0x7f80a00cf780 con 0x7f80a00b5c90 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80880035b0 con 0x7f80a00b5c90 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118846545 0 0) 0x7f80a00cd490 con 0x7f80a00b6110 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.617+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a00cf780 con 0x7f80a00b6110 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809effd700 1 -- 172.21.15.71:0/2451351777 >> v1:172.21.15.194:6789/0 conn(0x7f80a00b6110 legacy=0x7f80a00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809effd700 1 -- 172.21.15.71:0/2451351777 >> v1:172.21.15.71:6789/0 conn(0x7f80a00b5c90 legacy=0x7f80a00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614463652 0 0) 0x7f80880035b0 con 0x7f80a00b5c90 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809effd700 1 -- 172.21.15.71:0/2451351777 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00cda50 con 0x7f80a015fca0 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809effd700 1 --2- 172.21.15.71:0/2451351777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a015fca0 0x7f80a00d1420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8090009840 tx=0x7f8090009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0396e339416e45 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094001670 con 0x7f80a015fca0 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090004030 con 0x7f80a015fca0 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.618+0000 7f809dffb700 1 -- 172.21.15.71:0/2451351777 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900043c0 con 0x7f80a015fca0 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 -- 172.21.15.71:0/2451351777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a015fca0 msgr2=0x7f80a00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 --2- 172.21.15.71:0/2451351777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a015fca0 0x7f80a00d1420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8090009840 tx=0x7f8090009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 -- 172.21.15.71:0/2451351777 shutdown_connections 2023-07-06T01:09:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 --2- 172.21.15.71:0/2451351777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a015fca0 0x7f80a00d1420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 -- 172.21.15.71:0/2451351777 >> 172.21.15.71:0/2451351777 conn(0x7f80a006c150 msgr2=0x7f80a006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 -- 172.21.15.71:0/2451351777 shutdown_connections 2023-07-06T01:09:41.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.619+0000 7f80a57ff700 1 -- 172.21.15.71:0/2451351777 wait complete. 2023-07-06T01:09:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.620+0000 7f80a57ff700 1 Processor -- start 2023-07-06T01:09:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 -- start start 2023-07-06T01:09:41.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a00b5c90 0x7f80a00cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a00b6110 0x7f80a00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 0x7f80a00c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01f5260 con 0x7f80a015fca0 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01f5500 con 0x7f80a00b6110 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.621+0000 7f80a57ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01f57e0 con 0x7f80a00b5c90 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 0x7f80a00c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 0x7f80a00c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44782/0 (socket says 172.21.15.71:44782) 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 -- 172.21.15.71:0/1636901373 learned_addr learned my addr 172.21.15.71:0/1636901373 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809effd700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a00b5c90 0x7f80a00cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809e7fc700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a00b6110 0x7f80a00c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 -- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a00b5c90 msgr2=0x7f80a00cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a00b5c90 0x7f80a00cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 -- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a00b6110 msgr2=0x7f80a00c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a00b6110 0x7f80a00c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 -- 172.21.15.71:0/1636901373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80900094a0 con 0x7f80a015fca0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.622+0000 7f809f7fe700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 0x7f80a00c6910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f809800cc20 tx=0x7f809800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.623+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800ac20 con 0x7f80a015fca0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.623+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800ad80 con 0x7f80a015fca0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.623+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a01f5ac0 con 0x7f80a015fca0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.623+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8098003c20 con 0x7f80a015fca0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.623+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a01f6080 con 0x7f80a015fca0 2023-07-06T01:09:41.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.624+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a00008d0 con 0x7f80a015fca0 2023-07-06T01:09:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.625+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80980050d0 con 0x7f80a015fca0 2023-07-06T01:09:41.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.626+0000 7f80877fe700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f808c06ace0 0x7f808c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:41.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.626+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f80980895e0 con 0x7f80a015fca0 2023-07-06T01:09:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.627+0000 7f809effd700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f808c06ace0 0x7f808c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:41.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.627+0000 7f809effd700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f808c06ace0 0x7f808c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80900090b0 tx=0x7f8090013040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:41.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.630+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f80980546e0 con 0x7f80a015fca0 2023-07-06T01:09:41.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.826+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80a00b88b0 con 0x7f80a015fca0 2023-07-06T01:09:41.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.828+0000 7f80877fe700 1 -- 172.21.15.71:0/1636901373 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f8098057d00 con 0x7f80a015fca0 2023-07-06T01:09:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:41.831 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:41.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f808c06ace0 msgr2=0x7f808c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f808c06ace0 0x7f808c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80900090b0 tx=0x7f8090013040 comp rx=0 tx=0).stop 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 msgr2=0x7f80a00c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 0x7f80a00c6910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f809800cc20 tx=0x7f809800a060 comp rx=0 tx=0).stop 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 shutdown_connections 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f808c06ace0 0x7f808c06d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80a015fca0 0x7f80a00c6910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a00b5c90 0x7f80a00cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 --2- 172.21.15.71:0/1636901373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a00b6110 0x7f80a00c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:41.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 >> 172.21.15.71:0/1636901373 conn(0x7f80a006c150 msgr2=0x7f80a00d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:41.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 shutdown_connections 2023-07-06T01:09:41.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:41.830+0000 7f80a57ff700 1 -- 172.21.15.71:0/1636901373 wait complete. 2023-07-06T01:09:41.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:41.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:42.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.046+0000 7f9cd99ff700 1 Processor -- start 2023-07-06T01:09:42.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.046+0000 7f9cd99ff700 1 -- start start 2023-07-06T01:09:42.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.047+0000 7f9cd99ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9cd40b5c90 0x7f9cd40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.047+0000 7f9cd99ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40cf780 con 0x7f9cd40b6110 2023-07-06T01:09:42.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.047+0000 7f9cd99ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40cd490 con 0x7f9cd415fca0 2023-07-06T01:09:42.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.047+0000 7f9cd99ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd40cd770 con 0x7f9cd40b5c90 2023-07-06T01:09:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9cd40b5c90 0x7f9cd40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9cd40b5c90 0x7f9cd40d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44794/0 (socket says 172.21.15.71:44794) 2023-07-06T01:09:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 -- 172.21.15.71:0/3455297451 learned_addr learned my addr 172.21.15.71:0/3455297451 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9cd37fe700 1 --1- 172.21.15.71:0/3455297451 >> v1:172.21.15.71:6789/0 conn(0x7f9cd40b6110 0x7f9cd40cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37920/0 (socket says 172.21.15.71:37920) 2023-07-06T01:09:42.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 -- 172.21.15.71:0/3455297451 >> v1:172.21.15.194:6789/0 conn(0x7f9cd415fca0 legacy=0x7f9cd40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 -- 172.21.15.71:0/3455297451 >> v1:172.21.15.71:6789/0 conn(0x7f9cd40b6110 legacy=0x7f9cd40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 -- 172.21.15.71:0/3455297451 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd40cda50 con 0x7f9cd40b5c90 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.048+0000 7f9ccbfff700 1 --2- 172.21.15.71:0/3455297451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b5c90 0x7f9cd40d2d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0098f0 tx=0x7f9cbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f1a42e6ade9da5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd27fc700 1 -- 172.21.15.71:0/3455297451 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00b8a0 con 0x7f9cd40b5c90 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd27fc700 1 -- 172.21.15.71:0/3455297451 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc00ba00 con 0x7f9cd40b5c90 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd27fc700 1 -- 172.21.15.71:0/3455297451 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00bd90 con 0x7f9cd40b5c90 2023-07-06T01:09:42.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 -- 172.21.15.71:0/3455297451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b5c90 msgr2=0x7f9cd40d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/3455297451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b5c90 0x7f9cd40d2d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0098f0 tx=0x7f9cbc009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:42.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 -- 172.21.15.71:0/3455297451 shutdown_connections 2023-07-06T01:09:42.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/3455297451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b5c90 0x7f9cd40d2d40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 -- 172.21.15.71:0/3455297451 >> 172.21.15.71:0/3455297451 conn(0x7f9cd406c150 msgr2=0x7f9cd406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:42.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 -- 172.21.15.71:0/3455297451 shutdown_connections 2023-07-06T01:09:42.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.049+0000 7f9cd99ff700 1 -- 172.21.15.71:0/3455297451 wait complete. 2023-07-06T01:09:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.051+0000 7f9cd99ff700 1 Processor -- start 2023-07-06T01:09:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.051+0000 7f9cd99ff700 1 -- start start 2023-07-06T01:09:42.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9cd99ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cd40b5c90 0x7f9cd415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9cd99ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 0x7f9cd40cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9cd99ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd415fca0 0x7f9cd4156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9cd99ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40cb260 con 0x7f9cd40b6110 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9cd99ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40ca9c0 con 0x7f9cd415fca0 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9cd99ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40caca0 con 0x7f9cd40b5c90 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 0x7f9cd40cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9ccbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 0x7f9cd40cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44804/0 (socket says 172.21.15.71:44804) 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.052+0000 7f9ccbfff700 1 -- 172.21.15.71:0/732390009 learned_addr learned my addr 172.21.15.71:0/732390009 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd37fe700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd415fca0 0x7f9cd4156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9ccbfff700 1 -- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cd40b5c90 msgr2=0x7f9cd415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd2ffd700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cd40b5c90 0x7f9cd415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9ccbfff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cd40b5c90 0x7f9cd415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9ccbfff700 1 -- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd415fca0 msgr2=0x7f9cd4156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9ccbfff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd415fca0 0x7f9cd4156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9ccbfff700 1 -- 172.21.15.71:0/732390009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc009550 con 0x7f9cd40b6110 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd37fe700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd415fca0 0x7f9cd4156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd2ffd700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cd40b5c90 0x7f9cd415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9ccbfff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 0x7f9cd40cbb20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c00 tx=0x7f9cbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc004570 con 0x7f9cd40b6110 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc01f070 con 0x7f9cd40b6110 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0038e0 con 0x7f9cd40b6110 2023-07-06T01:09:42.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.053+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd40caf80 con 0x7f9cd40b6110 2023-07-06T01:09:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.054+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd4157410 con 0x7f9cd40b6110 2023-07-06T01:09:42.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.055+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd40c6910 con 0x7f9cd40b6110 2023-07-06T01:09:42.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.055+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9cbc021030 con 0x7f9cd40b6110 2023-07-06T01:09:42.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.056+0000 7f9cd0ff9700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9cb406ace0 0x7f9cb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.056+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9cbc08a9b0 con 0x7f9cd40b6110 2023-07-06T01:09:42.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.057+0000 7f9cd2ffd700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9cb406ace0 0x7f9cb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.058+0000 7f9cd2ffd700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9cb406ace0 0x7f9cb406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000f60 tx=0x7f9cc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.061+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9cd40c6910 con 0x7f9cd40b6110 2023-07-06T01:09:42.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.254+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cd40c6cf0 con 0x7f9cd40b6110 2023-07-06T01:09:42.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.254+0000 7f9cd0ff9700 1 -- 172.21.15.71:0/732390009 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cbc015020 con 0x7f9cd40b6110 2023-07-06T01:09:42.257 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:42.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9cb406ace0 msgr2=0x7f9cb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9cb406ace0 0x7f9cb406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4000f60 tx=0x7f9cc4009040 comp rx=0 tx=0).stop 2023-07-06T01:09:42.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 msgr2=0x7f9cd40cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 0x7f9cd40cbb20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c00 tx=0x7f9cbc004750 comp rx=0 tx=0).stop 2023-07-06T01:09:42.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 shutdown_connections 2023-07-06T01:09:42.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9cb406ace0 0x7f9cb406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cd415fca0 0x7f9cd4156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cd40b5c90 0x7f9cd415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 --2- 172.21.15.71:0/732390009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cd40b6110 0x7f9cd40cbb20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.256+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 >> 172.21.15.71:0/732390009 conn(0x7f9cd406c150 msgr2=0x7f9cd40d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:42.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.257+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 shutdown_connections 2023-07-06T01:09:42.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.257+0000 7f9cd99ff700 1 -- 172.21.15.71:0/732390009 wait complete. 2023-07-06T01:09:42.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.472+0000 7f03073ff700 1 Processor -- start 2023-07-06T01:09:42.474 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.472+0000 7f03073ff700 1 -- start start 2023-07-06T01:09:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f03073ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 0x7f03000d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f03073ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f03000b5c90 0x7f03000d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f03073ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03000cf780 con 0x7f03000b6100 2023-07-06T01:09:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f03073ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03000cd490 con 0x7f03000b5c90 2023-07-06T01:09:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f03073ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03000cd770 con 0x7f030015fca0 2023-07-06T01:09:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f030599c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f03000b6100 0x7f03000cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37924/0 (socket says 172.21.15.71:37924) 2023-07-06T01:09:42.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f030599c700 1 -- 172.21.15.71:0/550851678 learned_addr learned my addr 172.21.15.71:0/550851678 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:42.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f030519b700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 0x7f03000d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.473+0000 7f030499a700 1 --2- 172.21.15.71:0/550851678 >> v2:172.21.15.194:3300/0 conn(0x7f03000b5c90 0x7f03000d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126742763 0 0) 0x7f03000cf780 con 0x7f03000b6100 2023-07-06T01:09:42.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02ec0035b0 con 0x7f03000b6100 2023-07-06T01:09:42.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861454765 0 0) 0x7f02ec0035b0 con 0x7f03000b6100 2023-07-06T01:09:42.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 msgr2=0x7f03000d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:42.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 0x7f03000d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 >> v2:172.21.15.194:3300/0 conn(0x7f03000b5c90 msgr2=0x7f03000d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:42.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 --2- 172.21.15.71:0/550851678 >> v2:172.21.15.194:3300/0 conn(0x7f03000b5c90 0x7f03000d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000cda50 con 0x7f03000b6100 2023-07-06T01:09:42.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f02f80019f0 con 0x7f03000b6100 2023-07-06T01:09:42.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 >> v1:172.21.15.71:6789/0 conn(0x7f03000b6100 legacy=0x7f03000cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 0x7f02ec003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec003f80 0x7f02ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ec004d90 0x7f02ec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000cd490 con 0x7f02ec004d90 2023-07-06T01:09:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03000cd770 con 0x7f02ec003f80 2023-07-06T01:09:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec00ba10 con 0x7f030015fca0 2023-07-06T01:09:42.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f030499a700 1 --2- 172.21.15.71:0/550851678 >> v2:172.21.15.194:3300/0 conn(0x7f03000b5c90 0x7f03000d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f030599c700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ec004d90 0x7f02ec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.474+0000 7f030519b700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 0x7f02ec003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030499a700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec003f80 0x7f02ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030599c700 1 -- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 msgr2=0x7f02ec003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030599c700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015fca0 0x7f02ec003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030599c700 1 -- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec003f80 msgr2=0x7f02ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030599c700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec003f80 0x7f02ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030599c700 1 -- 172.21.15.71:0/550851678 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0035b0 con 0x7f02ec004d90 2023-07-06T01:09:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030499a700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec003f80 0x7f02ec004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f030599c700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ec004d90 0x7f02ec005200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02f800a830 tx=0x7f02ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4a7951d39fdda7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8012600 con 0x7f02ec004d90 2023-07-06T01:09:42.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8012780 con 0x7f02ec004d90 2023-07-06T01:09:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.475+0000 7f02f7fff700 1 -- 172.21.15.71:0/550851678 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8012b30 con 0x7f02ec004d90 2023-07-06T01:09:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f03073ff700 1 -- 172.21.15.71:0/550851678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ec004d90 msgr2=0x7f02ec005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f03073ff700 1 --2- 172.21.15.71:0/550851678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ec004d90 0x7f02ec005200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f02f800a830 tx=0x7f02ec005880 comp rx=0 tx=0).stop 2023-07-06T01:09:42.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f030599c700 1 -- 172.21.15.71:0/550851678 reap_dead start 2023-07-06T01:09:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f03073ff700 1 -- 172.21.15.71:0/550851678 shutdown_connections 2023-07-06T01:09:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f03073ff700 1 -- 172.21.15.71:0/550851678 >> 172.21.15.71:0/550851678 conn(0x7f030006c150 msgr2=0x7f030006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f03073ff700 1 -- 172.21.15.71:0/550851678 shutdown_connections 2023-07-06T01:09:42.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.476+0000 7f03073ff700 1 -- 172.21.15.71:0/550851678 wait complete. 2023-07-06T01:09:42.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.478+0000 7f03073ff700 1 Processor -- start 2023-07-06T01:09:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.478+0000 7f03073ff700 1 -- start start 2023-07-06T01:09:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f03073ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec004d90 0x7f03000b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f03073ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015bc10 0x7f030015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f03073ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 0x7f030015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f03073ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001f2d80 con 0x7f030015c080 2023-07-06T01:09:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f03073ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030015ea50 con 0x7f02ec004d90 2023-07-06T01:09:42.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f03073ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03000b25f0 con 0x7f030015bc10 2023-07-06T01:09:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 0x7f030015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 0x7f030015cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44824/0 (socket says 172.21.15.71:44824) 2023-07-06T01:09:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 -- 172.21.15.71:0/173541330 learned_addr learned my addr 172.21.15.71:0/173541330 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:42.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030519b700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec004d90 0x7f03000b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030499a700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015bc10 0x7f030015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 -- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015bc10 msgr2=0x7f030015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015bc10 0x7f030015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 -- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec004d90 msgr2=0x7f03000b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec004d90 0x7f03000b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030599c700 1 -- 172.21.15.71:0/173541330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03001f2100 con 0x7f030015c080 2023-07-06T01:09:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.479+0000 7f030499a700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015bc10 0x7f030015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:42.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.480+0000 7f030599c700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 0x7f030015cb90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001cb0 tx=0x7f02f8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.480+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80019b0 con 0x7f030015c080 2023-07-06T01:09:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.480+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8012610 con 0x7f030015c080 2023-07-06T01:09:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.480+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03001f23e0 con 0x7f030015c080 2023-07-06T01:09:42.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.480+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8026640 con 0x7f030015c080 2023-07-06T01:09:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.480+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03001f29a0 con 0x7f030015c080 2023-07-06T01:09:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.481+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03000cb4a0 con 0x7f030015c080 2023-07-06T01:09:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.482+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02f8019030 con 0x7f030015c080 2023-07-06T01:09:42.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.483+0000 7f02f5ffb700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f02e406ace0 0x7f02e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.483+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f02f808a730 con 0x7f030015c080 2023-07-06T01:09:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.483+0000 7f030519b700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f02e406ace0 0x7f02e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.484+0000 7f030519b700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f02e406ace0 0x7f02e406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0300159b70 tx=0x7f02fc009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.487+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03000cb4a0 con 0x7f030015c080 2023-07-06T01:09:42.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.683+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f03000cb4a0 con 0x7f030015c080 2023-07-06T01:09:42.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.684+0000 7f02f5ffb700 1 -- 172.21.15.71:0/173541330 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03000cb4a0 con 0x7f030015c080 2023-07-06T01:09:42.687 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f02e406ace0 msgr2=0x7f02e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f02e406ace0 0x7f02e406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0300159b70 tx=0x7f02fc009210 comp rx=0 tx=0).stop 2023-07-06T01:09:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 msgr2=0x7f030015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 0x7f030015cb90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001cb0 tx=0x7f02f8001d80 comp rx=0 tx=0).stop 2023-07-06T01:09:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 shutdown_connections 2023-07-06T01:09:42.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f02e406ace0 0x7f02e406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f030015c080 0x7f030015cb90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02ec004d90 0x7f03000b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 --2- 172.21.15.71:0/173541330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f030015bc10 0x7f030015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 >> 172.21.15.71:0/173541330 conn(0x7f030006c150 msgr2=0x7f03000d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 shutdown_connections 2023-07-06T01:09:42.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.686+0000 7f03073ff700 1 -- 172.21.15.71:0/173541330 wait complete. 2023-07-06T01:09:42.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.901+0000 7fe1ac1ff700 1 Processor -- start 2023-07-06T01:09:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.901+0000 7fe1ac1ff700 1 -- start start 2023-07-06T01:09:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.902+0000 7fe1ac1ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe1a415fca0 0x7fe1a40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.902+0000 7fe1ac1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40cf780 con 0x7fe1a40b5c90 2023-07-06T01:09:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.902+0000 7fe1ac1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40cd490 con 0x7fe1a40b6110 2023-07-06T01:09:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.902+0000 7fe1ac1ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40cd770 con 0x7fe1a415fca0 2023-07-06T01:09:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.902+0000 7fe1a979a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe1a40b5c90 0x7fe1a40d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:37934/0 (socket says 172.21.15.71:37934) 2023-07-06T01:09:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.902+0000 7fe1a979a700 1 -- 172.21.15.71:0/1341034957 learned_addr learned my addr 172.21.15.71:0/1341034957 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a9f9b700 1 --2- 172.21.15.71:0/1341034957 >> v2:172.21.15.194:3300/0 conn(0x7fe1a415fca0 0x7fe1a40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a8f99700 1 -- 172.21.15.71:0/1341034957 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221912984 0 0) 0x7fe1a40cf780 con 0x7fe1a40b5c90 2023-07-06T01:09:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a8f99700 1 -- 172.21.15.71:0/1341034957 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1900035b0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/1341034957 >> v1:172.21.15.194:6789/0 conn(0x7fe1a40b6110 legacy=0x7fe1a40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/1341034957 >> v1:172.21.15.71:6789/0 conn(0x7fe1a40b5c90 legacy=0x7fe1a40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/1341034957 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40cda50 con 0x7fe1a415fca0 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.903+0000 7fe1a9f9b700 1 --2- 172.21.15.71:0/1341034957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 0x7fe1a40d1420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009840 tx=0x7fe1a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df5ef1ffa74b699d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1a8f99700 1 -- 172.21.15.71:0/1341034957 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0011830 con 0x7fe1a415fca0 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1a8f99700 1 -- 172.21.15.71:0/1341034957 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0011990 con 0x7fe1a415fca0 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1a8f99700 1 -- 172.21.15.71:0/1341034957 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0011d00 con 0x7fe1a415fca0 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/1341034957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 msgr2=0x7fe1a40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/1341034957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 0x7fe1a40d1420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009840 tx=0x7fe1a0009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/1341034957 shutdown_connections 2023-07-06T01:09:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/1341034957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 0x7fe1a40d1420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/1341034957 >> 172.21.15.71:0/1341034957 conn(0x7fe1a406c150 msgr2=0x7fe1a406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/1341034957 shutdown_connections 2023-07-06T01:09:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.904+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/1341034957 wait complete. 2023-07-06T01:09:42.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:09:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.906+0000 7fe1ac1ff700 1 Processor -- start 2023-07-06T01:09:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.906+0000 7fe1ac1ff700 1 -- start start 2023-07-06T01:09:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1ac1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 0x7fe1a41e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1ac1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1a40b6110 0x7fe1a4148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1ac1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 0x7fe1a40c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1ac1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41e8300 con 0x7fe1a40b5c90 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1ac1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4148d80 con 0x7fe1a415fca0 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1ac1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41e76f0 con 0x7fe1a40b6110 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.907+0000 7fe1a9f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 0x7fe1a41e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 0x7fe1a41e7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44836/0 (socket says 172.21.15.71:44836) 2023-07-06T01:09:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/3107685835 learned_addr learned my addr 172.21.15.71:0/3107685835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1a40b6110 msgr2=0x7fe1a4148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1a40b6110 0x7fe1a4148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 msgr2=0x7fe1a40c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 0x7fe1a40c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 -- 172.21.15.71:0/3107685835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00094a0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1a9f9b700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 0x7fe1a41e7060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009fd0 tx=0x7fe1a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00036a0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a001e070 con 0x7fe1a40b5c90 2023-07-06T01:09:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0003a40 con 0x7fe1a40b5c90 2023-07-06T01:09:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.908+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a41e79d0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.909+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a41e7f90 con 0x7fe1a40b5c90 2023-07-06T01:09:42.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:09:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.910+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40008d0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.911+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1a0003ba0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.912+0000 7fe19a7fc700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe18806ace0 0x7fe18806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.912+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe1a008a4f0 con 0x7fe1a40b5c90 2023-07-06T01:09:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.913+0000 7fe1a979a700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe18806ace0 0x7fe18806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.913+0000 7fe1a979a700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe18806ace0 0x7fe18806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1a41e8ca0 tx=0x7fe1940079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:42.917+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1a00555f0 con 0x7fe1a40b5c90 2023-07-06T01:09:43.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.122+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1a415a4f0 con 0x7fe1a40b5c90 2023-07-06T01:09:43.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.123+0000 7fe19a7fc700 1 -- 172.21.15.71:0/3107685835 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1a0058c10 con 0x7fe1a40b5c90 2023-07-06T01:09:43.126 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:43.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe18806ace0 msgr2=0x7fe18806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe18806ace0 0x7fe18806d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1a41e8ca0 tx=0x7fe1940079c0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 msgr2=0x7fe1a41e7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 0x7fe1a41e7060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009fd0 tx=0x7fe1a0004750 comp rx=0 tx=0).stop 2023-07-06T01:09:43.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 shutdown_connections 2023-07-06T01:09:43.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe18806ace0 0x7fe18806d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1a415fca0 0x7fe1a40c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1a40b5c90 0x7fe1a41e7060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 --2- 172.21.15.71:0/3107685835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1a40b6110 0x7fe1a4148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 >> 172.21.15.71:0/3107685835 conn(0x7fe1a406c150 msgr2=0x7fe1a40d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 shutdown_connections 2023-07-06T01:09:43.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.125+0000 7fe1ac1ff700 1 -- 172.21.15.71:0/3107685835 wait complete. 2023-07-06T01:09:43.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:43.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.341+0000 7f97b87ff700 1 Processor -- start 2023-07-06T01:09:43.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.341+0000 7f97b87ff700 1 -- start start 2023-07-06T01:09:43.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b87ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f97b015fca0 0x7f97b00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b87ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f97b00b6110 0x7f97b00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b87ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b00cf780 con 0x7f97b00b5c90 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b87ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00cd490 con 0x7f97b00b6110 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b87ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b00cd770 con 0x7f97b015fca0 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f97b00b6110 0x7f97b00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f97b00b6110 0x7f97b00cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50954/0 (socket says 172.21.15.71:50954) 2023-07-06T01:09:43.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 -- 172.21.15.71:0/3205153856 learned_addr learned my addr 172.21.15.71:0/3205153856 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b659b700 1 --2- 172.21.15.71:0/3205153856 >> v2:172.21.15.194:3300/0 conn(0x7f97b015fca0 0x7f97b00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 -- 172.21.15.71:0/3205153856 >> v2:172.21.15.194:3300/0 conn(0x7f97b015fca0 msgr2=0x7f97b00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 --2- 172.21.15.71:0/3205153856 >> v2:172.21.15.194:3300/0 conn(0x7f97b015fca0 0x7f97b00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 -- 172.21.15.71:0/3205153856 >> v1:172.21.15.194:6789/0 conn(0x7f97b00b5c90 legacy=0x7f97b00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b6d9c700 1 -- 172.21.15.71:0/3205153856 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00cda50 con 0x7f97b00b6110 2023-07-06T01:09:43.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.343+0000 7f97b659b700 1 --2- 172.21.15.71:0/3205153856 >> v2:172.21.15.194:3300/0 conn(0x7f97b015fca0 0x7f97b00d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b6d9c700 1 --2- 172.21.15.71:0/3205153856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00cfc10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f97b00d0930 tx=0x7f97a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3509b2c14b723d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b5599700 1 -- 172.21.15.71:0/3205153856 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800e070 con 0x7f97b00b6110 2023-07-06T01:09:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b5599700 1 -- 172.21.15.71:0/3205153856 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8003a20 con 0x7f97b00b6110 2023-07-06T01:09:43.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b5599700 1 -- 172.21.15.71:0/3205153856 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8003dd0 con 0x7f97b00b6110 2023-07-06T01:09:43.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b87ff700 1 -- 172.21.15.71:0/3205153856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 msgr2=0x7f97b00cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b87ff700 1 --2- 172.21.15.71:0/3205153856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00cfc10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f97b00d0930 tx=0x7f97a800b330 comp rx=0 tx=0).stop 2023-07-06T01:09:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b87ff700 1 -- 172.21.15.71:0/3205153856 shutdown_connections 2023-07-06T01:09:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b87ff700 1 --2- 172.21.15.71:0/3205153856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00cfc10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b87ff700 1 --2- 172.21.15.71:0/3205153856 >> v2:172.21.15.194:3300/0 conn(0x7f97b015fca0 0x7f97b00d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.344+0000 7f97b87ff700 1 -- 172.21.15.71:0/3205153856 >> 172.21.15.71:0/3205153856 conn(0x7f97b006c150 msgr2=0x7f97b006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.345+0000 7f97b87ff700 1 -- 172.21.15.71:0/3205153856 shutdown_connections 2023-07-06T01:09:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.345+0000 7f97b87ff700 1 -- 172.21.15.71:0/3205153856 wait complete. 2023-07-06T01:09:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.346+0000 7f97b87ff700 1 Processor -- start 2023-07-06T01:09:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.346+0000 7f97b87ff700 1 -- start start 2023-07-06T01:09:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.347+0000 7f97b87ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97b00b5c90 0x7f97b00cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.347+0000 7f97b87ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.347+0000 7f97b87ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97b015fca0 0x7f97b01e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.347+0000 7f97b87ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00ca8f0 con 0x7f97b00b6110 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.347+0000 7f97b87ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00cabd0 con 0x7f97b015fca0 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.347+0000 7f97b87ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00caeb0 con 0x7f97b00b5c90 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50962/0 (socket says 172.21.15.71:50962) 2023-07-06T01:09:43.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 -- 172.21.15.71:0/1007295733 learned_addr learned my addr 172.21.15.71:0/1007295733 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b6d9c700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97b015fca0 0x7f97b01e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b659b700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97b00b5c90 0x7f97b00cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 -- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97b00b5c90 msgr2=0x7f97b00cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97b00b5c90 0x7f97b00cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 -- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97b015fca0 msgr2=0x7f97b01e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97b015fca0 0x7f97b01e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 -- 172.21.15.71:0/1007295733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8009b30 con 0x7f97b00b6110 2023-07-06T01:09:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b659b700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97b00b5c90 0x7f97b00cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b5d9a700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00c9f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c4d0 tx=0x7f97a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011790 con 0x7f97b00b6110 2023-07-06T01:09:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00118f0 con 0x7f97b00b6110 2023-07-06T01:09:43.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.348+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b00cb190 con 0x7f97b00b6110 2023-07-06T01:09:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.349+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0011ca0 con 0x7f97b00b6110 2023-07-06T01:09:43.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.349+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b01577c0 con 0x7f97b00b6110 2023-07-06T01:09:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.350+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b00cb6b0 con 0x7f97b00b6110 2023-07-06T01:09:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.351+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97a001c460 con 0x7f97b00b6110 2023-07-06T01:09:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.351+0000 7f97a6ffd700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f979406ace0 0x7f979406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.352+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f97a0089280 con 0x7f97b00b6110 2023-07-06T01:09:43.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.352+0000 7f97b659b700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f979406ace0 0x7f979406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.353+0000 7f97b659b700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f979406ace0 0x7f979406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f97ac008910 tx=0x7f97ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.355+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97b00cb6b0 con 0x7f97b00b6110 2023-07-06T01:09:43.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.554+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97b00cb6b0 con 0x7f97b00b6110 2023-07-06T01:09:43.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.554+0000 7f97a6ffd700 1 -- 172.21.15.71:0/1007295733 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97b00cb6b0 con 0x7f97b00b6110 2023-07-06T01:09:43.557 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:43.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f979406ace0 msgr2=0x7f979406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f979406ace0 0x7f979406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f97ac008910 tx=0x7f97ac008040 comp rx=0 tx=0).stop 2023-07-06T01:09:43.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 msgr2=0x7f97b00c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00c9f10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c4d0 tx=0x7f97a000c890 comp rx=0 tx=0).stop 2023-07-06T01:09:43.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 shutdown_connections 2023-07-06T01:09:43.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f979406ace0 0x7f979406d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f97b015fca0 0x7f97b01e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f97b00b5c90 0x7f97b00cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 --2- 172.21.15.71:0/1007295733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97b00b6110 0x7f97b00c9f10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 >> 172.21.15.71:0/1007295733 conn(0x7f97b006c150 msgr2=0x7f97b00b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:43.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 shutdown_connections 2023-07-06T01:09:43.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.557+0000 7f97b87ff700 1 -- 172.21.15.71:0/1007295733 wait complete. 2023-07-06T01:09:43.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T01:09:43.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.770+0000 7fd59b39d700 1 Processor -- start 2023-07-06T01:09:43.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.770+0000 7fd59b39d700 1 -- start start 2023-07-06T01:09:43.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.771+0000 7fd59b39d700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd59415d3d0 0x7fd5940b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.771+0000 7fd59b39d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5940d2b90 0x7fd5940d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.771+0000 7fd59b39d700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5940b24c0 con 0x7fd59415d000 2023-07-06T01:09:43.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.771+0000 7fd59b39d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5940d34f0 con 0x7fd5940d2b90 2023-07-06T01:09:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.771+0000 7fd59b39d700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5940cd250 con 0x7fd59415d3d0 2023-07-06T01:09:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5940d2b90 0x7fd5940d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5940d2b90 0x7fd5940d2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50964/0 (socket says 172.21.15.71:50964) 2023-07-06T01:09:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 -- 172.21.15.71:0/2191438158 learned_addr learned my addr 172.21.15.71:0/2191438158 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:43.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd599b9a700 1 --2- 172.21.15.71:0/2191438158 >> v2:172.21.15.194:3300/0 conn(0x7fd59415d3d0 0x7fd5940b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 -- 172.21.15.71:0/2191438158 >> v2:172.21.15.194:3300/0 conn(0x7fd59415d3d0 msgr2=0x7fd5940b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 --2- 172.21.15.71:0/2191438158 >> v2:172.21.15.194:3300/0 conn(0x7fd59415d3d0 0x7fd5940b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 -- 172.21.15.71:0/2191438158 >> v1:172.21.15.194:6789/0 conn(0x7fd59415d000 legacy=0x7fd5940cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 -- 172.21.15.71:0/2191438158 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940cd530 con 0x7fd5940d2b90 2023-07-06T01:09:43.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd59ab9c700 1 --2- 172.21.15.71:0/2191438158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5940d2b90 0x7fd5940d2fb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd594073a50 tx=0x7fd58c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cb6b45bab54f69 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.772+0000 7fd599399700 1 -- 172.21.15.71:0/2191438158 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00e070 con 0x7fd5940d2b90 2023-07-06T01:09:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd599399700 1 -- 172.21.15.71:0/2191438158 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c003a20 con 0x7fd5940d2b90 2023-07-06T01:09:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd599399700 1 -- 172.21.15.71:0/2191438158 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c003dd0 con 0x7fd5940d2b90 2023-07-06T01:09:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 -- 172.21.15.71:0/2191438158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5940d2b90 msgr2=0x7fd5940d2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 --2- 172.21.15.71:0/2191438158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5940d2b90 0x7fd5940d2fb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd594073a50 tx=0x7fd58c00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:43.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 -- 172.21.15.71:0/2191438158 shutdown_connections 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 --2- 172.21.15.71:0/2191438158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5940d2b90 0x7fd5940d2fb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 --2- 172.21.15.71:0/2191438158 >> v2:172.21.15.194:3300/0 conn(0x7fd59415d3d0 0x7fd5940b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 -- 172.21.15.71:0/2191438158 >> 172.21.15.71:0/2191438158 conn(0x7fd59406a4e0 msgr2=0x7fd59406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 -- 172.21.15.71:0/2191438158 shutdown_connections 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.773+0000 7fd59b39d700 1 -- 172.21.15.71:0/2191438158 wait complete. 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.776+0000 7fd59b39d700 1 Processor -- start 2023-07-06T01:09:43.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.776+0000 7fd59b39d700 1 -- start start 2023-07-06T01:09:43.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59b39d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940d2b90 0x7fd594155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59b39d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd59415d000 0x7fd594150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59b39d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 0x7fd5940b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59b39d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b7920 con 0x7fd59415d3d0 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59b39d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5940b7c00 con 0x7fd5940d2b90 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59b39d700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5941e5ce0 con 0x7fd59415d000 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59ab9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 0x7fd5940b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59ab9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 0x7fd5940b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50978/0 (socket says 172.21.15.71:50978) 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59ab9c700 1 -- 172.21.15.71:0/1863168899 learned_addr learned my addr 172.21.15.71:0/1863168899 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd59a39b700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940d2b90 0x7fd594155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.777+0000 7fd599b9a700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd59415d000 0x7fd594150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59ab9c700 1 -- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd59415d000 msgr2=0x7fd594150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59ab9c700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd59415d000 0x7fd594150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59ab9c700 1 -- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940d2b90 msgr2=0x7fd594155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59ab9c700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940d2b90 0x7fd594155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59ab9c700 1 -- 172.21.15.71:0/1863168899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c009b30 con 0x7fd59415d3d0 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59ab9c700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 0x7fd5940b3c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00b370 tx=0x7fd58c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:43.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c004440 con 0x7fd59415d3d0 2023-07-06T01:09:43.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c0092e0 con 0x7fd59415d3d0 2023-07-06T01:09:43.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c004800 con 0x7fd59415d3d0 2023-07-06T01:09:43.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5941e5fc0 con 0x7fd59415d3d0 2023-07-06T01:09:43.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.778+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5941509d0 con 0x7fd59415d3d0 2023-07-06T01:09:43.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.779+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5941e6480 con 0x7fd59415d3d0 2023-07-06T01:09:43.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.780+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd58c012430 con 0x7fd59415d3d0 2023-07-06T01:09:43.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.782+0000 7fd58affd700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd57806ace0 0x7fd57806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:43.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.782+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd58c08a580 con 0x7fd59415d3d0 2023-07-06T01:09:43.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.783+0000 7fd59a39b700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd57806ace0 0x7fd57806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:43.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.783+0000 7fd59a39b700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd57806ace0 0x7fd57806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd590007fd0 tx=0x7fd590007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:43.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.787+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd58c055680 con 0x7fd59415d3d0 2023-07-06T01:09:43.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.997+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd5940b24c0 con 0x7fd59415d3d0 2023-07-06T01:09:44.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.997+0000 7fd58affd700 1 -- 172.21.15.71:0/1863168899 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd5940b24c0 con 0x7fd59415d3d0 2023-07-06T01:09:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd57806ace0 msgr2=0x7fd57806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd57806ace0 0x7fd57806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd590007fd0 tx=0x7fd590007ec0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 msgr2=0x7fd5940b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 0x7fd5940b3c50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00b370 tx=0x7fd58c004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 shutdown_connections 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd57806ace0 0x7fd57806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd59415d3d0 0x7fd5940b3c50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5940d2b90 0x7fd594155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:43.999+0000 7fd59b39d700 1 --2- 172.21.15.71:0/1863168899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd59415d000 0x7fd594150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.000+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 >> 172.21.15.71:0/1863168899 conn(0x7fd59406a4e0 msgr2=0x7fd59415a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:44.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.000+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 shutdown_connections 2023-07-06T01:09:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.000+0000 7fd59b39d700 1 -- 172.21.15.71:0/1863168899 wait complete. 2023-07-06T01:09:44.004 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2023-07-06T01:09:44.019 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-06T01:09:44.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:44.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-06T01:09:44.112 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:09:44.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:44.113 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-06T01:09:44.368 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:44.369 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:44.415 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:44.415 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:44.501 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:09:44.501 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:44.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.817+0000 7f1534fff700 1 Processor -- start 2023-07-06T01:09:44.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.817+0000 7f1534fff700 1 -- start start 2023-07-06T01:09:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.818+0000 7f1534fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300b8610 0x7f15300b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.818+0000 7f1534fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300d1370 con 0x7f15300ceed0 2023-07-06T01:09:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.818+0000 7f1534fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300d1650 con 0x7f15300cfe80 2023-07-06T01:09:44.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.818+0000 7f1534fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b8cd0 con 0x7f15300b8610 2023-07-06T01:09:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152dd9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f15300ceed0 0x7f15300cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35784/0 (socket says 172.21.15.71:35784) 2023-07-06T01:09:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152dd9b700 1 -- 172.21.15.71:0/1340039111 learned_addr learned my addr 172.21.15.71:0/1340039111 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:44.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152e59c700 1 --2- 172.21.15.71:0/1340039111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300b8610 0x7f15300b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871583036 0 0) 0x7f15300d1370 con 0x7f15300ceed0 2023-07-06T01:09:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15180035b0 con 0x7f15300ceed0 2023-07-06T01:09:44.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682357071 0 0) 0x7f15300d1650 con 0x7f15300cfe80 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15300d1370 con 0x7f15300cfe80 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152e59c700 1 -- 172.21.15.71:0/1340039111 >> v1:172.21.15.194:6789/0 conn(0x7f15300cfe80 legacy=0x7f15300d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707100195 0 0) 0x7f15180035b0 con 0x7f15300ceed0 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152e59c700 1 -- 172.21.15.71:0/1340039111 >> v1:172.21.15.71:6789/0 conn(0x7f15300ceed0 legacy=0x7f15300cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.819+0000 7f152e59c700 1 -- 172.21.15.71:0/1340039111 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300cd580 con 0x7f15300b8610 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.820+0000 7f152e59c700 1 --2- 172.21.15.71:0/1340039111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300b8610 0x7f15300b2180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1520009870 tx=0x7f1520009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462d1284d9827661 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:44.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.820+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524001670 con 0x7f15300b8610 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.820+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1520004030 con 0x7f15300b8610 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.820+0000 7f152d59a700 1 -- 172.21.15.71:0/1340039111 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200043c0 con 0x7f15300b8610 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.820+0000 7f1534fff700 1 -- 172.21.15.71:0/1340039111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300b8610 msgr2=0x7f15300b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.820+0000 7f1534fff700 1 --2- 172.21.15.71:0/1340039111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300b8610 0x7f15300b2180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1520009870 tx=0x7f1520009b80 comp rx=0 tx=0).stop 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.821+0000 7f1534fff700 1 -- 172.21.15.71:0/1340039111 shutdown_connections 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.821+0000 7f1534fff700 1 --2- 172.21.15.71:0/1340039111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300b8610 0x7f15300b2180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.821+0000 7f1534fff700 1 -- 172.21.15.71:0/1340039111 >> 172.21.15.71:0/1340039111 conn(0x7f1530071690 msgr2=0x7f1530071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.821+0000 7f1534fff700 1 -- 172.21.15.71:0/1340039111 shutdown_connections 2023-07-06T01:09:44.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.821+0000 7f1534fff700 1 -- 172.21.15.71:0/1340039111 wait complete. 2023-07-06T01:09:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.823+0000 7f1534fff700 1 Processor -- start 2023-07-06T01:09:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.823+0000 7f1534fff700 1 -- start start 2023-07-06T01:09:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.824+0000 7f1534fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 0x7f15300c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.824+0000 7f1534fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300ceed0 0x7f15300cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:44.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.824+0000 7f1534fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15300cfe80 0x7f15301f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.824+0000 7f1534fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300ca6b0 con 0x7f15300b8610 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.824+0000 7f1534fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300ca990 con 0x7f15300cfe80 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.824+0000 7f1534fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300cac70 con 0x7f15300ceed0 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 0x7f15300c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 0x7f15300c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50994/0 (socket says 172.21.15.71:50994) 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 -- 172.21.15.71:0/3575662659 learned_addr learned my addr 172.21.15.71:0/3575662659 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:44.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152dd9b700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300ceed0 0x7f15300cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:44.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152ed9d700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15300cfe80 0x7f15301f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 -- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300ceed0 msgr2=0x7f15300cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300ceed0 0x7f15300cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 -- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15300cfe80 msgr2=0x7f15301f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15300cfe80 0x7f15301f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 -- 172.21.15.71:0/3575662659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200094a0 con 0x7f15300b8610 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f152e59c700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 0x7f15300c9e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1520000c00 tx=0x7f1520004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:44.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.825+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520011630 con 0x7f15300b8610 2023-07-06T01:09:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.826+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152001f070 con 0x7f15300b8610 2023-07-06T01:09:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.826+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15300caf50 con 0x7f15300b8610 2023-07-06T01:09:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.826+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200119f0 con 0x7f15300b8610 2023-07-06T01:09:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.826+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300ca3a0 con 0x7f15300b8610 2023-07-06T01:09:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.827+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300cf300 con 0x7f15300b8610 2023-07-06T01:09:44.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.827+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1520011b50 con 0x7f15300b8610 2023-07-06T01:09:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.828+0000 7f151effd700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f151006ace0 0x7f151006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.828+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1520021070 con 0x7f15300b8610 2023-07-06T01:09:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.829+0000 7f152dd9b700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f151006ace0 0x7f151006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:44.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.829+0000 7f152dd9b700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f151006ace0 0x7f151006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1524000f60 tx=0x7f1524001c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:44.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:44.833+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1520055f60 con 0x7f15300b8610 2023-07-06T01:09:45.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.027+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15300008d0 con 0x7f15300b8610 2023-07-06T01:09:45.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.029+0000 7f151effd700 1 -- 172.21.15.71:0/3575662659 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f1520059580 con 0x7f15300b8610 2023-07-06T01:09:45.032 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:45.032 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f151006ace0 msgr2=0x7f151006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f151006ace0 0x7f151006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1524000f60 tx=0x7f1524001c00 comp rx=0 tx=0).stop 2023-07-06T01:09:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 msgr2=0x7f15300c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 0x7f15300c9e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1520000c00 tx=0x7f1520004750 comp rx=0 tx=0).stop 2023-07-06T01:09:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 shutdown_connections 2023-07-06T01:09:45.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f151006ace0 0x7f151006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15300cfe80 0x7f15301f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15300b8610 0x7f15300c9e60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 --2- 172.21.15.71:0/3575662659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15300ceed0 0x7f15300cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 >> 172.21.15.71:0/3575662659 conn(0x7f1530071690 msgr2=0x7f153015eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 shutdown_connections 2023-07-06T01:09:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.031+0000 7f1534fff700 1 -- 172.21.15.71:0/3575662659 wait complete. 2023-07-06T01:09:45.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:45.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.248+0000 7f21b87ff700 1 Processor -- start 2023-07-06T01:09:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.248+0000 7f21b87ff700 1 -- start start 2023-07-06T01:09:45.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b87ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f21b006c330 0x7f21b006c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b87ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21b00c9010 0x7f21b00c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b87ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b006cc40 con 0x7f21b01565f0 2023-07-06T01:09:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b87ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00c9a60 con 0x7f21b00c9010 2023-07-06T01:09:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b87ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b0159b70 con 0x7f21b006c330 2023-07-06T01:09:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b5d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21b00c9010 0x7f21b00c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b5d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21b00c9010 0x7f21b00c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50998/0 (socket says 172.21.15.71:50998) 2023-07-06T01:09:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b5d9a700 1 -- 172.21.15.71:0/2203051940 learned_addr learned my addr 172.21.15.71:0/2203051940 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b6d9c700 1 --1- 172.21.15.71:0/2203051940 >> v1:172.21.15.71:6789/0 conn(0x7f21b01565f0 0x7f21b0156a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35800/0 (socket says 172.21.15.71:35800) 2023-07-06T01:09:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.249+0000 7f21b659b700 1 --2- 172.21.15.71:0/2203051940 >> v2:172.21.15.194:3300/0 conn(0x7f21b006c330 0x7f21b006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5d9a700 1 -- 172.21.15.71:0/2203051940 >> v2:172.21.15.194:3300/0 conn(0x7f21b006c330 msgr2=0x7f21b006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5d9a700 1 --2- 172.21.15.71:0/2203051940 >> v2:172.21.15.194:3300/0 conn(0x7f21b006c330 0x7f21b006c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5d9a700 1 -- 172.21.15.71:0/2203051940 >> v1:172.21.15.71:6789/0 conn(0x7f21b01565f0 legacy=0x7f21b0156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5d9a700 1 -- 172.21.15.71:0/2203051940 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0159e50 con 0x7f21b00c9010 2023-07-06T01:09:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5d9a700 1 --2- 172.21.15.71:0/2203051940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b00c9010 0x7f21b00c9480 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f21b006f160 tx=0x7f21a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b3e4bfc013117 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5599700 1 -- 172.21.15.71:0/2203051940 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000f8a0 con 0x7f21b00c9010 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5599700 1 -- 172.21.15.71:0/2203051940 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a000fa00 con 0x7f21b00c9010 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.250+0000 7f21b5599700 1 -- 172.21.15.71:0/2203051940 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a000fd90 con 0x7f21b00c9010 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 -- 172.21.15.71:0/2203051940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b00c9010 msgr2=0x7f21b00c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 --2- 172.21.15.71:0/2203051940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b00c9010 0x7f21b00c9480 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f21b006f160 tx=0x7f21a0009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 -- 172.21.15.71:0/2203051940 shutdown_connections 2023-07-06T01:09:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 --2- 172.21.15.71:0/2203051940 >> v2:172.21.15.194:3300/0 conn(0x7f21b006c330 0x7f21b006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 --2- 172.21.15.71:0/2203051940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b00c9010 0x7f21b00c9480 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 -- 172.21.15.71:0/2203051940 >> 172.21.15.71:0/2203051940 conn(0x7f21b00cb440 msgr2=0x7f21b00cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:45.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 -- 172.21.15.71:0/2203051940 shutdown_connections 2023-07-06T01:09:45.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.251+0000 7f21b87ff700 1 -- 172.21.15.71:0/2203051940 wait complete. 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.253+0000 7f21b87ff700 1 Processor -- start 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.253+0000 7f21b87ff700 1 -- start start 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b87ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21b006c330 0x7f21b01f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b87ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21b00c9010 0x7f21b00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b87ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 0x7f21b0155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b87ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00b3c30 con 0x7f21b01565f0 2023-07-06T01:09:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b87ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01f6570 con 0x7f21b006c330 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b87ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01f2230 con 0x7f21b00c9010 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 0x7f21b0155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 0x7f21b0155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51000/0 (socket says 172.21.15.71:51000) 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 -- 172.21.15.71:0/3536595817 learned_addr learned my addr 172.21.15.71:0/3536595817 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b659b700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21b006c330 0x7f21b01f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b5d9a700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21b00c9010 0x7f21b00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 -- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21b00c9010 msgr2=0x7f21b00b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21b00c9010 0x7f21b00b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 -- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21b006c330 msgr2=0x7f21b01f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21b006c330 0x7f21b01f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 -- 172.21.15.71:0/3536595817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0009550 con 0x7f21b01565f0 2023-07-06T01:09:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b5d9a700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21b00c9010 0x7f21b00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b659b700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21b006c330 0x7f21b01f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.254+0000 7f21b6d9c700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 0x7f21b0155e40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f21a800cc00 tx=0x7f21a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.255+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800aba0 con 0x7f21b01565f0 2023-07-06T01:09:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.255+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800ad00 con 0x7f21b01565f0 2023-07-06T01:09:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.255+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b01f5cd0 con 0x7f21b01565f0 2023-07-06T01:09:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.255+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8007270 con 0x7f21b01565f0 2023-07-06T01:09:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.255+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b01f6290 con 0x7f21b01565f0 2023-07-06T01:09:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.256+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b01f1fd0 con 0x7f21b01565f0 2023-07-06T01:09:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.257+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21a80073d0 con 0x7f21b01565f0 2023-07-06T01:09:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.258+0000 7f21a6ffd700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f219406ace0 0x7f219406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.258+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f21a80892d0 con 0x7f21b01565f0 2023-07-06T01:09:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.258+0000 7f21b659b700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f219406ace0 0x7f219406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.259+0000 7f21b659b700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f219406ace0 0x7f219406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21b00ca660 tx=0x7f21ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.262+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21a8054350 con 0x7f21b01565f0 2023-07-06T01:09:45.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.455+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21b00008d0 con 0x7f21b01565f0 2023-07-06T01:09:45.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.455+0000 7f21a6ffd700 1 -- 172.21.15.71:0/3536595817 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21a80170a0 con 0x7f21b01565f0 2023-07-06T01:09:45.458 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f219406ace0 msgr2=0x7f219406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f219406ace0 0x7f219406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21b00ca660 tx=0x7f21ac008040 comp rx=0 tx=0).stop 2023-07-06T01:09:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 msgr2=0x7f21b0155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 0x7f21b0155e40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f21a800cc00 tx=0x7f21a800a060 comp rx=0 tx=0).stop 2023-07-06T01:09:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 shutdown_connections 2023-07-06T01:09:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f219406ace0 0x7f219406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21b01565f0 0x7f21b0155e40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21b006c330 0x7f21b01f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 --2- 172.21.15.71:0/3536595817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21b00c9010 0x7f21b00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 >> 172.21.15.71:0/3536595817 conn(0x7f21b00cb440 msgr2=0x7f21b00cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:45.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 shutdown_connections 2023-07-06T01:09:45.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.458+0000 7f21b87ff700 1 -- 172.21.15.71:0/3536595817 wait complete. 2023-07-06T01:09:45.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.675+0000 7f1094bff700 1 Processor -- start 2023-07-06T01:09:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.675+0000 7f1094bff700 1 -- start start 2023-07-06T01:09:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f1094bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f109015fca0 0x7f10900d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f1094bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b5c90 0x7f10900d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f1094bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10900cf780 con 0x7f10900b60e0 2023-07-06T01:09:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f1094bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900cd490 con 0x7f109015fca0 2023-07-06T01:09:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f1094bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900cd770 con 0x7f10900b5c90 2023-07-06T01:09:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f108ed9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f10900b60e0 0x7f10900cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35816/0 (socket says 172.21.15.71:35816) 2023-07-06T01:09:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f108ed9d700 1 -- 172.21.15.71:0/869268575 learned_addr learned my addr 172.21.15.71:0/869268575 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f1087fff700 1 --2- 172.21.15.71:0/869268575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b5c90 0x7f10900d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.676+0000 7f108e59c700 1 --2- 172.21.15.71:0/869268575 >> v2:172.21.15.194:3300/0 conn(0x7f109015fca0 0x7f10900d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f108dd9b700 1 -- 172.21.15.71:0/869268575 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766600432 0 0) 0x7f10900cf780 con 0x7f10900b60e0 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f108dd9b700 1 -- 172.21.15.71:0/869268575 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f107c0035b0 con 0x7f10900b60e0 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f1087fff700 1 -- 172.21.15.71:0/869268575 >> v2:172.21.15.194:3300/0 conn(0x7f109015fca0 msgr2=0x7f10900d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f1087fff700 1 --2- 172.21.15.71:0/869268575 >> v2:172.21.15.194:3300/0 conn(0x7f109015fca0 0x7f10900d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f1087fff700 1 -- 172.21.15.71:0/869268575 >> v1:172.21.15.71:6789/0 conn(0x7f10900b60e0 legacy=0x7f10900cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f1087fff700 1 -- 172.21.15.71:0/869268575 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900cda50 con 0x7f10900b5c90 2023-07-06T01:09:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f1087fff700 1 --2- 172.21.15.71:0/869268575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b5c90 0x7f10900d2d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1078009840 tx=0x7f1078009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8402f9672e7e1fba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f108dd9b700 1 -- 172.21.15.71:0/869268575 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078011830 con 0x7f10900b5c90 2023-07-06T01:09:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f108dd9b700 1 -- 172.21.15.71:0/869268575 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078011990 con 0x7f10900b5c90 2023-07-06T01:09:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.677+0000 7f108dd9b700 1 -- 172.21.15.71:0/869268575 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078011d20 con 0x7f10900b5c90 2023-07-06T01:09:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 -- 172.21.15.71:0/869268575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b5c90 msgr2=0x7f10900d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 --2- 172.21.15.71:0/869268575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b5c90 0x7f10900d2d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1078009840 tx=0x7f1078009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 -- 172.21.15.71:0/869268575 shutdown_connections 2023-07-06T01:09:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 --2- 172.21.15.71:0/869268575 >> v2:172.21.15.194:3300/0 conn(0x7f109015fca0 0x7f10900d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 --2- 172.21.15.71:0/869268575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b5c90 0x7f10900d2d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 -- 172.21.15.71:0/869268575 >> 172.21.15.71:0/869268575 conn(0x7f109006c150 msgr2=0x7f109006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 -- 172.21.15.71:0/869268575 shutdown_connections 2023-07-06T01:09:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.678+0000 7f1094bff700 1 -- 172.21.15.71:0/869268575 wait complete. 2023-07-06T01:09:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.680+0000 7f1094bff700 1 Processor -- start 2023-07-06T01:09:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.680+0000 7f1094bff700 1 -- start start 2023-07-06T01:09:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1094bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10900b5c90 0x7f1090157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1094bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b60e0 0x7f10901f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1094bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 0x7f10901f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1094bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090157b80 con 0x7f109015fca0 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1094bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090159b90 con 0x7f10900b5c90 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1094bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900b32d0 con 0x7f10900b60e0 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 0x7f10901f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108e59c700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10900b5c90 0x7f1090157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 0x7f10901f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51012/0 (socket says 172.21.15.71:51012) 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 -- 172.21.15.71:0/1951774438 learned_addr learned my addr 172.21.15.71:0/1951774438 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f1087fff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b60e0 0x7f10901f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 -- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b60e0 msgr2=0x7f10901f1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b60e0 0x7f10901f1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 -- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10900b5c90 msgr2=0x7f1090157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10900b5c90 0x7f1090157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.681+0000 7f108ed9d700 1 -- 172.21.15.71:0/1951774438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10780094a0 con 0x7f109015fca0 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.682+0000 7f108ed9d700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 0x7f10901f2450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f108800cc10 tx=0x7f108800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.682+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800aa20 con 0x7f109015fca0 2023-07-06T01:09:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.682+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108800ab80 con 0x7f109015fca0 2023-07-06T01:09:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.682+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088012400 con 0x7f109015fca0 2023-07-06T01:09:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.682+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109015d020 con 0x7f109015fca0 2023-07-06T01:09:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.682+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900b3800 con 0x7f109015fca0 2023-07-06T01:09:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.683+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10900008d0 con 0x7f109015fca0 2023-07-06T01:09:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.684+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f108801b3b0 con 0x7f109015fca0 2023-07-06T01:09:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.685+0000 7f1086ffd700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f107006ace0 0x7f107006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.685+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1088089040 con 0x7f109015fca0 2023-07-06T01:09:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.685+0000 7f108e59c700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f107006ace0 0x7f107006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.686+0000 7f108e59c700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f107006ace0 0x7f107006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10900b1ea0 tx=0x7f1080009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.689+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10880540c0 con 0x7f109015fca0 2023-07-06T01:09:45.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.882+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10900b8c40 con 0x7f109015fca0 2023-07-06T01:09:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.882+0000 7f1086ffd700 1 -- 172.21.15.71:0/1951774438 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1088017020 con 0x7f109015fca0 2023-07-06T01:09:45.885 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.884+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f107006ace0 msgr2=0x7f107006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.884+0000 7f1094bff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f107006ace0 0x7f107006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f10900b1ea0 tx=0x7f1080009210 comp rx=0 tx=0).stop 2023-07-06T01:09:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.884+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 msgr2=0x7f10901f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:45.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.884+0000 7f1094bff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 0x7f10901f2450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f108800cc10 tx=0x7f108800cf20 comp rx=0 tx=0).stop 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 shutdown_connections 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f107006ace0 0x7f107006d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f109015fca0 0x7f10901f2450 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10900b5c90 0x7f1090157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 --2- 172.21.15.71:0/1951774438 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10900b60e0 0x7f10901f1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 >> 172.21.15.71:0/1951774438 conn(0x7f109006c150 msgr2=0x7f10900b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 shutdown_connections 2023-07-06T01:09:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:45.885+0000 7f1094bff700 1 -- 172.21.15.71:0/1951774438 wait complete. 2023-07-06T01:09:45.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.099+0000 7f048b5ff700 1 Processor -- start 2023-07-06T01:09:46.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.100+0000 7f048b5ff700 1 -- start start 2023-07-06T01:09:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048b5ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f048415fca0 0x7f04840d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048b5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f04840cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048b5ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04840cf780 con 0x7f04840b5c90 2023-07-06T01:09:46.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048b5ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04840cd490 con 0x7f048415fca0 2023-07-06T01:09:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048b5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04840cd770 con 0x7f04840b6110 2023-07-06T01:09:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048939b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f048415fca0 0x7f04840d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048939b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f048415fca0 0x7f04840d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51026/0 (socket says 172.21.15.71:51026) 2023-07-06T01:09:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048939b700 1 -- 172.21.15.71:0/1887441272 learned_addr learned my addr 172.21.15.71:0/1887441272 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:46.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f0489b9c700 1 --2- 172.21.15.71:0/1887441272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f04840cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048939b700 1 -- 172.21.15.71:0/1887441272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 msgr2=0x7f04840cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:46.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048939b700 1 --2- 172.21.15.71:0/1887441272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f04840cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.101+0000 7f048939b700 1 -- 172.21.15.71:0/1887441272 >> v1:172.21.15.194:6789/0 conn(0x7f04840b5c90 legacy=0x7f04840d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f048939b700 1 -- 172.21.15.71:0/1887441272 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04840cda50 con 0x7f048415fca0 2023-07-06T01:09:46.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f048939b700 1 --2- 172.21.15.71:0/1887441272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f048415fca0 0x7f04840d1420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04800098f0 tx=0x7f0480009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d2d0b9fdc2c9b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f047bfff700 1 -- 172.21.15.71:0/1887441272 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000b8a0 con 0x7f048415fca0 2023-07-06T01:09:46.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f047bfff700 1 -- 172.21.15.71:0/1887441272 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048000ba00 con 0x7f048415fca0 2023-07-06T01:09:46.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f047bfff700 1 -- 172.21.15.71:0/1887441272 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000bd90 con 0x7f048415fca0 2023-07-06T01:09:46.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f048b5ff700 1 -- 172.21.15.71:0/1887441272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f048415fca0 msgr2=0x7f04840d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.102+0000 7f048b5ff700 1 --2- 172.21.15.71:0/1887441272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f048415fca0 0x7f04840d1420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f04800098f0 tx=0x7f0480009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:46.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.103+0000 7f048b5ff700 1 -- 172.21.15.71:0/1887441272 shutdown_connections 2023-07-06T01:09:46.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.103+0000 7f048b5ff700 1 --2- 172.21.15.71:0/1887441272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f04840cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.103+0000 7f048b5ff700 1 --2- 172.21.15.71:0/1887441272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f048415fca0 0x7f04840d1420 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.103+0000 7f048b5ff700 1 -- 172.21.15.71:0/1887441272 >> 172.21.15.71:0/1887441272 conn(0x7f048406c150 msgr2=0x7f048406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:46.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.103+0000 7f048b5ff700 1 -- 172.21.15.71:0/1887441272 shutdown_connections 2023-07-06T01:09:46.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.103+0000 7f048b5ff700 1 -- 172.21.15.71:0/1887441272 wait complete. 2023-07-06T01:09:46.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.104+0000 7f048b5ff700 1 Processor -- start 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.105+0000 7f048b5ff700 1 -- start start 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.105+0000 7f048b5ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 0x7f0484148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.105+0000 7f048b5ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f048415deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.105+0000 7f048b5ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048415fca0 0x7f048414ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048b5ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048415da20 con 0x7f04840b5c90 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048b5ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048414b7d0 con 0x7f048415fca0 2023-07-06T01:09:46.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048b5ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048414bab0 con 0x7f04840b6110 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 0x7f0484148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 0x7f0484148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51032/0 (socket says 172.21.15.71:51032) 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 -- 172.21.15.71:0/138614147 learned_addr learned my addr 172.21.15.71:0/138614147 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f0488b9a700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f048415deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f0489b9c700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048415fca0 0x7f048414ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 -- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 msgr2=0x7f048415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f048415deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 -- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048415fca0 msgr2=0x7f048414ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048415fca0 0x7f048414ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 -- 172.21.15.71:0/138614147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480009550 con 0x7f04840b5c90 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f0488b9a700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f048415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.106+0000 7f048939b700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 0x7f0484148350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0480009c40 tx=0x7f0480004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.107+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800036a0 con 0x7f04840b5c90 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.107+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048001e070 con 0x7f04840b5c90 2023-07-06T01:09:46.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.107+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480003a60 con 0x7f04840b5c90 2023-07-06T01:09:46.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.107+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f048415d6b0 con 0x7f04840b5c90 2023-07-06T01:09:46.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.107+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048415b9d0 con 0x7f04840b5c90 2023-07-06T01:09:46.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.108+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048415dd00 con 0x7f04840b5c90 2023-07-06T01:09:46.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.109+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0480003bc0 con 0x7f04840b5c90 2023-07-06T01:09:46.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.110+0000 7f0479ffb700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f046806ace0 0x7f046806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.110+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0480020070 con 0x7f04840b5c90 2023-07-06T01:09:46.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.110+0000 7f0488b9a700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f046806ace0 0x7f046806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.111+0000 7f0488b9a700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f046806ace0 0x7f046806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04840c6b70 tx=0x7f0474009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.114+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0480055a50 con 0x7f04840b5c90 2023-07-06T01:09:46.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.309+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04840008d0 con 0x7f04840b5c90 2023-07-06T01:09:46.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.309+0000 7f0479ffb700 1 -- 172.21.15.71:0/138614147 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0480059070 con 0x7f04840b5c90 2023-07-06T01:09:46.312 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:46.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f046806ace0 msgr2=0x7f046806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f046806ace0 0x7f046806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f04840c6b70 tx=0x7f0474009040 comp rx=0 tx=0).stop 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 msgr2=0x7f0484148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 0x7f0484148350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0480009c40 tx=0x7f0480004750 comp rx=0 tx=0).stop 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 shutdown_connections 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f046806ace0 0x7f046806d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f048415fca0 0x7f048414ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04840b5c90 0x7f0484148350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.311+0000 7f048b5ff700 1 --2- 172.21.15.71:0/138614147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04840b6110 0x7f048415deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.312+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 >> 172.21.15.71:0/138614147 conn(0x7f048406c150 msgr2=0x7f04840b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:46.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.312+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 shutdown_connections 2023-07-06T01:09:46.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.312+0000 7f048b5ff700 1 -- 172.21.15.71:0/138614147 wait complete. 2023-07-06T01:09:46.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.526+0000 7f7263bff700 1 Processor -- start 2023-07-06T01:09:46.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.526+0000 7f7263bff700 1 -- start start 2023-07-06T01:09:46.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f7263bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c15fca0 0x7f725c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f7263bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f725c0b5c90 0x7f725c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f7263bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c0cf780 con 0x7f725c0b6100 2023-07-06T01:09:46.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f7263bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0cd490 con 0x7f725c0b5c90 2023-07-06T01:09:46.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f7263bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0cd770 con 0x7f725c15fca0 2023-07-06T01:09:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f726219c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f725c0b6100 0x7f725c0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35824/0 (socket says 172.21.15.71:35824) 2023-07-06T01:09:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f726219c700 1 -- 172.21.15.71:0/3534093613 learned_addr learned my addr 172.21.15.71:0/3534093613 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.528+0000 7f726199b700 1 --2- 172.21.15.71:0/3534093613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c15fca0 0x7f725c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726119a700 1 --2- 172.21.15.71:0/3534093613 >> v2:172.21.15.194:3300/0 conn(0x7f725c0b5c90 0x7f725c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f7260999700 1 -- 172.21.15.71:0/3534093613 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707573970 0 0) 0x7f725c0cf780 con 0x7f725c0b6100 2023-07-06T01:09:46.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f7260999700 1 -- 172.21.15.71:0/3534093613 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72480035b0 con 0x7f725c0b6100 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726199b700 1 -- 172.21.15.71:0/3534093613 >> v2:172.21.15.194:3300/0 conn(0x7f725c0b5c90 msgr2=0x7f725c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726199b700 1 --2- 172.21.15.71:0/3534093613 >> v2:172.21.15.194:3300/0 conn(0x7f725c0b5c90 0x7f725c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726199b700 1 -- 172.21.15.71:0/3534093613 >> v1:172.21.15.71:6789/0 conn(0x7f725c0b6100 legacy=0x7f725c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726199b700 1 -- 172.21.15.71:0/3534093613 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0cda50 con 0x7f725c15fca0 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726119a700 1 --2- 172.21.15.71:0/3534093613 >> v2:172.21.15.194:3300/0 conn(0x7f725c0b5c90 0x7f725c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.529+0000 7f726199b700 1 --2- 172.21.15.71:0/3534093613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c15fca0 0x7f725c0d1420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7258009840 tx=0x7f7258009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1bbfafd31cd75c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7260999700 1 -- 172.21.15.71:0/3534093613 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011830 con 0x7f725c15fca0 2023-07-06T01:09:46.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7260999700 1 -- 172.21.15.71:0/3534093613 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258011990 con 0x7f725c15fca0 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7260999700 1 -- 172.21.15.71:0/3534093613 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011d20 con 0x7f725c15fca0 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 -- 172.21.15.71:0/3534093613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c15fca0 msgr2=0x7f725c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 --2- 172.21.15.71:0/3534093613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c15fca0 0x7f725c0d1420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7258009840 tx=0x7f7258009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 -- 172.21.15.71:0/3534093613 shutdown_connections 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 --2- 172.21.15.71:0/3534093613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c15fca0 0x7f725c0d1420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 --2- 172.21.15.71:0/3534093613 >> v2:172.21.15.194:3300/0 conn(0x7f725c0b5c90 0x7f725c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 -- 172.21.15.71:0/3534093613 >> 172.21.15.71:0/3534093613 conn(0x7f725c06c150 msgr2=0x7f725c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:46.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 -- 172.21.15.71:0/3534093613 shutdown_connections 2023-07-06T01:09:46.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.530+0000 7f7263bff700 1 -- 172.21.15.71:0/3534093613 wait complete. 2023-07-06T01:09:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.532+0000 7f7263bff700 1 Processor -- start 2023-07-06T01:09:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.532+0000 7f7263bff700 1 -- start start 2023-07-06T01:09:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.533+0000 7f7263bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 0x7f725c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.533+0000 7f7263bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c0b6100 0x7f725c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.533+0000 7f7263bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f725c15fca0 0x7f725c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.533+0000 7f7263bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0b5770 con 0x7f725c0b5c90 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.533+0000 7f7263bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0b5490 con 0x7f725c15fca0 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.533+0000 7f7263bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c15b7d0 con 0x7f725c0b6100 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 0x7f725c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 0x7f725c15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51036/0 (socket says 172.21.15.71:51036) 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 -- 172.21.15.71:0/763860332 learned_addr learned my addr 172.21.15.71:0/763860332 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:46.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726219c700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f725c15fca0 0x7f725c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726119a700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c0b6100 0x7f725c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 -- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c0b6100 msgr2=0x7f725c0b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c0b6100 0x7f725c0b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 -- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f725c15fca0 msgr2=0x7f725c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f725c15fca0 0x7f725c15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 -- 172.21.15.71:0/763860332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0094a0 con 0x7f725c0b5c90 2023-07-06T01:09:46.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726119a700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c0b6100 0x7f725c0b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:46.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.534+0000 7f726199b700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 0x7f725c15d250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7258014040 tx=0x7f7258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.535+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580038a0 con 0x7f725c0b5c90 2023-07-06T01:09:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.535+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725801f070 con 0x7f725c0b5c90 2023-07-06T01:09:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.535+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580094a0 con 0x7f725c0b5c90 2023-07-06T01:09:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.535+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258003c00 con 0x7f725c0b5c90 2023-07-06T01:09:46.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.535+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c15bd90 con 0x7f725c0b5c90 2023-07-06T01:09:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.536+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c06ae20 con 0x7f725c0b5c90 2023-07-06T01:09:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.537+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f725801a430 con 0x7f725c0b5c90 2023-07-06T01:09:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.538+0000 7f72527fc700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f724006ace0 0x7f724006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.538+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7258021070 con 0x7f725c0b5c90 2023-07-06T01:09:46.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.538+0000 7f726119a700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f724006ace0 0x7f724006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.539+0000 7f726119a700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f724006ace0 0x7f724006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f725c1f5170 tx=0x7f724c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.542+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f725c06ae20 con 0x7f725c0b5c90 2023-07-06T01:09:46.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.735+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f725c06ae20 con 0x7f725c0b5c90 2023-07-06T01:09:46.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.735+0000 7f72527fc700 1 -- 172.21.15.71:0/763860332 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f725c06ae20 con 0x7f725c0b5c90 2023-07-06T01:09:46.738 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:46.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.737+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f724006ace0 msgr2=0x7f724006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.737+0000 7f7263bff700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f724006ace0 0x7f724006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f725c1f5170 tx=0x7f724c008040 comp rx=0 tx=0).stop 2023-07-06T01:09:46.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.737+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 msgr2=0x7f725c15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.737+0000 7f7263bff700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 0x7f725c15d250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7258014040 tx=0x7f7258004750 comp rx=0 tx=0).stop 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 shutdown_connections 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f724006ace0 0x7f724006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f725c15fca0 0x7f725c15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f725c0b5c90 0x7f725c15d250 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 --2- 172.21.15.71:0/763860332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725c0b6100 0x7f725c0b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 >> 172.21.15.71:0/763860332 conn(0x7f725c06c150 msgr2=0x7f725c0cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:46.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 shutdown_connections 2023-07-06T01:09:46.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.738+0000 7f7263bff700 1 -- 172.21.15.71:0/763860332 wait complete. 2023-07-06T01:09:46.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T01:09:46.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.949+0000 7f652b9ff700 1 Processor -- start 2023-07-06T01:09:46.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.950+0000 7f652b9ff700 1 -- start start 2023-07-06T01:09:46.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652b9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f65240d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652b9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 0x7f65240cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652b9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65240cf780 con 0x7f65240b5c90 2023-07-06T01:09:46.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652b9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240cd490 con 0x7f65240b6100 2023-07-06T01:09:46.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652b9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65240cd770 con 0x7f652415fca0 2023-07-06T01:09:46.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652979b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f65240d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f6529f9c700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 0x7f65240cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652979b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f65240d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:56678/0 (socket says 172.21.15.71:56678) 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f6529f9c700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 0x7f65240cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:32900/0 (socket says 172.21.15.71:32900) 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f6528f9a700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f65240b5c90 0x7f65240d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:38716/0 (socket says 172.21.15.71:38716) 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.951+0000 7f652979b700 1 -- 172.21.15.71:0/2909005164 learned_addr learned my addr 172.21.15.71:0/2909005164 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f652979b700 1 -- 172.21.15.71:0/2909005164 >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 msgr2=0x7f65240cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:46.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f652979b700 1 --2- 172.21.15.71:0/2909005164 >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 0x7f65240cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f652979b700 1 -- 172.21.15.71:0/2909005164 >> v1:172.21.15.194:6789/0 conn(0x7f65240b5c90 legacy=0x7f65240d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f652979b700 1 -- 172.21.15.71:0/2909005164 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240cda50 con 0x7f652415fca0 2023-07-06T01:09:46.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f6529f9c700 1 --2- 172.21.15.71:0/2909005164 >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 0x7f65240cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:46.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f652979b700 1 --2- 172.21.15.71:0/2909005164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f65240d1420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f65200098f0 tx=0x7f6520009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3e2fcd9a7032914 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f651bfff700 1 -- 172.21.15.71:0/2909005164 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520011830 con 0x7f652415fca0 2023-07-06T01:09:46.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f651bfff700 1 -- 172.21.15.71:0/2909005164 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6520011990 con 0x7f652415fca0 2023-07-06T01:09:46.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.952+0000 7f651bfff700 1 -- 172.21.15.71:0/2909005164 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6520011d20 con 0x7f652415fca0 2023-07-06T01:09:46.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 -- 172.21.15.71:0/2909005164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 msgr2=0x7f65240d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2909005164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f65240d1420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f65200098f0 tx=0x7f6520009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 -- 172.21.15.71:0/2909005164 shutdown_connections 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2909005164 >> v2:172.21.15.194:3300/0 conn(0x7f65240b6100 0x7f65240cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2909005164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f65240d1420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 -- 172.21.15.71:0/2909005164 >> 172.21.15.71:0/2909005164 conn(0x7f652406c150 msgr2=0x7f652406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 -- 172.21.15.71:0/2909005164 shutdown_connections 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.953+0000 7f652b9ff700 1 -- 172.21.15.71:0/2909005164 wait complete. 2023-07-06T01:09:46.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.955+0000 7f652b9ff700 1 Processor -- start 2023-07-06T01:09:46.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.955+0000 7f652b9ff700 1 -- start start 2023-07-06T01:09:46.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652b9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65240b5c90 0x7f65241e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652b9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 0x7f6524156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652b9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f652415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652b9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65240b2960 con 0x7f65240b6100 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652b9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65241e80e0 con 0x7f65240b5c90 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652b9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65240b2bd0 con 0x7f652415fca0 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f6528f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 0x7f6524156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f6528f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 0x7f6524156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51040/0 (socket says 172.21.15.71:51040) 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f6528f9a700 1 -- 172.21.15.71:0/2028125452 learned_addr learned my addr 172.21.15.71:0/2028125452 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f652979b700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65240b5c90 0x7f65241e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.956+0000 7f6529f9c700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f652415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6528f9a700 1 -- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 msgr2=0x7f652415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6528f9a700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f652415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6528f9a700 1 -- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65240b5c90 msgr2=0x7f65241e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6528f9a700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65240b5c90 0x7f65241e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6528f9a700 1 -- 172.21.15.71:0/2028125452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c009a70 con 0x7f65240b6100 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6528f9a700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 0x7f6524156840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f651400c520 tx=0x7f651400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6514005cb0 con 0x7f65240b6100 2023-07-06T01:09:46.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6514005e10 con 0x7f65240b6100 2023-07-06T01:09:46.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6520009550 con 0x7f65240b6100 2023-07-06T01:09:46.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65140072d0 con 0x7f65240b6100 2023-07-06T01:09:46.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.957+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65241e83c0 con 0x7f65240b6100 2023-07-06T01:09:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.958+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65240b30f0 con 0x7f65240b6100 2023-07-06T01:09:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.959+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6514007430 con 0x7f65240b6100 2023-07-06T01:09:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.960+0000 7f6519ffb700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f650806ace0 0x7f650806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.960+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f65140888a0 con 0x7f65240b6100 2023-07-06T01:09:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.961+0000 7f652979b700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f650806ace0 0x7f650806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:46.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.961+0000 7f652979b700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f650806ace0 0x7f650806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6520009c40 tx=0x7f6520008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:46.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:46.964+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f65240b30f0 con 0x7f65240b6100 2023-07-06T01:09:47.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.173+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f65240b30f0 con 0x7f65240b6100 2023-07-06T01:09:47.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.174+0000 7f6519ffb700 1 -- 172.21.15.71:0/2028125452 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f65240b30f0 con 0x7f65240b6100 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f650806ace0 msgr2=0x7f650806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f650806ace0 0x7f650806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6520009c40 tx=0x7f6520008030 comp rx=0 tx=0).stop 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 msgr2=0x7f6524156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 0x7f6524156840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f651400c520 tx=0x7f651400c830 comp rx=0 tx=0).stop 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 shutdown_connections 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f650806ace0 0x7f650806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f652415fca0 0x7f652415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65240b5c90 0x7f65241e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 --2- 172.21.15.71:0/2028125452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65240b6100 0x7f6524156840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 >> 172.21.15.71:0/2028125452 conn(0x7f652406c150 msgr2=0x7f65240cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:47.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 shutdown_connections 2023-07-06T01:09:47.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.176+0000 7f652b9ff700 1 -- 172.21.15.71:0/2028125452 wait complete. 2023-07-06T01:09:47.181 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2023-07-06T01:09:47.196 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-06T01:09:47.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:47.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-06T01:09:47.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:09:47.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:47.285 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-06T01:09:47.331 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:47.332 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:47.382 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:47.383 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:47.430 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:09:47.430 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:09:47.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:47.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.713+0000 7ff6f8dff700 1 Processor -- start 2023-07-06T01:09:47.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.713+0000 7ff6f8dff700 1 -- start start 2023-07-06T01:09:47.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f8dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f8dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40cf780 con 0x7ff6f415fca0 2023-07-06T01:09:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f8dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f40cd490 con 0x7ff6f40b5c90 2023-07-06T01:09:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f8dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40cd770 con 0x7ff6f40b6110 2023-07-06T01:09:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f259c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff6f415fca0 0x7ff6f40d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35832/0 (socket says 172.21.15.71:35832) 2023-07-06T01:09:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f259c700 1 -- 172.21.15.71:0/1740071309 learned_addr learned my addr 172.21.15.71:0/1740071309 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:47.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.714+0000 7ff6f2d9d700 1 --2- 172.21.15.71:0/1740071309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911501787 0 0) 0x7ff6f40cf780 con 0x7ff6f415fca0 2023-07-06T01:09:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e00035b0 con 0x7ff6f415fca0 2023-07-06T01:09:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781338190 0 0) 0x7ff6f40cd490 con 0x7ff6f40b5c90 2023-07-06T01:09:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6f40cf780 con 0x7ff6f40b5c90 2023-07-06T01:09:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f2d9d700 1 -- 172.21.15.71:0/1740071309 >> v1:172.21.15.194:6789/0 conn(0x7ff6f40b5c90 legacy=0x7ff6f40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f2d9d700 1 -- 172.21.15.71:0/1740071309 >> v1:172.21.15.71:6789/0 conn(0x7ff6f415fca0 legacy=0x7ff6f40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f2d9d700 1 -- 172.21.15.71:0/1740071309 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40cda50 con 0x7ff6f40b6110 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f2d9d700 1 --2- 172.21.15.71:0/1740071309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f40cfc10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009dc0 tx=0x7ff6ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b5644b6ec24947 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00e070 con 0x7ff6f40b6110 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00bb20 con 0x7ff6f40b6110 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.715+0000 7ff6f1d9b700 1 -- 172.21.15.71:0/1740071309 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec012430 con 0x7ff6f40b6110 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 -- 172.21.15.71:0/1740071309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 msgr2=0x7ff6f40cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/1740071309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f40cfc10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009dc0 tx=0x7ff6ec00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:47.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 -- 172.21.15.71:0/1740071309 shutdown_connections 2023-07-06T01:09:47.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/1740071309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f40cfc10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 -- 172.21.15.71:0/1740071309 >> 172.21.15.71:0/1740071309 conn(0x7ff6f406c150 msgr2=0x7ff6f406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:47.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 -- 172.21.15.71:0/1740071309 shutdown_connections 2023-07-06T01:09:47.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.716+0000 7ff6f8dff700 1 -- 172.21.15.71:0/1740071309 wait complete. 2023-07-06T01:09:47.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.718+0000 7ff6f8dff700 1 Processor -- start 2023-07-06T01:09:47.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.718+0000 7ff6f8dff700 1 -- start start 2023-07-06T01:09:47.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f8dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 0x7ff6f40cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:47.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f8dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f41e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:47.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f8dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6f415fca0 0x7ff6f414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:47.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f8dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f41e6a20 con 0x7ff6f40b5c90 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f8dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f41e6d00 con 0x7ff6f415fca0 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f8dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f41e6fe0 con 0x7ff6f40b6110 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 0x7ff6f40cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 0x7ff6f40cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51046/0 (socket says 172.21.15.71:51046) 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 -- 172.21.15.71:0/3367399490 learned_addr learned my addr 172.21.15.71:0/3367399490 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6ebfff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f41e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:47.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f2d9d700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6f415fca0 0x7ff6f414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 -- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 msgr2=0x7ff6f41e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f41e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 -- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6f415fca0 msgr2=0x7ff6f414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6f415fca0 0x7ff6f414a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.719+0000 7ff6f259c700 1 -- 172.21.15.71:0/3367399490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec009a70 con 0x7ff6f40b5c90 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.720+0000 7ff6f259c700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 0x7ff6f40cbd80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4001eb0 tx=0x7ff6e400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.720+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4005d70 con 0x7ff6f40b5c90 2023-07-06T01:09:47.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.720+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e40070d0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.720+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4007460 con 0x7ff6f40b5c90 2023-07-06T01:09:47.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.720+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f41e72c0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.720+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f40cc2c0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.721+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f41e77e0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.722+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6e40075c0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.723+0000 7ff6eaffd700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff6d406ace0 0x7ff6d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:47.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.723+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff6e4088930 con 0x7ff6f40b5c90 2023-07-06T01:09:47.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.724+0000 7ff6ebfff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff6d406ace0 0x7ff6d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:47.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.724+0000 7ff6ebfff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff6d406ace0 0x7ff6d406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b4690 tx=0x7ff6dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:47.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.728+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6f41e77e0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.922+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6f41e77e0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.924+0000 7ff6eaffd700 1 -- 172.21.15.71:0/3367399490 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7ff6f41e77e0 con 0x7ff6f40b5c90 2023-07-06T01:09:47.927 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:47.927 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:47.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff6d406ace0 msgr2=0x7ff6d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff6d406ace0 0x7ff6d406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b4690 tx=0x7ff6dc009040 comp rx=0 tx=0).stop 2023-07-06T01:09:47.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 msgr2=0x7ff6f40cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:47.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 0x7ff6f40cbd80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4001eb0 tx=0x7ff6e400c7b0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 shutdown_connections 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff6d406ace0 0x7ff6d406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6f415fca0 0x7ff6f414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6f40b5c90 0x7ff6f40cbd80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 --2- 172.21.15.71:0/3367399490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6f40b6110 0x7ff6f41e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 >> 172.21.15.71:0/3367399490 conn(0x7ff6f406c150 msgr2=0x7ff6f40d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 shutdown_connections 2023-07-06T01:09:47.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:47.926+0000 7ff6f8dff700 1 -- 172.21.15.71:0/3367399490 wait complete. 2023-07-06T01:09:47.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:47.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.143+0000 7f36213ff700 1 Processor -- start 2023-07-06T01:09:48.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.143+0000 7f36213ff700 1 -- start start 2023-07-06T01:09:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f36213ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 0x7f361c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f36213ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0cf780 con 0x7f361c15fca0 2023-07-06T01:09:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f36213ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361c0cd490 con 0x7f361c0b5c90 2023-07-06T01:09:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f36213ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0cd770 con 0x7f361c0b6110 2023-07-06T01:09:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f361affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f361c15fca0 0x7f361c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35846/0 (socket says 172.21.15.71:35846) 2023-07-06T01:09:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f361affd700 1 -- 172.21.15.71:0/2787473402 learned_addr learned my addr 172.21.15.71:0/2787473402 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:48.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587747892 0 0) 0x7f361c0cf780 con 0x7f361c15fca0 2023-07-06T01:09:48.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f361b7fe700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 0x7f361c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36040035b0 con 0x7f361c15fca0 2023-07-06T01:09:48.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3598117884 0 0) 0x7f36040035b0 con 0x7f361c15fca0 2023-07-06T01:09:48.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 msgr2=0x7f361c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.145+0000 7f3619ffb700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 0x7f361c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 >> v1:172.21.15.194:6789/0 conn(0x7f361c0b5c90 legacy=0x7f361c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c0cda50 con 0x7f361c15fca0 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f360c001670 con 0x7f361c15fca0 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 >> v1:172.21.15.71:6789/0 conn(0x7f361c15fca0 legacy=0x7f361c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3604003a30 0x7f3604003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f3604004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 0x7f3604005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c0cd770 con 0x7f3604003a30 2023-07-06T01:09:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360400bac0 con 0x7f3604004850 2023-07-06T01:09:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360400bc50 con 0x7f361c0b6110 2023-07-06T01:09:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361affd700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3604003a30 0x7f3604003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361a7fc700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f3604004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361b7fe700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 0x7f3604005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361a7fc700 1 -- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 msgr2=0x7f3604005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361a7fc700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c0b6110 0x7f3604005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361a7fc700 1 -- 172.21.15.71:0/2787473402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3604003a30 msgr2=0x7f3604003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361a7fc700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3604003a30 0x7f3604003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.146+0000 7f361a7fc700 1 -- 172.21.15.71:0/2787473402 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36040035b0 con 0x7f3604004850 2023-07-06T01:09:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f361a7fc700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f3604004cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3610001800 tx=0x7f3604005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89514d244bfc10cd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100012f0 con 0x7f3604004850 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100052f0 con 0x7f3604004850 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f3619ffb700 1 -- 172.21.15.71:0/2787473402 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610006860 con 0x7f3604004850 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f36213ff700 1 -- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 msgr2=0x7f3604004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f36213ff700 1 --2- 172.21.15.71:0/2787473402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f3604004cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3610001800 tx=0x7f3604005880 comp rx=0 tx=0).stop 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.147+0000 7f361b7fe700 1 -- 172.21.15.71:0/2787473402 reap_dead start 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.148+0000 7f36213ff700 1 -- 172.21.15.71:0/2787473402 shutdown_connections 2023-07-06T01:09:48.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.148+0000 7f36213ff700 1 -- 172.21.15.71:0/2787473402 >> 172.21.15.71:0/2787473402 conn(0x7f361c06c150 msgr2=0x7f361c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.148+0000 7f36213ff700 1 -- 172.21.15.71:0/2787473402 shutdown_connections 2023-07-06T01:09:48.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.148+0000 7f36213ff700 1 -- 172.21.15.71:0/2787473402 wait complete. 2023-07-06T01:09:48.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.149+0000 7f36213ff700 1 Processor -- start 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.150+0000 7f36213ff700 1 -- start start 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.150+0000 7f36213ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f361c1e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.150+0000 7f36213ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 0x7f361c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.150+0000 7f36213ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c1f2070 0x7f361c0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f36213ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1e64d0 con 0x7f361c1570f0 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f36213ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1e5ee0 con 0x7f3604004850 2023-07-06T01:09:48.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f36213ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361c1f26c0 con 0x7f361c1f2070 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 0x7f361c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 0x7f361c1f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51066/0 (socket says 172.21.15.71:51066) 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 -- 172.21.15.71:0/3638300183 learned_addr learned my addr 172.21.15.71:0/3638300183 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361affd700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f361c1e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361b7fe700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c1f2070 0x7f361c0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 -- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c1f2070 msgr2=0x7f361c0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c1f2070 0x7f361c0d2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 -- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 msgr2=0x7f361c1e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f361c1e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 -- 172.21.15.71:0/3638300183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c1f29a0 con 0x7f361c1570f0 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.151+0000 7f361a7fc700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 0x7f361c1f1b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3610004000 tx=0x7f3610001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.152+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610006c70 con 0x7f361c1570f0 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.152+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3610006dd0 con 0x7f361c1570f0 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.152+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610007220 con 0x7f361c1570f0 2023-07-06T01:09:48.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.152+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c1e60f0 con 0x7f361c1570f0 2023-07-06T01:09:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.152+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c1e6e30 con 0x7f361c1570f0 2023-07-06T01:09:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.153+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c1f2bc0 con 0x7f361c1570f0 2023-07-06T01:09:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.154+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3610007380 con 0x7f361c1570f0 2023-07-06T01:09:48.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.155+0000 7f36037fe700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f360806ace0 0x7f360806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.155+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f361008a7b0 con 0x7f361c1570f0 2023-07-06T01:09:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.155+0000 7f361affd700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f360806ace0 0x7f360806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.156+0000 7f361affd700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f360806ace0 0x7f360806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f360c001c90 tx=0x7f360c001b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:48.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.159+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3610055810 con 0x7f361c1570f0 2023-07-06T01:09:48.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.350+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f361c1f2470 con 0x7f361c1570f0 2023-07-06T01:09:48.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.350+0000 7f36037fe700 1 -- 172.21.15.71:0/3638300183 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3610058e30 con 0x7f361c1570f0 2023-07-06T01:09:48.353 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:48.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f360806ace0 msgr2=0x7f360806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f360806ace0 0x7f360806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f360c001c90 tx=0x7f360c001b20 comp rx=0 tx=0).stop 2023-07-06T01:09:48.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 msgr2=0x7f361c1f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 0x7f361c1f1b30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3610004000 tx=0x7f3610001120 comp rx=0 tx=0).stop 2023-07-06T01:09:48.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 shutdown_connections 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f360806ace0 0x7f360806d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f361c1f2070 0x7f361c0d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3604004850 0x7f361c1e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 --2- 172.21.15.71:0/3638300183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f361c1570f0 0x7f361c1f1b30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 >> 172.21.15.71:0/3638300183 conn(0x7f361c06c150 msgr2=0x7f361c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 shutdown_connections 2023-07-06T01:09:48.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.352+0000 7f36213ff700 1 -- 172.21.15.71:0/3638300183 wait complete. 2023-07-06T01:09:48.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:48.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.569+0000 7fc8089ff700 1 Processor -- start 2023-07-06T01:09:48.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.569+0000 7fc8089ff700 1 -- start start 2023-07-06T01:09:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc8089ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc80415fca0 0x7fc8040d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc8089ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8040b5c90 0x7fc8040d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc8089ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8040cf780 con 0x7fc8040b6110 2023-07-06T01:09:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc8089ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8040cd490 con 0x7fc80415fca0 2023-07-06T01:09:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc8089ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8040cd770 con 0x7fc8040b5c90 2023-07-06T01:09:48.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc80415fca0 0x7fc8040d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc80415fca0 0x7fc8040d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51072/0 (socket says 172.21.15.71:51072) 2023-07-06T01:09:48.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 -- 172.21.15.71:0/3639334025 learned_addr learned my addr 172.21.15.71:0/3639334025 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:48.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc7fbfff700 1 --2- 172.21.15.71:0/3639334025 >> v2:172.21.15.194:3300/0 conn(0x7fc8040b5c90 0x7fc8040d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 -- 172.21.15.71:0/3639334025 >> v2:172.21.15.194:3300/0 conn(0x7fc8040b5c90 msgr2=0x7fc8040d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:48.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 --2- 172.21.15.71:0/3639334025 >> v2:172.21.15.194:3300/0 conn(0x7fc8040b5c90 0x7fc8040d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 -- 172.21.15.71:0/3639334025 >> v1:172.21.15.194:6789/0 conn(0x7fc8040b6110 legacy=0x7fc8040cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.570+0000 7fc80259c700 1 -- 172.21.15.71:0/3639334025 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8040cda50 con 0x7fc80415fca0 2023-07-06T01:09:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.571+0000 7fc80259c700 1 --2- 172.21.15.71:0/3639334025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040d1420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc80406b6f0 tx=0x7fc7f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830e6943c20a49fc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:48.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.571+0000 7fc801d9b700 1 -- 172.21.15.71:0/3639334025 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f400b870 con 0x7fc80415fca0 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.571+0000 7fc801d9b700 1 -- 172.21.15.71:0/3639334025 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f400b9d0 con 0x7fc80415fca0 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.571+0000 7fc801d9b700 1 -- 172.21.15.71:0/3639334025 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f400bd60 con 0x7fc80415fca0 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.571+0000 7fc8089ff700 1 -- 172.21.15.71:0/3639334025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 msgr2=0x7fc8040d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.571+0000 7fc8089ff700 1 --2- 172.21.15.71:0/3639334025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040d1420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc80406b6f0 tx=0x7fc7f4009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.572+0000 7fc8089ff700 1 -- 172.21.15.71:0/3639334025 shutdown_connections 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.572+0000 7fc8089ff700 1 --2- 172.21.15.71:0/3639334025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040d1420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.572+0000 7fc8089ff700 1 --2- 172.21.15.71:0/3639334025 >> v2:172.21.15.194:3300/0 conn(0x7fc8040b5c90 0x7fc8040d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.572+0000 7fc8089ff700 1 -- 172.21.15.71:0/3639334025 >> 172.21.15.71:0/3639334025 conn(0x7fc80406c150 msgr2=0x7fc80406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:48.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.572+0000 7fc8089ff700 1 -- 172.21.15.71:0/3639334025 shutdown_connections 2023-07-06T01:09:48.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.572+0000 7fc8089ff700 1 -- 172.21.15.71:0/3639334025 wait complete. 2023-07-06T01:09:48.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.573+0000 7fc8089ff700 1 Processor -- start 2023-07-06T01:09:48.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.573+0000 7fc8089ff700 1 -- start start 2023-07-06T01:09:48.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.574+0000 7fc8089ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8040b5c90 0x7fc8040d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.574+0000 7fc8089ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8040b6110 0x7fc804158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.574+0000 7fc8089ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.574+0000 7fc8089ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8040c7ed0 con 0x7fc80415fca0 2023-07-06T01:09:48.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.574+0000 7fc8089ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8040c81b0 con 0x7fc8040b5c90 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.574+0000 7fc8089ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8040c8490 con 0x7fc8040b6110 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51078/0 (socket says 172.21.15.71:51078) 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 -- 172.21.15.71:0/2103286051 learned_addr learned my addr 172.21.15.71:0/2103286051 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc80259c700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8040b5c90 0x7fc8040d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc7fbfff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8040b6110 0x7fc804158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 -- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8040b6110 msgr2=0x7fc804158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8040b6110 0x7fc804158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 -- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8040b5c90 msgr2=0x7fc8040d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8040b5c90 0x7fc8040d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 -- 172.21.15.71:0/2103286051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4009550 con 0x7fc80415fca0 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc802d9d700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040c8f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00cc50 tx=0x7fc7fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00ad80 con 0x7fc80415fca0 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00ce50 con 0x7fc80415fca0 2023-07-06T01:09:48.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.575+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8040c8770 con 0x7fc80415fca0 2023-07-06T01:09:48.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.576+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc003c40 con 0x7fc80415fca0 2023-07-06T01:09:48.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.576+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc804159920 con 0x7fc80415fca0 2023-07-06T01:09:48.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.577+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8040008d0 con 0x7fc80415fca0 2023-07-06T01:09:48.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.578+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7fc0050d0 con 0x7fc80415fca0 2023-07-06T01:09:48.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.578+0000 7fc7faffd700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc7e406ace0 0x7fc7e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:48.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.579+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc7fc089540 con 0x7fc80415fca0 2023-07-06T01:09:48.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.579+0000 7fc80259c700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc7e406ace0 0x7fc7e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:48.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.579+0000 7fc80259c700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc7e406ace0 0x7fc7e406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4014040 tx=0x7fc7f4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:48.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.583+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7fc054640 con 0x7fc80415fca0 2023-07-06T01:09:48.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.779+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc80415a560 con 0x7fc80415fca0 2023-07-06T01:09:48.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.780+0000 7fc7faffd700 1 -- 172.21.15.71:0/2103286051 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7fc057c60 con 0x7fc80415fca0 2023-07-06T01:09:48.783 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc7e406ace0 msgr2=0x7fc7e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc7e406ace0 0x7fc7e406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4014040 tx=0x7fc7f4008030 comp rx=0 tx=0).stop 2023-07-06T01:09:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 msgr2=0x7fc8040c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:48.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040c8f70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00cc50 tx=0x7fc7fc00a340 comp rx=0 tx=0).stop 2023-07-06T01:09:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 shutdown_connections 2023-07-06T01:09:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc7e406ace0 0x7fc7e406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc80415fca0 0x7fc8040c8f70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8040b5c90 0x7fc8040d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 --2- 172.21.15.71:0/2103286051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8040b6110 0x7fc804158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:48.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 >> 172.21.15.71:0/2103286051 conn(0x7fc80406c150 msgr2=0x7fc8040b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 shutdown_connections 2023-07-06T01:09:48.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.782+0000 7fc8089ff700 1 -- 172.21.15.71:0/2103286051 wait complete. 2023-07-06T01:09:48.802 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.997+0000 7f7ca45ff700 1 Processor -- start 2023-07-06T01:09:49.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.997+0000 7f7ca45ff700 1 -- start start 2023-07-06T01:09:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca45ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca45ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7c9c0b60e0 0x7f7c9c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca45ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c0cf780 con 0x7f7c9c15fca0 2023-07-06T01:09:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca45ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c0cd490 con 0x7f7c9c0b60e0 2023-07-06T01:09:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca45ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0cd770 con 0x7f7c9c0b5c90 2023-07-06T01:09:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7c9c0b60e0 0x7f7c9c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca239b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7c9c15fca0 0x7f7c9c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35850/0 (socket says 172.21.15.71:35850) 2023-07-06T01:09:49.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca2b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7c9c0b60e0 0x7f7c9c0d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51080/0 (socket says 172.21.15.71:51080) 2023-07-06T01:09:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca239b700 1 -- 172.21.15.71:0/952090267 learned_addr learned my addr 172.21.15.71:0/952090267 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:49.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca1b9a700 1 --2- 172.21.15.71:0/952090267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/952090267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 msgr2=0x7f7c9c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca2b9c700 1 --2- 172.21.15.71:0/952090267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/952090267 >> v1:172.21.15.71:6789/0 conn(0x7f7c9c15fca0 legacy=0x7f7c9c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/952090267 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0cda50 con 0x7f7c9c0b60e0 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:48.999+0000 7f7ca1399700 1 -- 172.21.15.71:0/952090267 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583682444 0 0) 0x7f7c9c0cf780 con 0x7f7c9c15fca0 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca2b9c700 1 --2- 172.21.15.71:0/952090267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c0d3280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009d90 tx=0x7f7c9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881876c2dbda32dd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca1399700 1 -- 172.21.15.71:0/952090267 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400e070 con 0x7f7c9c0b60e0 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca1399700 1 -- 172.21.15.71:0/952090267 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400bb20 con 0x7f7c9c0b60e0 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca1399700 1 -- 172.21.15.71:0/952090267 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94012430 con 0x7f7c9c0b60e0 2023-07-06T01:09:49.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca45ff700 1 -- 172.21.15.71:0/952090267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c0b60e0 msgr2=0x7f7c9c0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/952090267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c0d3280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009d90 tx=0x7f7c9400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca45ff700 1 -- 172.21.15.71:0/952090267 shutdown_connections 2023-07-06T01:09:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/952090267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c0d3280 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/952090267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.000+0000 7f7ca45ff700 1 -- 172.21.15.71:0/952090267 >> 172.21.15.71:0/952090267 conn(0x7f7c9c06c150 msgr2=0x7f7c9c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:49.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.001+0000 7f7ca45ff700 1 -- 172.21.15.71:0/952090267 shutdown_connections 2023-07-06T01:09:49.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.001+0000 7f7ca45ff700 1 -- 172.21.15.71:0/952090267 wait complete. 2023-07-06T01:09:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.002+0000 7f7ca45ff700 1 Processor -- start 2023-07-06T01:09:49.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.002+0000 7f7ca45ff700 1 -- start start 2023-07-06T01:09:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca45ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca45ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca45ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 0x7f7c9c1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca45ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c14efd0 con 0x7f7c9c15fca0 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca45ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0a9d70 con 0x7f7c9c0b60e0 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca45ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c15bc50 con 0x7f7c9c0b5c90 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.003+0000 7f7ca2b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 0x7f7c9c1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 0x7f7c9c1f5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51082/0 (socket says 172.21.15.71:51082) 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/3101137266 learned_addr learned my addr 172.21.15.71:0/3101137266 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca239b700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca1b9a700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 msgr2=0x7f7c9c15e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c15e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9c0b60e0 msgr2=0x7f7c9c1f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c1f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 -- 172.21.15.71:0/3101137266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94009a70 con 0x7f7c9c15fca0 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca1b9a700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c1f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca239b700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca2b9c700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 0x7f7c9c1f5310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c06d0f0 tx=0x7f7c94004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94012430 con 0x7f7c9c15fca0 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c94020070 con 0x7f7c9c15fca0 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94004280 con 0x7f7c9c15fca0 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.004+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c15bf30 con 0x7f7c9c15fca0 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.005+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c15c4f0 con 0x7f7c9c15fca0 2023-07-06T01:09:49.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.006+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c0ce120 con 0x7f7c9c15fca0 2023-07-06T01:09:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.006+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c940043e0 con 0x7f7c9c15fca0 2023-07-06T01:09:49.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.007+0000 7f7c92ffd700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7c8006ace0 0x7f7c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.008+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7c94022070 con 0x7f7c9c15fca0 2023-07-06T01:09:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.008+0000 7f7ca239b700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7c8006ace0 0x7f7c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.009+0000 7f7ca239b700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7c8006ace0 0x7f7c8006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7c98007fd0 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.012+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c940bd310 con 0x7f7c9c15fca0 2023-07-06T01:09:49.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.207+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c9c0008d0 con 0x7f7c9c15fca0 2023-07-06T01:09:49.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.207+0000 7f7c92ffd700 1 -- 172.21.15.71:0/3101137266 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c94056280 con 0x7f7c9c15fca0 2023-07-06T01:09:49.211 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:49.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.209+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7c8006ace0 msgr2=0x7f7c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.209+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7c8006ace0 0x7f7c8006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7c98007fd0 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2023-07-06T01:09:49.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.209+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 msgr2=0x7f7c9c1f5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.209+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 0x7f7c9c1f5310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c06d0f0 tx=0x7f7c94004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 shutdown_connections 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7c8006ace0 0x7f7c8006d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c15fca0 0x7f7c9c1f5310 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9c0b5c90 0x7f7c9c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 --2- 172.21.15.71:0/3101137266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9c0b60e0 0x7f7c9c1f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 >> 172.21.15.71:0/3101137266 conn(0x7f7c9c06c150 msgr2=0x7f7c9c0d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:49.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 shutdown_connections 2023-07-06T01:09:49.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.210+0000 7f7ca45ff700 1 -- 172.21.15.71:0/3101137266 wait complete. 2023-07-06T01:09:49.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:49.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.428+0000 7f34ee1ff700 1 Processor -- start 2023-07-06T01:09:49.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.428+0000 7f34ee1ff700 1 -- start start 2023-07-06T01:09:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.429+0000 7f34ee1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e80b5c90 0x7f34e80d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.429+0000 7f34ee1ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80cf780 con 0x7f34e80b60e0 2023-07-06T01:09:49.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.429+0000 7f34ee1ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80cd490 con 0x7f34e815fca0 2023-07-06T01:09:49.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.429+0000 7f34ee1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80cd770 con 0x7f34e80b5c90 2023-07-06T01:09:49.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e7fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f34e80b60e0 0x7f34e80cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35858/0 (socket says 172.21.15.71:35858) 2023-07-06T01:09:49.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e7fff700 1 -- 172.21.15.71:0/3005610604 learned_addr learned my addr 172.21.15.71:0/3005610604 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:49.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e6ffd700 1 --2- 172.21.15.71:0/3005610604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e80b5c90 0x7f34e80d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260326774 0 0) 0x7f34e80cf780 con 0x7f34e80b60e0 2023-07-06T01:09:49.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d00035b0 con 0x7f34e80b60e0 2023-07-06T01:09:49.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717416110 0 0) 0x7f34e80cd490 con 0x7f34e815fca0 2023-07-06T01:09:49.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e80cf780 con 0x7f34e815fca0 2023-07-06T01:09:49.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3005610604 >> v1:172.21.15.194:6789/0 conn(0x7f34e815fca0 legacy=0x7f34e80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3005610604 >> v1:172.21.15.71:6789/0 conn(0x7f34e80b60e0 legacy=0x7f34e80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.430+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3005610604 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80cda50 con 0x7f34e80b5c90 2023-07-06T01:09:49.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.431+0000 7f34e6ffd700 1 --2- 172.21.15.71:0/3005610604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e80b5c90 0x7f34e80d2d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009870 tx=0x7f34dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=610931f04137eb27 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.431+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc011830 con 0x7f34e80b5c90 2023-07-06T01:09:49.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.431+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc011990 con 0x7f34e80b5c90 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.431+0000 7f34e67fc700 1 -- 172.21.15.71:0/3005610604 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc011d00 con 0x7f34e80b5c90 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.431+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3005610604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e80b5c90 msgr2=0x7f34e80d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.431+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3005610604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e80b5c90 0x7f34e80d2d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009870 tx=0x7f34dc009b80 comp rx=0 tx=0).stop 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.432+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3005610604 shutdown_connections 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.432+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3005610604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e80b5c90 0x7f34e80d2d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.432+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3005610604 >> 172.21.15.71:0/3005610604 conn(0x7f34e806c150 msgr2=0x7f34e806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:49.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.432+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3005610604 shutdown_connections 2023-07-06T01:09:49.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.432+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3005610604 wait complete. 2023-07-06T01:09:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.433+0000 7f34ee1ff700 1 Processor -- start 2023-07-06T01:09:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.433+0000 7f34ee1ff700 1 -- start start 2023-07-06T01:09:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.434+0000 7f34ee1ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34e80b5c90 0x7f34e815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.434+0000 7f34ee1ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 0x7f34e80b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.434+0000 7f34ee1ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e815fca0 0x7f34e8157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.434+0000 7f34ee1ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81f20b0 con 0x7f34e80b60e0 2023-07-06T01:09:49.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.434+0000 7f34ee1ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80b34b0 con 0x7f34e80b5c90 2023-07-06T01:09:49.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.434+0000 7f34ee1ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815c770 con 0x7f34e815fca0 2023-07-06T01:09:49.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 0x7f34e80b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 0x7f34e80b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51096/0 (socket says 172.21.15.71:51096) 2023-07-06T01:09:49.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3304958374 learned_addr learned my addr 172.21.15.71:0/3304958374 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:49.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e77fe700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34e80b5c90 0x7f34e815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e7fff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e815fca0 0x7f34e8157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e815fca0 msgr2=0x7f34e8157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e815fca0 0x7f34e8157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34e80b5c90 msgr2=0x7f34e815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34e80b5c90 0x7f34e815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 -- 172.21.15.71:0/3304958374 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc0094a0 con 0x7f34e80b60e0 2023-07-06T01:09:49.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e7fff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e815fca0 0x7f34e8157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34e6ffd700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 0x7f34e80b3980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0097c0 tx=0x7f34dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.435+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0044d0 con 0x7f34e80b60e0 2023-07-06T01:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.436+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc01f070 con 0x7f34e80b60e0 2023-07-06T01:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.436+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e81f2330 con 0x7f34e80b60e0 2023-07-06T01:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.436+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0038e0 con 0x7f34e80b60e0 2023-07-06T01:09:49.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.436+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e815c1b0 con 0x7f34e80b60e0 2023-07-06T01:09:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.437+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e81f24c0 con 0x7f34e80b60e0 2023-07-06T01:09:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.438+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34dc003a40 con 0x7f34e80b60e0 2023-07-06T01:09:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.438+0000 7f34cffff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f34d406ace0 0x7f34d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.439+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f34dc021070 con 0x7f34e80b60e0 2023-07-06T01:09:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.439+0000 7f34e77fe700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f34d406ace0 0x7f34d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.440+0000 7f34e77fe700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f34d406ace0 0x7f34d406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f34e815ead0 tx=0x7f34d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.443+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34dc055dd0 con 0x7f34e80b60e0 2023-07-06T01:09:49.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.639+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34e80008d0 con 0x7f34e80b60e0 2023-07-06T01:09:49.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.639+0000 7f34cffff700 1 -- 172.21.15.71:0/3304958374 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34dc0150a0 con 0x7f34e80b60e0 2023-07-06T01:09:49.642 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:49.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f34d406ace0 msgr2=0x7f34d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f34d406ace0 0x7f34d406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f34e815ead0 tx=0x7f34d8009040 comp rx=0 tx=0).stop 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 msgr2=0x7f34e80b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 0x7f34e80b3980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0097c0 tx=0x7f34dc004750 comp rx=0 tx=0).stop 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 shutdown_connections 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f34d406ace0 0x7f34d406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34e815fca0 0x7f34e8157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34e80b5c90 0x7f34e815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 --2- 172.21.15.71:0/3304958374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34e80b60e0 0x7f34e80b3980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 >> 172.21.15.71:0/3304958374 conn(0x7f34e806c150 msgr2=0x7f34e80b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:49.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 shutdown_connections 2023-07-06T01:09:49.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.642+0000 7f34ee1ff700 1 -- 172.21.15.71:0/3304958374 wait complete. 2023-07-06T01:09:49.661 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T01:09:49.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.856+0000 7f02a7bff700 1 Processor -- start 2023-07-06T01:09:49.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.857+0000 7f02a7bff700 1 -- start start 2023-07-06T01:09:49.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a7bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f02a0158cd0 0x7f02a00cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.860 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a7bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a7bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00cd370 con 0x7f02a00ce420 2023-07-06T01:09:49.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a7bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00cbf50 con 0x7f02a0158cd0 2023-07-06T01:09:49.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a7bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00cd7b0 con 0x7f02a00c9010 2023-07-06T01:09:49.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a619c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f02a00ce420 0x7f02a00cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35864/0 (socket says 172.21.15.71:35864) 2023-07-06T01:09:49.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a619c700 1 -- 172.21.15.71:0/2397639697 learned_addr learned my addr 172.21.15.71:0/2397639697 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:49.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a599b700 1 --2- 172.21.15.71:0/2397639697 >> v2:172.21.15.194:3300/0 conn(0x7f02a0158cd0 0x7f02a00cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a519a700 1 --2- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a4999700 1 -- 172.21.15.71:0/2397639697 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919183090 0 0) 0x7f02a00cd370 con 0x7f02a00ce420 2023-07-06T01:09:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.858+0000 7f02a4999700 1 -- 172.21.15.71:0/2397639697 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028c0035b0 con 0x7f02a00ce420 2023-07-06T01:09:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a599b700 1 -- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 msgr2=0x7f02a006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a599b700 1 --2- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a599b700 1 -- 172.21.15.71:0/2397639697 >> v1:172.21.15.71:6789/0 conn(0x7f02a00ce420 legacy=0x7f02a00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a599b700 1 -- 172.21.15.71:0/2397639697 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00ad7f0 con 0x7f02a0158cd0 2023-07-06T01:09:49.863 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a599b700 1 --2- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a00cdee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f029c009840 tx=0x7f029c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842494c7eab76b41 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a4999700 1 -- 172.21.15.71:0/2397639697 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c011830 con 0x7f02a0158cd0 2023-07-06T01:09:49.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a4999700 1 -- 172.21.15.71:0/2397639697 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c011990 con 0x7f02a0158cd0 2023-07-06T01:09:49.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.859+0000 7f02a4999700 1 -- 172.21.15.71:0/2397639697 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c011d20 con 0x7f02a0158cd0 2023-07-06T01:09:49.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 -- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 msgr2=0x7f02a00cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a00cdee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f029c009840 tx=0x7f029c009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:49.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 -- 172.21.15.71:0/2397639697 shutdown_connections 2023-07-06T01:09:49.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a00cdee0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2397639697 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 -- 172.21.15.71:0/2397639697 >> 172.21.15.71:0/2397639697 conn(0x7f02a00cb440 msgr2=0x7f02a00cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:49.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 -- 172.21.15.71:0/2397639697 shutdown_connections 2023-07-06T01:09:49.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.860+0000 7f02a7bff700 1 -- 172.21.15.71:0/2397639697 wait complete. 2023-07-06T01:09:49.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.862+0000 7f02a7bff700 1 Processor -- start 2023-07-06T01:09:49.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.862+0000 7f02a7bff700 1 -- start start 2023-07-06T01:09:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a7bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a0153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a7bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 0x7f02a00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a7bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a7bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00c7ce0 con 0x7f02a00ce420 2023-07-06T01:09:49.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a7bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0153cc0 con 0x7f02a0158cd0 2023-07-06T01:09:49.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a7bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b0810 con 0x7f02a00c9010 2023-07-06T01:09:49.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 0x7f02a00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 0x7f02a00afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51100/0 (socket says 172.21.15.71:51100) 2023-07-06T01:09:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 -- 172.21.15.71:0/2535775173 learned_addr learned my addr 172.21.15.71:0/2535775173 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a599b700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a0153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a619c700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 -- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 msgr2=0x7f02a0153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a0153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 -- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 msgr2=0x7f02a006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:49.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:49.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a519a700 1 -- 172.21.15.71:0/2535775173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0094a0 con 0x7f02a00ce420 2023-07-06T01:09:49.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.863+0000 7f02a619c700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:49.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.864+0000 7f02a519a700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 0x7f02a00afd50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f029000e9b0 tx=0x7f029000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.864+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290009710 con 0x7f02a00ce420 2023-07-06T01:09:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.864+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029000c850 con 0x7f02a00ce420 2023-07-06T01:09:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.864+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a00c73b0 con 0x7f02a00ce420 2023-07-06T01:09:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.864+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029000cbc0 con 0x7f02a00ce420 2023-07-06T01:09:49.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.864+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a00c7970 con 0x7f02a00ce420 2023-07-06T01:09:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.865+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a00008d0 con 0x7f02a00ce420 2023-07-06T01:09:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.866+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f029000cd20 con 0x7f02a00ce420 2023-07-06T01:09:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.867+0000 7f02967fc700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f028406ace0 0x7f028406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.867+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f02900896d0 con 0x7f02a00ce420 2023-07-06T01:09:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.867+0000 7f02a599b700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f028406ace0 0x7f028406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:49.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.868+0000 7f02a599b700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f028406ace0 0x7f028406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f029c000c00 tx=0x7f029c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:49.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:49.871+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0290058130 con 0x7f02a00ce420 2023-07-06T01:09:50.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.079+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f02a00b0b20 con 0x7f02a00ce420 2023-07-06T01:09:50.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.079+0000 7f02967fc700 1 -- 172.21.15.71:0/2535775173 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0290057cc0 con 0x7f02a00ce420 2023-07-06T01:09:50.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f028406ace0 msgr2=0x7f028406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f028406ace0 0x7f028406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f029c000c00 tx=0x7f029c01c040 comp rx=0 tx=0).stop 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 msgr2=0x7f02a00afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 0x7f02a00afd50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f029000e9b0 tx=0x7f029000ed70 comp rx=0 tx=0).stop 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 shutdown_connections 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f028406ace0 0x7f028406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02a0158cd0 0x7f02a006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02a00c9010 0x7f02a0153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 --2- 172.21.15.71:0/2535775173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02a00ce420 0x7f02a00afd50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 >> 172.21.15.71:0/2535775173 conn(0x7f02a00cb440 msgr2=0x7f02a00cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:50.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 shutdown_connections 2023-07-06T01:09:50.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.082+0000 7f02a7bff700 1 -- 172.21.15.71:0/2535775173 wait complete. 2023-07-06T01:09:50.085 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2023-07-06T01:09:50.101 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-06T01:09:50.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:50.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-06T01:09:50.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:09:50.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:09:50.204 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-06T01:09:50.252 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T01:09:50.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:50.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.446+0000 7eff13fff700 1 Processor -- start 2023-07-06T01:09:50.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.447+0000 7eff13fff700 1 -- start start 2023-07-06T01:09:50.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff13fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c15fca0 0x7eff0c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff13fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff0c0b6100 0x7eff0c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff13fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0cf780 con 0x7eff0c0b5c90 2023-07-06T01:09:50.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff13fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0cd490 con 0x7eff0c0b6100 2023-07-06T01:09:50.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff13fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0cd770 con 0x7eff0c15fca0 2023-07-06T01:09:50.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff1259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff0c0b6100 0x7eff0c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff1259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff0c0b6100 0x7eff0c0cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51110/0 (socket says 172.21.15.71:51110) 2023-07-06T01:09:50.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff1259c700 1 -- 172.21.15.71:0/3748441640 learned_addr learned my addr 172.21.15.71:0/3748441640 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:50.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.448+0000 7eff11d9b700 1 --2- 172.21.15.71:0/3748441640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c15fca0 0x7eff0c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff1259c700 1 -- 172.21.15.71:0/3748441640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c15fca0 msgr2=0x7eff0c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:50.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff1259c700 1 --2- 172.21.15.71:0/3748441640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c15fca0 0x7eff0c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff1259c700 1 -- 172.21.15.71:0/3748441640 >> v1:172.21.15.194:6789/0 conn(0x7eff0c0b5c90 legacy=0x7eff0c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff1259c700 1 -- 172.21.15.71:0/3748441640 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0cda50 con 0x7eff0c0b6100 2023-07-06T01:09:50.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff1259c700 1 --2- 172.21.15.71:0/3748441640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c0b6100 0x7eff0c0cfc10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff04009e50 tx=0x7eff0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a0e0bb9d81a408 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:50.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff10d99700 1 -- 172.21.15.71:0/3748441640 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400e070 con 0x7eff0c0b6100 2023-07-06T01:09:50.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff10d99700 1 -- 172.21.15.71:0/3748441640 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0400b910 con 0x7eff0c0b6100 2023-07-06T01:09:50.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.449+0000 7eff10d99700 1 -- 172.21.15.71:0/3748441640 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400bcc0 con 0x7eff0c0b6100 2023-07-06T01:09:50.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 -- 172.21.15.71:0/3748441640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c0b6100 msgr2=0x7eff0c0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 --2- 172.21.15.71:0/3748441640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c0b6100 0x7eff0c0cfc10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7eff04009e50 tx=0x7eff0400b330 comp rx=0 tx=0).stop 2023-07-06T01:09:50.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 -- 172.21.15.71:0/3748441640 shutdown_connections 2023-07-06T01:09:50.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 --2- 172.21.15.71:0/3748441640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c0b6100 0x7eff0c0cfc10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 --2- 172.21.15.71:0/3748441640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c15fca0 0x7eff0c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 -- 172.21.15.71:0/3748441640 >> 172.21.15.71:0/3748441640 conn(0x7eff0c06c150 msgr2=0x7eff0c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:50.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 -- 172.21.15.71:0/3748441640 shutdown_connections 2023-07-06T01:09:50.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.450+0000 7eff13fff700 1 -- 172.21.15.71:0/3748441640 wait complete. 2023-07-06T01:09:50.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.451+0000 7eff13fff700 1 Processor -- start 2023-07-06T01:09:50.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.452+0000 7eff13fff700 1 -- start start 2023-07-06T01:09:50.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.452+0000 7eff13fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0b5c90 0x7eff0c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.452+0000 7eff13fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c0b6100 0x7eff0c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff13fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 0x7eff0c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff13fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1f5430 con 0x7eff0c15fca0 2023-07-06T01:09:50.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff13fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1f5710 con 0x7eff0c0b5c90 2023-07-06T01:09:50.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff13fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1f59f0 con 0x7eff0c0b6100 2023-07-06T01:09:50.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 0x7eff0c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 0x7eff0c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51126/0 (socket says 172.21.15.71:51126) 2023-07-06T01:09:50.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 -- 172.21.15.71:0/1690926305 learned_addr learned my addr 172.21.15.71:0/1690926305 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:50.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff11d9b700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0b5c90 0x7eff0c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1159a700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c0b6100 0x7eff0c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 -- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c0b6100 msgr2=0x7eff0c156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c0b6100 0x7eff0c156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 -- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0b5c90 msgr2=0x7eff0c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0b5c90 0x7eff0c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1259c700 1 -- 172.21.15.71:0/1690926305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04009b30 con 0x7eff0c15fca0 2023-07-06T01:09:50.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff1159a700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c0b6100 0x7eff0c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:50.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.453+0000 7eff11d9b700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0b5c90 0x7eff0c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:50.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.454+0000 7eff1259c700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 0x7eff0c157450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff04012000 tx=0x7eff04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:50.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.454+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04004960 con 0x7eff0c15fca0 2023-07-06T01:09:50.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.454+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040099b0 con 0x7eff0c15fca0 2023-07-06T01:09:50.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.454+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0401c680 con 0x7eff0c15fca0 2023-07-06T01:09:50.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.454+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c1f5cd0 con 0x7eff0c15fca0 2023-07-06T01:09:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.454+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c159740 con 0x7eff0c15fca0 2023-07-06T01:09:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.455+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c0008d0 con 0x7eff0c15fca0 2023-07-06T01:09:50.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.456+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff0401c7e0 con 0x7eff0c15fca0 2023-07-06T01:09:50.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.457+0000 7eff027fc700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efef006ace0 0x7efef006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.457+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7eff0408ad50 con 0x7eff0c15fca0 2023-07-06T01:09:50.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.458+0000 7eff11d9b700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efef006ace0 0x7efef006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.458+0000 7eff11d9b700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efef006ace0 0x7efef006d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7eff08009b90 tx=0x7eff08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:50.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.462+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff04055db0 con 0x7eff0c15fca0 2023-07-06T01:09:50.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.698+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff0c159740 con 0x7eff0c15fca0 2023-07-06T01:09:50.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.698+0000 7eff027fc700 1 -- 172.21.15.71:0/1690926305 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7eff0405ae60 con 0x7eff0c15fca0 2023-07-06T01:09:50.701 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:50.701 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:50.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efef006ace0 msgr2=0x7efef006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efef006ace0 0x7efef006d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7eff08009b90 tx=0x7eff08008040 comp rx=0 tx=0).stop 2023-07-06T01:09:50.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 msgr2=0x7eff0c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 0x7eff0c157450 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff04012000 tx=0x7eff04004ad0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 shutdown_connections 2023-07-06T01:09:50.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efef006ace0 0x7efef006d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff0c15fca0 0x7eff0c157450 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff0c0b5c90 0x7eff0c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 --2- 172.21.15.71:0/1690926305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff0c0b6100 0x7eff0c156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 >> 172.21.15.71:0/1690926305 conn(0x7eff0c06c150 msgr2=0x7eff0c0d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:50.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 shutdown_connections 2023-07-06T01:09:50.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.701+0000 7eff13fff700 1 -- 172.21.15.71:0/1690926305 wait complete. 2023-07-06T01:09:50.707 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:50.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:50.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.915+0000 7f12173ff700 1 Processor -- start 2023-07-06T01:09:50.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.915+0000 7f12173ff700 1 -- start start 2023-07-06T01:09:50.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.916+0000 7f12173ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f121015fca0 0x7f12100d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.916+0000 7f12173ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100cf780 con 0x7f12100b5c90 2023-07-06T01:09:50.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.916+0000 7f12173ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12100cd490 con 0x7f12100b6110 2023-07-06T01:09:50.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.916+0000 7f12173ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12100cd770 con 0x7f121015fca0 2023-07-06T01:09:50.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.916+0000 7f121499a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f12100b5c90 0x7f12100d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35872/0 (socket says 172.21.15.71:35872) 2023-07-06T01:09:50.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.916+0000 7f121499a700 1 -- 172.21.15.71:0/1555761125 learned_addr learned my addr 172.21.15.71:0/1555761125 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:50.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f121519b700 1 --2- 172.21.15.71:0/1555761125 >> v2:172.21.15.194:3300/0 conn(0x7f121015fca0 0x7f12100d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392926327 0 0) 0x7f12100cf780 con 0x7f12100b5c90 2023-07-06T01:09:50.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc0035b0 con 0x7f12100b5c90 2023-07-06T01:09:50.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4163259237 0 0) 0x7f11fc0035b0 con 0x7f12100b5c90 2023-07-06T01:09:50.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 >> v2:172.21.15.194:3300/0 conn(0x7f121015fca0 msgr2=0x7f12100d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:50.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 --2- 172.21.15.71:0/1555761125 >> v2:172.21.15.194:3300/0 conn(0x7f121015fca0 0x7f12100d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 >> v1:172.21.15.194:6789/0 conn(0x7f12100b6110 legacy=0x7f12100cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100cda50 con 0x7f12100b5c90 2023-07-06T01:09:50.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f1200001670 con 0x7f12100b5c90 2023-07-06T01:09:50.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 >> v1:172.21.15.71:6789/0 conn(0x7f12100b5c90 legacy=0x7f12100d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc005200 0x7f11fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100cd770 con 0x7f11fc003a00 2023-07-06T01:09:50.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00c080 con 0x7f11fc004850 2023-07-06T01:09:50.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc00c240 con 0x7f11fc005200 2023-07-06T01:09:50.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.917+0000 7f121519b700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121499a700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121599c700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc005200 0x7f11fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121519b700 1 -- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc005200 msgr2=0x7f11fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:50.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121519b700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc005200 0x7f11fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121519b700 1 -- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11fc004850 msgr2=0x7f11fc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:50.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121519b700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121519b700 1 -- 172.21.15.71:0/1555761125 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0035b0 con 0x7f11fc003a00 2023-07-06T01:09:50.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121499a700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11fc004850 0x7f11fc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:50.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121599c700 1 -- 172.21.15.71:0/1555761125 reap_dead start 2023-07-06T01:09:50.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f121519b700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f120c009b60 tx=0x7f11fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105df55c4fb794ae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:50.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00e6c0 con 0x7f11fc003a00 2023-07-06T01:09:50.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00e820 con 0x7f11fc003a00 2023-07-06T01:09:50.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.918+0000 7f1207fff700 1 -- 172.21.15.71:0/1555761125 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00ebb0 con 0x7f11fc003a00 2023-07-06T01:09:50.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 -- 172.21.15.71:0/1555761125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11fc003a00 msgr2=0x7f11fc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f120c009b60 tx=0x7f11fc005880 comp rx=0 tx=0).stop 2023-07-06T01:09:50.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 -- 172.21.15.71:0/1555761125 shutdown_connections 2023-07-06T01:09:50.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 --2- 172.21.15.71:0/1555761125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f11fc003a00 0x7f11fc003e10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 -- 172.21.15.71:0/1555761125 >> 172.21.15.71:0/1555761125 conn(0x7f121006c150 msgr2=0x7f121006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:50.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 -- 172.21.15.71:0/1555761125 shutdown_connections 2023-07-06T01:09:50.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.919+0000 7f12173ff700 1 -- 172.21.15.71:0/1555761125 wait complete. 2023-07-06T01:09:50.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.921+0000 7f12173ff700 1 Processor -- start 2023-07-06T01:09:50.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.921+0000 7f12173ff700 1 -- start start 2023-07-06T01:09:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f12173ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc003a00 0x7f121015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f12173ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1210148480 0x7f121015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f12173ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 0x7f121014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f12173ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121015d7e0 con 0x7f121015be10 2023-07-06T01:09:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f12173ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121015c280 con 0x7f1210148480 2023-07-06T01:09:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f12173ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121014bc40 con 0x7f11fc003a00 2023-07-06T01:09:50.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f121599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 0x7f121014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f121599c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 0x7f121014ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51144/0 (socket says 172.21.15.71:51144) 2023-07-06T01:09:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f121599c700 1 -- 172.21.15.71:0/1246615190 learned_addr learned my addr 172.21.15.71:0/1246615190 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f121519b700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc003a00 0x7f121015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.922+0000 7f121499a700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1210148480 0x7f121015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121599c700 1 -- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc003a00 msgr2=0x7f121015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121599c700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc003a00 0x7f121015e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121599c700 1 -- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1210148480 msgr2=0x7f121015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121599c700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1210148480 0x7f121015b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121599c700 1 -- 172.21.15.71:0/1246615190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121015e040 con 0x7f121015be10 2023-07-06T01:09:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121499a700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1210148480 0x7f121015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121519b700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc003a00 0x7f121015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:50.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f121599c700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 0x7f121014ad10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12100cf6f0 tx=0x7f120800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208003c10 con 0x7f121015be10 2023-07-06T01:09:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1208003d70 con 0x7f121015be10 2023-07-06T01:09:50.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208005310 con 0x7f121015be10 2023-07-06T01:09:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121014b960 con 0x7f121015be10 2023-07-06T01:09:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.923+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121015dcd0 con 0x7f121015be10 2023-07-06T01:09:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.924+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12100008d0 con 0x7f121015be10 2023-07-06T01:09:50.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.925+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1208005470 con 0x7f121015be10 2023-07-06T01:09:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.926+0000 7f1205ffb700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11f406ace0 0x7f11f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.926+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f12080895a0 con 0x7f121015be10 2023-07-06T01:09:50.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.926+0000 7f121519b700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11f406ace0 0x7f11f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:50.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.927+0000 7f121519b700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11f406ace0 0x7f11f406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f120c0090b0 tx=0x7f120c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:50.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:50.930+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1208054570 con 0x7f121015be10 2023-07-06T01:09:51.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.124+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f121015de90 con 0x7f121015be10 2023-07-06T01:09:51.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.126+0000 7f1205ffb700 1 -- 172.21.15.71:0/1246615190 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f1208057b90 con 0x7f121015be10 2023-07-06T01:09:51.128 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:51.128 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:51.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11f406ace0 msgr2=0x7f11f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11f406ace0 0x7f11f406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f120c0090b0 tx=0x7f120c008030 comp rx=0 tx=0).stop 2023-07-06T01:09:51.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 msgr2=0x7f121014ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 0x7f121014ad10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12100cf6f0 tx=0x7f120800ee80 comp rx=0 tx=0).stop 2023-07-06T01:09:51.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 shutdown_connections 2023-07-06T01:09:51.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f11f406ace0 0x7f11f406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f121015be10 0x7f121014ad10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11fc003a00 0x7f121015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 --2- 172.21.15.71:0/1246615190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1210148480 0x7f121015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 >> 172.21.15.71:0/1246615190 conn(0x7f121006c150 msgr2=0x7f12100b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:51.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 shutdown_connections 2023-07-06T01:09:51.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.128+0000 7f12173ff700 1 -- 172.21.15.71:0/1246615190 wait complete. 2023-07-06T01:09:51.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:08:49.137166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:08:49.986109+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:09:51.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:09:51.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.343+0000 7f960ddff700 1 Processor -- start 2023-07-06T01:09:51.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.344+0000 7f960ddff700 1 -- start start 2023-07-06T01:09:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f960ddff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f960815fca0 0x7f96080d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f960ddff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b5c90 0x7f96080d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f960ddff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96080cf780 con 0x7f96080b60e0 2023-07-06T01:09:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f960ddff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96080cd490 con 0x7f960815fca0 2023-07-06T01:09:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f960ddff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96080cd770 con 0x7f96080b5c90 2023-07-06T01:09:51.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f96077fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f960815fca0 0x7f96080d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f9607fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f96080b60e0 0x7f96080cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35886/0 (socket says 172.21.15.71:35886) 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f9607fff700 1 -- 172.21.15.71:0/3601388819 learned_addr learned my addr 172.21.15.71:0/3601388819 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.345+0000 7f95fffff700 1 --2- 172.21.15.71:0/3601388819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b5c90 0x7f96080d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f96077fe700 1 -- 172.21.15.71:0/3601388819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b5c90 msgr2=0x7f96080d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f96077fe700 1 --2- 172.21.15.71:0/3601388819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b5c90 0x7f96080d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f96077fe700 1 -- 172.21.15.71:0/3601388819 >> v1:172.21.15.71:6789/0 conn(0x7f96080b60e0 legacy=0x7f96080cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f96077fe700 1 -- 172.21.15.71:0/3601388819 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96080cda50 con 0x7f960815fca0 2023-07-06T01:09:51.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f96077fe700 1 --2- 172.21.15.71:0/3601388819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f96080d1420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009840 tx=0x7f95f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a212a14261f144b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f9606ffd700 1 -- 172.21.15.71:0/3601388819 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8011830 con 0x7f960815fca0 2023-07-06T01:09:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f9606ffd700 1 -- 172.21.15.71:0/3601388819 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8011990 con 0x7f960815fca0 2023-07-06T01:09:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f9606ffd700 1 -- 172.21.15.71:0/3601388819 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8011d20 con 0x7f960815fca0 2023-07-06T01:09:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f960ddff700 1 -- 172.21.15.71:0/3601388819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 msgr2=0x7f96080d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.346+0000 7f960ddff700 1 --2- 172.21.15.71:0/3601388819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f96080d1420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009840 tx=0x7f95f8009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.347+0000 7f960ddff700 1 -- 172.21.15.71:0/3601388819 shutdown_connections 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.347+0000 7f960ddff700 1 --2- 172.21.15.71:0/3601388819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f96080d1420 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.347+0000 7f960ddff700 1 --2- 172.21.15.71:0/3601388819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b5c90 0x7f96080d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.347+0000 7f960ddff700 1 -- 172.21.15.71:0/3601388819 >> 172.21.15.71:0/3601388819 conn(0x7f960806c150 msgr2=0x7f960806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.347+0000 7f960ddff700 1 -- 172.21.15.71:0/3601388819 shutdown_connections 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.347+0000 7f960ddff700 1 -- 172.21.15.71:0/3601388819 wait complete. 2023-07-06T01:09:51.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.348+0000 7f960ddff700 1 Processor -- start 2023-07-06T01:09:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 -- start start 2023-07-06T01:09:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b5c90 0x7f9608153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b60e0 0x7f96080cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f960815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96080ccc10 con 0x7f960815fca0 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96080cc370 con 0x7f96080b5c90 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.349+0000 7f960ddff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96080cc650 con 0x7f96080b60e0 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f960815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f960815a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51152/0 (socket says 172.21.15.71:51152) 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 -- 172.21.15.71:0/3571843486 learned_addr learned my addr 172.21.15.71:0/3571843486 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f95fffff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b60e0 0x7f96080cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f96077fe700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b5c90 0x7f9608153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 -- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b60e0 msgr2=0x7f96080cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b60e0 0x7f96080cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 -- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b5c90 msgr2=0x7f9608153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b5c90 0x7f9608153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 -- 172.21.15.71:0/3571843486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80094a0 con 0x7f960815fca0 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f95fffff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b60e0 0x7f96080cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:51.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9607fff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f960815a6c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f960000caf0 tx=0x7f960000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:51.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.350+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000aaa0 con 0x7f960815fca0 2023-07-06T01:09:51.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.351+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000ac00 con 0x7f960815fca0 2023-07-06T01:09:51.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.351+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96080cc930 con 0x7f960815fca0 2023-07-06T01:09:51.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.351+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600012400 con 0x7f960815fca0 2023-07-06T01:09:51.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.351+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96080cc060 con 0x7f960815fca0 2023-07-06T01:09:51.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.352+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960815bcd0 con 0x7f960815fca0 2023-07-06T01:09:51.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.352+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f960001b3b0 con 0x7f960815fca0 2023-07-06T01:09:51.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.354+0000 7f9604ff9700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f95e806ace0 0x7f95e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.354+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9600088fe0 con 0x7f960815fca0 2023-07-06T01:09:51.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.354+0000 7f96077fe700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f95e806ace0 0x7f95e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.355+0000 7f96077fe700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f95e806ace0 0x7f95e806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95f80090b0 tx=0x7f95f801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:51.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.358+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f960815bcd0 con 0x7f960815fca0 2023-07-06T01:09:51.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.554+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f960815bcd0 con 0x7f960815fca0 2023-07-06T01:09:51.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.555+0000 7f9604ff9700 1 -- 172.21.15.71:0/3571843486 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9600017020 con 0x7f960815fca0 2023-07-06T01:09:51.557 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:09:51.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f95e806ace0 msgr2=0x7f95e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f95e806ace0 0x7f95e806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95f80090b0 tx=0x7f95f801c040 comp rx=0 tx=0).stop 2023-07-06T01:09:51.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 msgr2=0x7f960815a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f960815a6c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f960000caf0 tx=0x7f960000ce00 comp rx=0 tx=0).stop 2023-07-06T01:09:51.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 shutdown_connections 2023-07-06T01:09:51.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f95e806ace0 0x7f95e806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f960815fca0 0x7f960815a6c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b5c90 0x7f9608153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 --2- 172.21.15.71:0/3571843486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96080b60e0 0x7f96080cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 >> 172.21.15.71:0/3571843486 conn(0x7f960806c150 msgr2=0x7f96080d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:51.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 shutdown_connections 2023-07-06T01:09:51.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.557+0000 7f960ddff700 1 -- 172.21.15.71:0/3571843486 wait complete. 2023-07-06T01:09:51.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:09:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.773+0000 7faa0dfff700 1 Processor -- start 2023-07-06T01:09:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.773+0000 7faa0dfff700 1 -- start start 2023-07-06T01:09:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa0dfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa0815fca0 0x7faa080d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa0dfff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa080b6110 0x7faa080cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa0dfff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080cf780 con 0x7faa080b5c90 2023-07-06T01:09:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa0dfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa080cd490 con 0x7faa0815fca0 2023-07-06T01:09:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa0dfff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa080cd770 con 0x7faa080b6110 2023-07-06T01:09:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa077fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa0815fca0 0x7faa080d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa077fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa0815fca0 0x7faa080d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51166/0 (socket says 172.21.15.71:51166) 2023-07-06T01:09:51.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.774+0000 7faa077fe700 1 -- 172.21.15.71:0/1842656667 learned_addr learned my addr 172.21.15.71:0/1842656667 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa07fff700 1 --2- 172.21.15.71:0/1842656667 >> v2:172.21.15.194:3300/0 conn(0x7faa080b6110 0x7faa080cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa077fe700 1 -- 172.21.15.71:0/1842656667 >> v2:172.21.15.194:3300/0 conn(0x7faa080b6110 msgr2=0x7faa080cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:51.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa077fe700 1 --2- 172.21.15.71:0/1842656667 >> v2:172.21.15.194:3300/0 conn(0x7faa080b6110 0x7faa080cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa077fe700 1 -- 172.21.15.71:0/1842656667 >> v1:172.21.15.194:6789/0 conn(0x7faa080b5c90 legacy=0x7faa080d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa077fe700 1 -- 172.21.15.71:0/1842656667 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080cda50 con 0x7faa0815fca0 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa077fe700 1 --2- 172.21.15.71:0/1842656667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0815fca0 0x7faa080d1420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa080cd410 tx=0x7fa9f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992c44616dcc1158 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa067fc700 1 -- 172.21.15.71:0/1842656667 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800b870 con 0x7faa0815fca0 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa067fc700 1 -- 172.21.15.71:0/1842656667 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f800b9d0 con 0x7faa0815fca0 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.775+0000 7faa067fc700 1 -- 172.21.15.71:0/1842656667 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800bd60 con 0x7faa0815fca0 2023-07-06T01:09:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 -- 172.21.15.71:0/1842656667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0815fca0 msgr2=0x7faa080d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1842656667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0815fca0 0x7faa080d1420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faa080cd410 tx=0x7fa9f8009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 -- 172.21.15.71:0/1842656667 shutdown_connections 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1842656667 >> v2:172.21.15.194:3300/0 conn(0x7faa080b6110 0x7faa080cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1842656667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa0815fca0 0x7faa080d1420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 -- 172.21.15.71:0/1842656667 >> 172.21.15.71:0/1842656667 conn(0x7faa0806c150 msgr2=0x7faa0806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 -- 172.21.15.71:0/1842656667 shutdown_connections 2023-07-06T01:09:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.776+0000 7faa0dfff700 1 -- 172.21.15.71:0/1842656667 wait complete. 2023-07-06T01:09:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.778+0000 7faa0dfff700 1 Processor -- start 2023-07-06T01:09:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.778+0000 7faa0dfff700 1 -- start start 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa0dfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa080b5c90 0x7faa0814c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa0dfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 0x7faa080c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa0dfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa0815fca0 0x7faa080d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa0dfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa080ca5c0 con 0x7faa080b6110 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa0dfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa080c9370 con 0x7faa080b5c90 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa0dfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa080c9650 con 0x7faa0815fca0 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa06ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 0x7faa080c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa06ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 0x7faa080c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51176/0 (socket says 172.21.15.71:51176) 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa06ffd700 1 -- 172.21.15.71:0/1590194169 learned_addr learned my addr 172.21.15.71:0/1590194169 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa077fe700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa080b5c90 0x7faa0814c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.779+0000 7faa07fff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa0815fca0 0x7faa080d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa06ffd700 1 -- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa0815fca0 msgr2=0x7faa080d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa06ffd700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa0815fca0 0x7faa080d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa06ffd700 1 -- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa080b5c90 msgr2=0x7faa0814c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa06ffd700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa080b5c90 0x7faa0814c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa06ffd700 1 -- 172.21.15.71:0/1590194169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f8009550 con 0x7faa080b6110 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa06ffd700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 0x7faa080c8900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c4e0 tx=0x7fa9fc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0052d0 con 0x7faa080b6110 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc005430 con 0x7faa080b6110 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa080ca810 con 0x7faa080b6110 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0038c0 con 0x7faa080b6110 2023-07-06T01:09:51.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.780+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa08159190 con 0x7faa080b6110 2023-07-06T01:09:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.781+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa080008d0 con 0x7faa080b6110 2023-07-06T01:09:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.782+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9fc003a20 con 0x7faa080b6110 2023-07-06T01:09:51.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.783+0000 7fa9effff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9f406ace0 0x7fa9f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.783+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa9fc088830 con 0x7faa080b6110 2023-07-06T01:09:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.784+0000 7faa077fe700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9f406ace0 0x7fa9f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:51.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.784+0000 7faa077fe700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9f406ace0 0x7fa9f406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8014040 tx=0x7fa9f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:51.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.787+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9fc053890 con 0x7faa080b6110 2023-07-06T01:09:51.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.982+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa080c65f0 con 0x7faa080b6110 2023-07-06T01:09:51.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.982+0000 7fa9effff700 1 -- 172.21.15.71:0/1590194169 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9fc056eb0 con 0x7faa080b6110 2023-07-06T01:09:51.984 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:09:51.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9f406ace0 msgr2=0x7fa9f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9f406ace0 0x7fa9f406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8014040 tx=0x7fa9f8008030 comp rx=0 tx=0).stop 2023-07-06T01:09:51.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 msgr2=0x7faa080c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 0x7faa080c8900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c4e0 tx=0x7fa9fc00c7f0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 shutdown_connections 2023-07-06T01:09:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa9f406ace0 0x7fa9f406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa0815fca0 0x7faa080d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa080b5c90 0x7faa0814c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 --2- 172.21.15.71:0/1590194169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa080b6110 0x7faa080c8900 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.984+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 >> 172.21.15.71:0/1590194169 conn(0x7faa0806c150 msgr2=0x7faa080b7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.985+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 shutdown_connections 2023-07-06T01:09:51.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:51.985+0000 7faa0dfff700 1 -- 172.21.15.71:0/1590194169 wait complete. 2023-07-06T01:09:52.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:09:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.200+0000 7f8aca9ff700 1 Processor -- start 2023-07-06T01:09:52.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.200+0000 7f8aca9ff700 1 -- start start 2023-07-06T01:09:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.201+0000 7f8aca9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ac40b6110 0x7f8ac40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.201+0000 7f8aca9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40cf780 con 0x7f8ac415fca0 2023-07-06T01:09:52.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.201+0000 7f8aca9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40cd490 con 0x7f8ac40b5c90 2023-07-06T01:09:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8aca9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac40cd770 con 0x7f8ac40b6110 2023-07-06T01:09:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac8f9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ac40b6110 0x7f8ac40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8ac415fca0 0x7f8ac40d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:35892/0 (socket says 172.21.15.71:35892) 2023-07-06T01:09:52.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac3fff700 1 -- 172.21.15.71:0/1034428439 learned_addr learned my addr 172.21.15.71:0/1034428439 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac8f9c700 1 -- 172.21.15.71:0/1034428439 >> v1:172.21.15.194:6789/0 conn(0x7f8ac40b5c90 legacy=0x7f8ac40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac8f9c700 1 -- 172.21.15.71:0/1034428439 >> v1:172.21.15.71:6789/0 conn(0x7f8ac415fca0 legacy=0x7f8ac40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac8f9c700 1 -- 172.21.15.71:0/1034428439 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40cda50 con 0x7f8ac40b6110 2023-07-06T01:09:52.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac2ffd700 1 -- 172.21.15.71:0/1034428439 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775690715 0 0) 0x7f8ac40cf780 con 0x7f8ac415fca0 2023-07-06T01:09:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.202+0000 7f8ac8f9c700 1 --2- 172.21.15.71:0/1034428439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b6110 0x7f8ac40cfc10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009d90 tx=0x7f8abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c2ea66fc4ccd93 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8ac2ffd700 1 -- 172.21.15.71:0/1034428439 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc00e070 con 0x7f8ac40b6110 2023-07-06T01:09:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8ac2ffd700 1 -- 172.21.15.71:0/1034428439 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc00bbd0 con 0x7f8ac40b6110 2023-07-06T01:09:52.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8ac2ffd700 1 -- 172.21.15.71:0/1034428439 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc012430 con 0x7f8ac40b6110 2023-07-06T01:09:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 -- 172.21.15.71:0/1034428439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b6110 msgr2=0x7f8ac40cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/1034428439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b6110 0x7f8ac40cfc10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009d90 tx=0x7f8abc00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 -- 172.21.15.71:0/1034428439 shutdown_connections 2023-07-06T01:09:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/1034428439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b6110 0x7f8ac40cfc10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 -- 172.21.15.71:0/1034428439 >> 172.21.15.71:0/1034428439 conn(0x7f8ac406c150 msgr2=0x7f8ac406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 -- 172.21.15.71:0/1034428439 shutdown_connections 2023-07-06T01:09:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.203+0000 7f8aca9ff700 1 -- 172.21.15.71:0/1034428439 wait complete. 2023-07-06T01:09:52.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.205+0000 7f8aca9ff700 1 Processor -- start 2023-07-06T01:09:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.205+0000 7f8aca9ff700 1 -- start start 2023-07-06T01:09:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8aca9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 0x7f8ac41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8aca9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ac40b6110 0x7f8ac40c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8aca9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ac415fca0 0x7f8ac40c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8aca9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c6930 con 0x7f8ac40b5c90 2023-07-06T01:09:52.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8aca9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c6b80 con 0x7f8ac415fca0 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8aca9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c6e60 con 0x7f8ac40b6110 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8ac3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 0x7f8ac41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8ac3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 0x7f8ac41571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51196/0 (socket says 172.21.15.71:51196) 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.206+0000 7f8ac3fff700 1 -- 172.21.15.71:0/392334425 learned_addr learned my addr 172.21.15.71:0/392334425 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac8f9c700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ac415fca0 0x7f8ac40c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac37fe700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ac40b6110 0x7f8ac40c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac3fff700 1 -- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ac40b6110 msgr2=0x7f8ac40c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac3fff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ac40b6110 0x7f8ac40c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac3fff700 1 -- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ac415fca0 msgr2=0x7f8ac40c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac3fff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ac415fca0 0x7f8ac40c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac3fff700 1 -- 172.21.15.71:0/392334425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc009a70 con 0x7f8ac40b5c90 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac37fe700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ac40b6110 0x7f8ac40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac8f9c700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ac415fca0 0x7f8ac40c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac3fff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 0x7f8ac41571f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c520 tx=0x7f8ab400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4004c80 con 0x7f8ac40b5c90 2023-07-06T01:09:52.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4004e20 con 0x7f8ac40b5c90 2023-07-06T01:09:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac40c7140 con 0x7f8ac40b5c90 2023-07-06T01:09:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4007310 con 0x7f8ac40b5c90 2023-07-06T01:09:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.207+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac40c7700 con 0x7f8ac40b5c90 2023-07-06T01:09:52.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.208+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac40008d0 con 0x7f8ac40b5c90 2023-07-06T01:09:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.209+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ab4007470 con 0x7f8ac40b5c90 2023-07-06T01:09:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.210+0000 7f8ac0ff9700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.210+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8ab4089180 con 0x7f8ac40b5c90 2023-07-06T01:09:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.211+0000 7f8ac37fe700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.211+0000 7f8ac37fe700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cc960 tx=0x7f8ab8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:52.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.214+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8ab40541e0 con 0x7f8ac40b5c90 2023-07-06T01:09:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.407+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ac40733a0 con 0x7f8ac40b5c90 2023-07-06T01:09:52.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.408+0000 7f8ac0ff9700 1 -- 172.21.15.71:0/392334425 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ab4057800 con 0x7f8ac40b5c90 2023-07-06T01:09:52.410 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:09:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.410+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 msgr2=0x7f8ab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.410+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cc960 tx=0x7f8ab8009040 comp rx=0 tx=0).stop 2023-07-06T01:09:52.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.410+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 msgr2=0x7f8ac41571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.410+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 0x7f8ac41571f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c520 tx=0x7f8ab400c8e0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 shutdown_connections 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ac415fca0 0x7f8ac40c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ac40b5c90 0x7f8ac41571f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 --2- 172.21.15.71:0/392334425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ac40b6110 0x7f8ac40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 >> 172.21.15.71:0/392334425 conn(0x7f8ac406c150 msgr2=0x7f8ac40b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 shutdown_connections 2023-07-06T01:09:52.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.411+0000 7f8aca9ff700 1 -- 172.21.15.71:0/392334425 wait complete. 2023-07-06T01:09:52.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:09:52.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.625+0000 7fae259ff700 1 Processor -- start 2023-07-06T01:09:52.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.626+0000 7fae259ff700 1 -- start start 2023-07-06T01:09:52.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae259ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fae2015fca0 0x7fae200d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae259ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 0x7fae200d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae259ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200cf780 con 0x7fae200b60e0 2023-07-06T01:09:52.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae259ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200cd490 con 0x7fae2015fca0 2023-07-06T01:09:52.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae259ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae200cd770 con 0x7fae200b5c90 2023-07-06T01:09:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae17fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 0x7fae200d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae17fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 0x7fae200d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:56858/0 (socket says 172.21.15.71:56858) 2023-07-06T01:09:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae17fff700 1 -- 172.21.15.71:0/3520872818 learned_addr learned my addr 172.21.15.71:0/3520872818 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.627+0000 7fae1effd700 1 --2- 172.21.15.71:0/3520872818 >> v2:172.21.15.194:3300/0 conn(0x7fae2015fca0 0x7fae200d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae17fff700 1 -- 172.21.15.71:0/3520872818 >> v2:172.21.15.194:3300/0 conn(0x7fae2015fca0 msgr2=0x7fae200d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae17fff700 1 --2- 172.21.15.71:0/3520872818 >> v2:172.21.15.194:3300/0 conn(0x7fae2015fca0 0x7fae200d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae1e7fc700 1 -- 172.21.15.71:0/3520872818 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810599076 0 0) 0x7fae200cf780 con 0x7fae200b60e0 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae17fff700 1 -- 172.21.15.71:0/3520872818 >> v1:172.21.15.194:6789/0 conn(0x7fae200b60e0 legacy=0x7fae200cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae17fff700 1 -- 172.21.15.71:0/3520872818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200cda50 con 0x7fae200b5c90 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae1effd700 1 --2- 172.21.15.71:0/3520872818 >> v2:172.21.15.194:3300/0 conn(0x7fae2015fca0 0x7fae200d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae17fff700 1 --2- 172.21.15.71:0/3520872818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 0x7fae200d2d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae080098f0 tx=0x7fae08009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c2f109efb1df296 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae1e7fc700 1 -- 172.21.15.71:0/3520872818 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08011830 con 0x7fae200b5c90 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae1e7fc700 1 -- 172.21.15.71:0/3520872818 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08011990 con 0x7fae200b5c90 2023-07-06T01:09:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.628+0000 7fae1e7fc700 1 -- 172.21.15.71:0/3520872818 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08011d20 con 0x7fae200b5c90 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 -- 172.21.15.71:0/3520872818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 msgr2=0x7fae200d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 --2- 172.21.15.71:0/3520872818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 0x7fae200d2d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae080098f0 tx=0x7fae08009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 -- 172.21.15.71:0/3520872818 shutdown_connections 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 --2- 172.21.15.71:0/3520872818 >> v2:172.21.15.194:3300/0 conn(0x7fae2015fca0 0x7fae200d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 --2- 172.21.15.71:0/3520872818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b5c90 0x7fae200d2d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 -- 172.21.15.71:0/3520872818 >> 172.21.15.71:0/3520872818 conn(0x7fae2006c150 msgr2=0x7fae2006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 -- 172.21.15.71:0/3520872818 shutdown_connections 2023-07-06T01:09:52.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.629+0000 7fae259ff700 1 -- 172.21.15.71:0/3520872818 wait complete. 2023-07-06T01:09:52.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.631+0000 7fae259ff700 1 Processor -- start 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.631+0000 7fae259ff700 1 -- start start 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae259ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae200b5c90 0x7fae2015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae259ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b60e0 0x7fae2015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae259ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 0x7fae201f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae259ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b5500 con 0x7fae2015fca0 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae259ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae200b2960 con 0x7fae200b5c90 2023-07-06T01:09:52.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae259ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2015cec0 con 0x7fae200b60e0 2023-07-06T01:09:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 0x7fae201f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 0x7fae201f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51200/0 (socket says 172.21.15.71:51200) 2023-07-06T01:09:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae1f7fe700 1 -- 172.21.15.71:0/3310161240 learned_addr learned my addr 172.21.15.71:0/3310161240 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae17fff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b60e0 0x7fae2015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.632+0000 7fae1effd700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae200b5c90 0x7fae2015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1f7fe700 1 -- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b60e0 msgr2=0x7fae2015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1f7fe700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b60e0 0x7fae2015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1f7fe700 1 -- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae200b5c90 msgr2=0x7fae2015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1f7fe700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae200b5c90 0x7fae2015c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1f7fe700 1 -- 172.21.15.71:0/3310161240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100094a0 con 0x7fae2015fca0 2023-07-06T01:09:52.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1f7fe700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 0x7fae201f18d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fae1800c820 tx=0x7fae1800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18003e30 con 0x7fae2015fca0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae180050f0 con 0x7fae2015fca0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180054a0 con 0x7fae2015fca0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08009550 con 0x7fae2015fca0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.633+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae200b2bd0 con 0x7fae2015fca0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.634+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae200b2e10 con 0x7fae2015fca0 2023-07-06T01:09:52.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.635+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae18005600 con 0x7fae2015fca0 2023-07-06T01:09:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.636+0000 7fae1cff9700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fae0006ad10 0x7fae0006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.636+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fae18088b80 con 0x7fae2015fca0 2023-07-06T01:09:52.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.637+0000 7fae1effd700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fae0006ad10 0x7fae0006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:52.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.637+0000 7fae1effd700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fae0006ad10 0x7fae0006d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fae10009cd0 tx=0x7fae10009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:52.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.640+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fae200b2e10 con 0x7fae2015fca0 2023-07-06T01:09:52.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.836+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae200b2e10 con 0x7fae2015fca0 2023-07-06T01:09:52.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.837+0000 7fae1cff9700 1 -- 172.21.15.71:0/3310161240 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae200b2e10 con 0x7fae2015fca0 2023-07-06T01:09:52.838 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:09:52.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fae0006ad10 msgr2=0x7fae0006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fae0006ad10 0x7fae0006d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fae10009cd0 tx=0x7fae10009210 comp rx=0 tx=0).stop 2023-07-06T01:09:52.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 msgr2=0x7fae201f18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:52.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 0x7fae201f18d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fae1800c820 tx=0x7fae1800cb30 comp rx=0 tx=0).stop 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 shutdown_connections 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fae0006ad10 0x7fae0006d1c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae2015fca0 0x7fae201f18d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae200b5c90 0x7fae2015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.839+0000 7fae259ff700 1 --2- 172.21.15.71:0/3310161240 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fae200b60e0 0x7fae2015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.840+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 >> 172.21.15.71:0/3310161240 conn(0x7fae2006c150 msgr2=0x7fae200b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:52.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.840+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 shutdown_connections 2023-07-06T01:09:52.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:52.840+0000 7fae259ff700 1 -- 172.21.15.71:0/3310161240 wait complete. 2023-07-06T01:09:52.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.053+0000 7f95b69ff700 1 Processor -- start 2023-07-06T01:09:53.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.053+0000 7f95b69ff700 1 -- start start 2023-07-06T01:09:53.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.054+0000 7f95b69ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b015fca0 0x7f95b00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.054+0000 7f95b69ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00cf780 con 0x7f95b00b6100 2023-07-06T01:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.054+0000 7f95b69ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00cd490 con 0x7f95b00b5c90 2023-07-06T01:09:53.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.054+0000 7f95b69ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cd770 con 0x7f95b015fca0 2023-07-06T01:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.054+0000 7f95b4f9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f95b00b6100 0x7f95b00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41430/0 (socket says 172.21.15.71:41430) 2023-07-06T01:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.054+0000 7f95b4f9c700 1 -- 172.21.15.71:0/3941032124 learned_addr learned my addr 172.21.15.71:0/3941032124 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:53.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95affff700 1 --2- 172.21.15.71:0/3941032124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b015fca0 0x7f95b00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066822666 0 0) 0x7f95b00cf780 con 0x7f95b00b6100 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c0035b0 con 0x7f95b00b6100 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129876536 0 0) 0x7f95b00cd490 con 0x7f95b00b5c90 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b00cf780 con 0x7f95b00b5c90 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95affff700 1 -- 172.21.15.71:0/3941032124 >> v1:172.21.15.194:6789/0 conn(0x7f95b00b5c90 legacy=0x7f95b00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95affff700 1 -- 172.21.15.71:0/3941032124 >> v1:172.21.15.71:6789/0 conn(0x7f95b00b6100 legacy=0x7f95b00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95affff700 1 -- 172.21.15.71:0/3941032124 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00cda50 con 0x7f95b015fca0 2023-07-06T01:09:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.055+0000 7f95affff700 1 --2- 172.21.15.71:0/3941032124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b015fca0 0x7f95b00d1420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009870 tx=0x7f95a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f14b60bb5263c02 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0011830 con 0x7f95b015fca0 2023-07-06T01:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a0011990 con 0x7f95b015fca0 2023-07-06T01:09:53.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95af7fe700 1 -- 172.21.15.71:0/3941032124 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0011d00 con 0x7f95b015fca0 2023-07-06T01:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 -- 172.21.15.71:0/3941032124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b015fca0 msgr2=0x7f95b00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 --2- 172.21.15.71:0/3941032124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b015fca0 0x7f95b00d1420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009870 tx=0x7f95a0009b80 comp rx=0 tx=0).stop 2023-07-06T01:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 -- 172.21.15.71:0/3941032124 shutdown_connections 2023-07-06T01:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 --2- 172.21.15.71:0/3941032124 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b015fca0 0x7f95b00d1420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 -- 172.21.15.71:0/3941032124 >> 172.21.15.71:0/3941032124 conn(0x7f95b006c150 msgr2=0x7f95b006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:53.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 -- 172.21.15.71:0/3941032124 shutdown_connections 2023-07-06T01:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.056+0000 7f95b69ff700 1 -- 172.21.15.71:0/3941032124 wait complete. 2023-07-06T01:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.058+0000 7f95b69ff700 1 Processor -- start 2023-07-06T01:09:53.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.058+0000 7f95b69ff700 1 -- start start 2023-07-06T01:09:53.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.059+0000 7f95b69ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b00b5c90 0x7f95b00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.059+0000 7f95b69ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b00b6100 0x7f95b01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.059+0000 7f95b69ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 0x7f95b00b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.059+0000 7f95b69ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cbe20 con 0x7f95b015fca0 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.059+0000 7f95b69ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cb210 con 0x7f95b00b6100 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.059+0000 7f95b69ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00cb4f0 con 0x7f95b00b5c90 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 0x7f95b00b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 0x7f95b00b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33532/0 (socket says 172.21.15.71:33532) 2023-07-06T01:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 -- 172.21.15.71:0/568191888 learned_addr learned my addr 172.21.15.71:0/568191888 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95affff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b00b5c90 0x7f95b00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95a7fff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b00b6100 0x7f95b01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 -- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b00b5c90 msgr2=0x7f95b00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b00b5c90 0x7f95b00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 -- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b00b6100 msgr2=0x7f95b01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b00b6100 0x7f95b01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 -- 172.21.15.71:0/568191888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00094a0 con 0x7f95b015fca0 2023-07-06T01:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95b4f9c700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 0x7f95b00b31b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f95a800cb70 tx=0x7f95a800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800aa40 con 0x7f95b015fca0 2023-07-06T01:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a800aba0 con 0x7f95b015fca0 2023-07-06T01:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.060+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8012400 con 0x7f95b015fca0 2023-07-06T01:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.061+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b00cb7d0 con 0x7f95b015fca0 2023-07-06T01:09:53.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.061+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b00b36f0 con 0x7f95b015fca0 2023-07-06T01:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.062+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b00cbfd0 con 0x7f95b015fca0 2023-07-06T01:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.063+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95a801b3b0 con 0x7f95b015fca0 2023-07-06T01:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.063+0000 7f95ad7fa700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f959006ace0 0x7f959006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.064+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f95a8089190 con 0x7f95b015fca0 2023-07-06T01:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.064+0000 7f95affff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f959006ace0 0x7f959006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.065+0000 7f95affff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f959006ace0 0x7f959006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f95a00090b0 tx=0x7f95a0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.068+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95b00cbfd0 con 0x7f95b015fca0 2023-07-06T01:09:53.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.304+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b00008d0 con 0x7f95b015fca0 2023-07-06T01:09:53.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.305+0000 7f95ad7fa700 1 -- 172.21.15.71:0/568191888 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f95a8054290 con 0x7f95b015fca0 2023-07-06T01:09:53.307 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:53.307 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:53.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f959006ace0 msgr2=0x7f959006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f959006ace0 0x7f959006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f95a00090b0 tx=0x7f95a0008030 comp rx=0 tx=0).stop 2023-07-06T01:09:53.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 msgr2=0x7f95b00b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 0x7f95b00b31b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f95a800cb70 tx=0x7f95a800ce80 comp rx=0 tx=0).stop 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 shutdown_connections 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f959006ace0 0x7f959006d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95b015fca0 0x7f95b00b31b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95b00b5c90 0x7f95b00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 --2- 172.21.15.71:0/568191888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95b00b6100 0x7f95b01573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.307+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 >> 172.21.15.71:0/568191888 conn(0x7f95b006c150 msgr2=0x7f95b015a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:53.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.308+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 shutdown_connections 2023-07-06T01:09:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.308+0000 7f95b69ff700 1 -- 172.21.15.71:0/568191888 wait complete. 2023-07-06T01:09:53.311 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:53.326 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:53.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.520+0000 7fce2cbff700 1 Processor -- start 2023-07-06T01:09:53.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.520+0000 7fce2cbff700 1 -- start start 2023-07-06T01:09:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce2cbff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fce2815fca0 0x7fce280d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce2cbff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce280b5c90 0x7fce280d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce2cbff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280cf780 con 0x7fce280b6110 2023-07-06T01:09:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce2cbff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280cd490 con 0x7fce280b5c90 2023-07-06T01:09:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce2cbff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280cd770 con 0x7fce2815fca0 2023-07-06T01:09:53.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce1ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce280b5c90 0x7fce280d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce1ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fce280b5c90 0x7fce280d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33534/0 (socket says 172.21.15.71:33534) 2023-07-06T01:09:53.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce1ffff700 1 -- 172.21.15.71:0/1130632635 learned_addr learned my addr 172.21.15.71:0/1130632635 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:53.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce26d9d700 1 --1- 172.21.15.71:0/1130632635 >> v1:172.21.15.71:6789/0 conn(0x7fce280b6110 0x7fce280cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41440/0 (socket says 172.21.15.71:41440) 2023-07-06T01:09:53.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.521+0000 7fce2659c700 1 --2- 172.21.15.71:0/1130632635 >> v2:172.21.15.194:3300/0 conn(0x7fce2815fca0 0x7fce280d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce1ffff700 1 -- 172.21.15.71:0/1130632635 >> v2:172.21.15.194:3300/0 conn(0x7fce2815fca0 msgr2=0x7fce280d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:53.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce1ffff700 1 --2- 172.21.15.71:0/1130632635 >> v2:172.21.15.194:3300/0 conn(0x7fce2815fca0 0x7fce280d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce1ffff700 1 -- 172.21.15.71:0/1130632635 >> v1:172.21.15.71:6789/0 conn(0x7fce280b6110 legacy=0x7fce280cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce1ffff700 1 -- 172.21.15.71:0/1130632635 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280cda50 con 0x7fce280b5c90 2023-07-06T01:09:53.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce2659c700 1 --2- 172.21.15.71:0/1130632635 >> v2:172.21.15.194:3300/0 conn(0x7fce2815fca0 0x7fce280d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:53.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce25d9b700 1 -- 172.21.15.71:0/1130632635 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450523226 0 0) 0x7fce280cf780 con 0x7fce280b6110 2023-07-06T01:09:53.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce1ffff700 1 --2- 172.21.15.71:0/1130632635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b5c90 0x7fce280d2d40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fce280d0930 tx=0x7fce10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dea3ee5c3e6a34b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce25d9b700 1 -- 172.21.15.71:0/1130632635 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1000b870 con 0x7fce280b5c90 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce25d9b700 1 -- 172.21.15.71:0/1130632635 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1000b9d0 con 0x7fce280b5c90 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.522+0000 7fce25d9b700 1 -- 172.21.15.71:0/1130632635 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1000bd60 con 0x7fce280b5c90 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 -- 172.21.15.71:0/1130632635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b5c90 msgr2=0x7fce280d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 --2- 172.21.15.71:0/1130632635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b5c90 0x7fce280d2d40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fce280d0930 tx=0x7fce10009bd0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 -- 172.21.15.71:0/1130632635 shutdown_connections 2023-07-06T01:09:53.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 --2- 172.21.15.71:0/1130632635 >> v2:172.21.15.194:3300/0 conn(0x7fce2815fca0 0x7fce280d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 --2- 172.21.15.71:0/1130632635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b5c90 0x7fce280d2d40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 -- 172.21.15.71:0/1130632635 >> 172.21.15.71:0/1130632635 conn(0x7fce2806c150 msgr2=0x7fce2806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:53.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 -- 172.21.15.71:0/1130632635 shutdown_connections 2023-07-06T01:09:53.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.523+0000 7fce2cbff700 1 -- 172.21.15.71:0/1130632635 wait complete. 2023-07-06T01:09:53.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.525+0000 7fce2cbff700 1 Processor -- start 2023-07-06T01:09:53.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.525+0000 7fce2cbff700 1 -- start start 2023-07-06T01:09:53.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2cbff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce280b5c90 0x7fce2814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2cbff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 0x7fce280cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2cbff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce2815fca0 0x7fce280cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2cbff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c76e0 con 0x7fce280b6110 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2cbff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c6a60 con 0x7fce280b5c90 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2cbff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280c6d40 con 0x7fce2815fca0 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 0x7fce280cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 0x7fce280cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33544/0 (socket says 172.21.15.71:33544) 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 -- 172.21.15.71:0/3549675586 learned_addr learned my addr 172.21.15.71:0/3549675586 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2659c700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce280b5c90 0x7fce2814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce26d9d700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce2815fca0 0x7fce280cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 -- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce2815fca0 msgr2=0x7fce280cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce2815fca0 0x7fce280cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 -- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce280b5c90 msgr2=0x7fce2814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce280b5c90 0x7fce2814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce1ffff700 1 -- 172.21.15.71:0/3549675586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce10009550 con 0x7fce280b6110 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce2659c700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce280b5c90 0x7fce2814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.526+0000 7fce26d9d700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce2815fca0 0x7fce280cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.527+0000 7fce1ffff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 0x7fce280cb390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce10009c10 tx=0x7fce10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.527+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce10004310 con 0x7fce280b6110 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.527+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1001f070 con 0x7fce280b6110 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.527+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280c7020 con 0x7fce280b6110 2023-07-06T01:09:53.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.527+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100036a0 con 0x7fce280b6110 2023-07-06T01:09:53.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.527+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2814f690 con 0x7fce280b6110 2023-07-06T01:09:53.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.528+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce280c7820 con 0x7fce280b6110 2023-07-06T01:09:53.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.529+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce10021030 con 0x7fce280b6110 2023-07-06T01:09:53.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.530+0000 7fce1effd700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fce0806ace0 0x7fce0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.530+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fce1008a780 con 0x7fce280b6110 2023-07-06T01:09:53.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.530+0000 7fce2659c700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fce0806ace0 0x7fce0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.531+0000 7fce2659c700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fce0806ace0 0x7fce0806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce18009960 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.535+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce280c7820 con 0x7fce280b6110 2023-07-06T01:09:53.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.732+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce280c7820 con 0x7fce280b6110 2023-07-06T01:09:53.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.733+0000 7fce1effd700 1 -- 172.21.15.71:0/3549675586 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7fce280c7820 con 0x7fce280b6110 2023-07-06T01:09:53.735 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:53.735 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:53.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fce0806ace0 msgr2=0x7fce0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fce0806ace0 0x7fce0806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce18009960 tx=0x7fce18008040 comp rx=0 tx=0).stop 2023-07-06T01:09:53.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 msgr2=0x7fce280cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 0x7fce280cb390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce10009c10 tx=0x7fce10004750 comp rx=0 tx=0).stop 2023-07-06T01:09:53.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 shutdown_connections 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fce0806ace0 0x7fce0806d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce2815fca0 0x7fce280cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce280b5c90 0x7fce2814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 --2- 172.21.15.71:0/3549675586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce280b6110 0x7fce280cb390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 >> 172.21.15.71:0/3549675586 conn(0x7fce2806c150 msgr2=0x7fce280d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 shutdown_connections 2023-07-06T01:09:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.735+0000 7fce2cbff700 1 -- 172.21.15.71:0/3549675586 wait complete. 2023-07-06T01:09:53.755 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T01:09:53.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:53.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.947+0000 7efd88bff700 1 Processor -- start 2023-07-06T01:09:53.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.947+0000 7efd88bff700 1 -- start start 2023-07-06T01:09:53.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd88bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b6110 0x7efd840cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd88bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840cf780 con 0x7efd840b5c90 2023-07-06T01:09:53.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd88bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840cd490 con 0x7efd8415fca0 2023-07-06T01:09:53.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd88bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840cd770 con 0x7efd840b6110 2023-07-06T01:09:53.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd81d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7efd840b5c90 0x7efd840d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41448/0 (socket says 172.21.15.71:41448) 2023-07-06T01:09:53.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd81d9b700 1 -- 172.21.15.71:0/1658902735 learned_addr learned my addr 172.21.15.71:0/1658902735 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:53.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.949+0000 7efd82d9d700 1 --2- 172.21.15.71:0/1658902735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b6110 0x7efd840cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408847822 0 0) 0x7efd840cf780 con 0x7efd840b5c90 2023-07-06T01:09:53.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd6c0035b0 con 0x7efd840b5c90 2023-07-06T01:09:53.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365876393 0 0) 0x7efd840cd490 con 0x7efd8415fca0 2023-07-06T01:09:53.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd840cf780 con 0x7efd8415fca0 2023-07-06T01:09:53.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd82d9d700 1 -- 172.21.15.71:0/1658902735 >> v1:172.21.15.194:6789/0 conn(0x7efd8415fca0 legacy=0x7efd840d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712527366 0 0) 0x7efd6c0035b0 con 0x7efd840b5c90 2023-07-06T01:09:53.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd82d9d700 1 -- 172.21.15.71:0/1658902735 >> v1:172.21.15.71:6789/0 conn(0x7efd840b5c90 legacy=0x7efd840d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd82d9d700 1 -- 172.21.15.71:0/1658902735 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840cda50 con 0x7efd840b6110 2023-07-06T01:09:53.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd82d9d700 1 --2- 172.21.15.71:0/1658902735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b6110 0x7efd840cfc10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009dc0 tx=0x7efd7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc19df5a1cc8adcc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00e070 con 0x7efd840b6110 2023-07-06T01:09:53.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c00bb20 con 0x7efd840b6110 2023-07-06T01:09:53.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.950+0000 7efd8159a700 1 -- 172.21.15.71:0/1658902735 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00bed0 con 0x7efd840b6110 2023-07-06T01:09:53.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 -- 172.21.15.71:0/1658902735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b6110 msgr2=0x7efd840cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 --2- 172.21.15.71:0/1658902735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b6110 0x7efd840cfc10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009dc0 tx=0x7efd7c00b330 comp rx=0 tx=0).stop 2023-07-06T01:09:53.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 -- 172.21.15.71:0/1658902735 shutdown_connections 2023-07-06T01:09:53.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 --2- 172.21.15.71:0/1658902735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b6110 0x7efd840cfc10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 -- 172.21.15.71:0/1658902735 >> 172.21.15.71:0/1658902735 conn(0x7efd8406c150 msgr2=0x7efd8406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:53.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 -- 172.21.15.71:0/1658902735 shutdown_connections 2023-07-06T01:09:53.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.951+0000 7efd88bff700 1 -- 172.21.15.71:0/1658902735 wait complete. 2023-07-06T01:09:53.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.953+0000 7efd88bff700 1 Processor -- start 2023-07-06T01:09:53.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.953+0000 7efd88bff700 1 -- start start 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd88bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b5c90 0x7efd840cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd88bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 0x7efd8415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd88bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd8415fca0 0x7efd8415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd88bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840ccd20 con 0x7efd840b6110 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd88bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840caee0 con 0x7efd8415fca0 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd88bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840cb1c0 con 0x7efd840b5c90 2023-07-06T01:09:53.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd81d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 0x7efd8415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd81d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 0x7efd8415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33552/0 (socket says 172.21.15.71:33552) 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd81d9b700 1 -- 172.21.15.71:0/1283348378 learned_addr learned my addr 172.21.15.71:0/1283348378 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd8259c700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b5c90 0x7efd840cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd82d9d700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd8415fca0 0x7efd8415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd81d9b700 1 -- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b5c90 msgr2=0x7efd840cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.954+0000 7efd81d9b700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b5c90 0x7efd840cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd81d9b700 1 -- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd8415fca0 msgr2=0x7efd8415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:53.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd81d9b700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd8415fca0 0x7efd8415e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:53.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd81d9b700 1 -- 172.21.15.71:0/1283348378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c009a70 con 0x7efd840b6110 2023-07-06T01:09:53.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd81d9b700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 0x7efd8415dbe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c750 tx=0x7efd7800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78005d70 con 0x7efd840b6110 2023-07-06T01:09:53.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd780070d0 con 0x7efd840b6110 2023-07-06T01:09:53.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd840cb4a0 con 0x7efd840b6110 2023-07-06T01:09:53.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78007440 con 0x7efd840b6110 2023-07-06T01:09:53.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.955+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd841472e0 con 0x7efd840b6110 2023-07-06T01:09:53.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.956+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd840008d0 con 0x7efd840b6110 2023-07-06T01:09:53.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.957+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd780075a0 con 0x7efd840b6110 2023-07-06T01:09:53.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.958+0000 7efd72ffd700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efd6406ace0 0x7efd6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:53.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.958+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efd780888a0 con 0x7efd840b6110 2023-07-06T01:09:53.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.958+0000 7efd8259c700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efd6406ace0 0x7efd6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:53.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.959+0000 7efd8259c700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efd6406ace0 0x7efd6406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd74001220 tx=0x7efd74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:53.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:53.962+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd78053920 con 0x7efd840b6110 2023-07-06T01:09:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.201+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd840cff90 con 0x7efd840b6110 2023-07-06T01:09:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.202+0000 7efd72ffd700 1 -- 172.21.15.71:0/1283348378 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7efd78056f40 con 0x7efd840b6110 2023-07-06T01:09:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:54.204 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:54.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efd6406ace0 msgr2=0x7efd6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efd6406ace0 0x7efd6406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efd74001220 tx=0x7efd74009040 comp rx=0 tx=0).stop 2023-07-06T01:09:54.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 msgr2=0x7efd8415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 0x7efd8415dbe0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c750 tx=0x7efd7800ca60 comp rx=0 tx=0).stop 2023-07-06T01:09:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 shutdown_connections 2023-07-06T01:09:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7efd6406ace0 0x7efd6406d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd8415fca0 0x7efd8415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd840b5c90 0x7efd840cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 --2- 172.21.15.71:0/1283348378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd840b6110 0x7efd8415dbe0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 >> 172.21.15.71:0/1283348378 conn(0x7efd8406c150 msgr2=0x7efd8415a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:54.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 shutdown_connections 2023-07-06T01:09:54.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.204+0000 7efd88bff700 1 -- 172.21.15.71:0/1283348378 wait complete. 2023-07-06T01:09:54.209 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:54.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:09:54.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.419+0000 7f3919fff700 1 Processor -- start 2023-07-06T01:09:54.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.419+0000 7f3919fff700 1 -- start start 2023-07-06T01:09:54.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f3919fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39140c9010 0x7f39140c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f3919fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f3914156a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f3919fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39140c9a60 con 0x7f391406c330 2023-07-06T01:09:54.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f3919fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3914159b70 con 0x7f39140c9010 2023-07-06T01:09:54.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f3919fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3914159e50 con 0x7f39141565f0 2023-07-06T01:09:54.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f3912ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39140c9010 0x7f39140c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f39137fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f391406c330 0x7f391406c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41462/0 (socket says 172.21.15.71:41462) 2023-07-06T01:09:54.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.420+0000 7f39137fe700 1 -- 172.21.15.71:0/659884992 learned_addr learned my addr 172.21.15.71:0/659884992 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:54.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f3913fff700 1 --2- 172.21.15.71:0/659884992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f3914156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f3912ffd700 1 -- 172.21.15.71:0/659884992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 msgr2=0x7f3914156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:54.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f3912ffd700 1 --2- 172.21.15.71:0/659884992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f3914156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f3912ffd700 1 -- 172.21.15.71:0/659884992 >> v1:172.21.15.71:6789/0 conn(0x7f391406c330 legacy=0x7f391406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f3912ffd700 1 -- 172.21.15.71:0/659884992 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391415a130 con 0x7f39140c9010 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f39127fc700 1 -- 172.21.15.71:0/659884992 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295372759 0 0) 0x7f39140c9a60 con 0x7f391406c330 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f3912ffd700 1 --2- 172.21.15.71:0/659884992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f39140c9480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3908009840 tx=0x7f3908009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cb4567f147f8b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f39127fc700 1 -- 172.21.15.71:0/659884992 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908011830 con 0x7f39140c9010 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f39127fc700 1 -- 172.21.15.71:0/659884992 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908011990 con 0x7f39140c9010 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.421+0000 7f39127fc700 1 -- 172.21.15.71:0/659884992 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908011d20 con 0x7f39140c9010 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 -- 172.21.15.71:0/659884992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 msgr2=0x7f39140c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 --2- 172.21.15.71:0/659884992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f39140c9480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3908009840 tx=0x7f3908009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:54.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 -- 172.21.15.71:0/659884992 shutdown_connections 2023-07-06T01:09:54.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 --2- 172.21.15.71:0/659884992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f3914156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 --2- 172.21.15.71:0/659884992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f39140c9480 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 -- 172.21.15.71:0/659884992 >> 172.21.15.71:0/659884992 conn(0x7f39140cb440 msgr2=0x7f39140cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:54.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 -- 172.21.15.71:0/659884992 shutdown_connections 2023-07-06T01:09:54.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.422+0000 7f3919fff700 1 -- 172.21.15.71:0/659884992 wait complete. 2023-07-06T01:09:54.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.424+0000 7f3919fff700 1 Processor -- start 2023-07-06T01:09:54.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.424+0000 7f3919fff700 1 -- start start 2023-07-06T01:09:54.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3919fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f391406c330 0x7f3914152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3919fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f391406f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3919fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f391406fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3919fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3914157710 con 0x7f39140c9010 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3919fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3914152ea0 con 0x7f391406c330 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3919fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3914156a90 con 0x7f39141565f0 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f391406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f391406f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33580/0 (socket says 172.21.15.71:33580) 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 -- 172.21.15.71:0/3131449899 learned_addr learned my addr 172.21.15.71:0/3131449899 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:54.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f39137fe700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f391406c330 0x7f3914152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3913fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f391406fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 -- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 msgr2=0x7f391406fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f391406fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 -- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f391406c330 msgr2=0x7f3914152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f391406c330 0x7f3914152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 -- 172.21.15.71:0/3131449899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39080094a0 con 0x7f39140c9010 2023-07-06T01:09:54.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.425+0000 7f3912ffd700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f391406f730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3908013000 tx=0x7f3908004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:54.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.426+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080038a0 con 0x7f39140c9010 2023-07-06T01:09:54.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.426+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390801f070 con 0x7f39140c9010 2023-07-06T01:09:54.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.426+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3914156d70 con 0x7f39140c9010 2023-07-06T01:09:54.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.426+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908003c40 con 0x7f39140c9010 2023-07-06T01:09:54.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.426+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3914157330 con 0x7f39140c9010 2023-07-06T01:09:54.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.427+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39140008d0 con 0x7f39140c9010 2023-07-06T01:09:54.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.428+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3908026480 con 0x7f39140c9010 2023-07-06T01:09:54.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.429+0000 7f38fbfff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f390006ad30 0x7f390006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.429+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3908021070 con 0x7f39140c9010 2023-07-06T01:09:54.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.429+0000 7f39137fe700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f390006ad30 0x7f390006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.430+0000 7f39137fe700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f390006ad30 0x7f390006d1e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3904000f60 tx=0x7f3904007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:54.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.433+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3908055f00 con 0x7f39140c9010 2023-07-06T01:09:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.675+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39140ae100 con 0x7f39140c9010 2023-07-06T01:09:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.675+0000 7f38fbfff700 1 -- 172.21.15.71:0/3131449899 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4668 (secure 0 0 0) 0x7f3908059520 con 0x7f39140c9010 2023-07-06T01:09:54.677 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:54.678 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2034391761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2034391761},{"type":"v1","addr":"172.21.15.194:6837","nonce":2034391761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/809963237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":809963237},{"type":"v1","addr":"172.21.15.71:6833","nonce":809963237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/1289751947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1289751947},{"type":"v1","addr":"172.21.15.194:6836","nonce":1289751947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:08:51.009959+0000","modified":"2023-07-06T01:08:54.558235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6835/4032291003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":4032291003},{"type":"v1","addr":"172.21.15.71:6835","nonce":4032291003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T01:09:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f390006ad30 msgr2=0x7f390006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f390006ad30 0x7f390006d1e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3904000f60 tx=0x7f3904007c90 comp rx=0 tx=0).stop 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 msgr2=0x7f391406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f391406f730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3908013000 tx=0x7f3908004750 comp rx=0 tx=0).stop 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 shutdown_connections 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f390006ad30 0x7f390006d1e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39141565f0 0x7f391406fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f391406c330 0x7f3914152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 --2- 172.21.15.71:0/3131449899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39140c9010 0x7f391406f730 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 >> 172.21.15.71:0/3131449899 conn(0x7f39140cb440 msgr2=0x7f391415c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 shutdown_connections 2023-07-06T01:09:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.678+0000 7f3919fff700 1 -- 172.21.15.71:0/3131449899 wait complete. 2023-07-06T01:09:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 8 2023-07-06T01:09:54.697 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:09:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.888+0000 7f3384dff700 1 Processor -- start 2023-07-06T01:09:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.889+0000 7f3384dff700 1 -- start start 2023-07-06T01:09:54.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f3384dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f338015fca0 0x7f33800d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f3384dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33800cf780 con 0x7f33800b6110 2023-07-06T01:09:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f3384dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33800cd490 con 0x7f33800b5c90 2023-07-06T01:09:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f3384dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33800cd770 con 0x7f338015fca0 2023-07-06T01:09:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f337e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f338015fca0 0x7f33800d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f337ed9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f33800b6110 0x7f33800cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41478/0 (socket says 172.21.15.71:41478) 2023-07-06T01:09:54.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f337e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f338015fca0 0x7f33800d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33592/0 (socket says 172.21.15.71:33592) 2023-07-06T01:09:54.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.890+0000 7f337ed9d700 1 -- 172.21.15.71:0/1885838659 learned_addr learned my addr 172.21.15.71:0/1885838659 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337e59c700 1 -- 172.21.15.71:0/1885838659 >> v1:172.21.15.194:6789/0 conn(0x7f33800b5c90 legacy=0x7f33800d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337e59c700 1 -- 172.21.15.71:0/1885838659 >> v1:172.21.15.71:6789/0 conn(0x7f33800b6110 legacy=0x7f33800cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337e59c700 1 -- 172.21.15.71:0/1885838659 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800cda50 con 0x7f338015fca0 2023-07-06T01:09:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337e59c700 1 --2- 172.21.15.71:0/1885838659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f338015fca0 0x7f33800d1420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3370009840 tx=0x7f3370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfd3d5ed79db6a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337dd9b700 1 -- 172.21.15.71:0/1885838659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370011830 con 0x7f338015fca0 2023-07-06T01:09:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337dd9b700 1 -- 172.21.15.71:0/1885838659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3370011990 con 0x7f338015fca0 2023-07-06T01:09:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.891+0000 7f337dd9b700 1 -- 172.21.15.71:0/1885838659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370011d20 con 0x7f338015fca0 2023-07-06T01:09:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 -- 172.21.15.71:0/1885838659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f338015fca0 msgr2=0x7f33800d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 --2- 172.21.15.71:0/1885838659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f338015fca0 0x7f33800d1420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3370009840 tx=0x7f3370009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 -- 172.21.15.71:0/1885838659 shutdown_connections 2023-07-06T01:09:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 --2- 172.21.15.71:0/1885838659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f338015fca0 0x7f33800d1420 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 -- 172.21.15.71:0/1885838659 >> 172.21.15.71:0/1885838659 conn(0x7f338006c150 msgr2=0x7f338006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 -- 172.21.15.71:0/1885838659 shutdown_connections 2023-07-06T01:09:54.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.892+0000 7f3384dff700 1 -- 172.21.15.71:0/1885838659 wait complete. 2023-07-06T01:09:54.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.893+0000 7f3384dff700 1 Processor -- start 2023-07-06T01:09:54.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.894+0000 7f3384dff700 1 -- start start 2023-07-06T01:09:54.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.894+0000 7f3384dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33800b5c90 0x7f338014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.894+0000 7f3384dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 0x7f33800cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3384dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f338015fca0 0x7f33800c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3384dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338015c570 con 0x7f33800b6110 2023-07-06T01:09:54.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3384dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33800cadb0 con 0x7f33800b5c90 2023-07-06T01:09:54.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3384dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33800cb090 con 0x7f338015fca0 2023-07-06T01:09:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 0x7f33800cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 0x7f33800cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33602/0 (socket says 172.21.15.71:33602) 2023-07-06T01:09:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 -- 172.21.15.71:0/2212624897 learned_addr learned my addr 172.21.15.71:0/2212624897 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f337e59c700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33800b5c90 0x7f338014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 -- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f338015fca0 msgr2=0x7f33800c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f338015fca0 0x7f33800c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 -- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33800b5c90 msgr2=0x7f338014d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33800b5c90 0x7f338014d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 -- 172.21.15.71:0/2212624897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700094a0 con 0x7f33800b6110 2023-07-06T01:09:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f337e59c700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33800b5c90 0x7f338014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:54.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.895+0000 7f3377fff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 0x7f33800cc320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f336800c4e0 tx=0x7f336800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.896+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680052d0 con 0x7f33800b6110 2023-07-06T01:09:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.896+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368005430 con 0x7f33800b6110 2023-07-06T01:09:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.896+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33800cb370 con 0x7f33800b6110 2023-07-06T01:09:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.896+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680038c0 con 0x7f33800b6110 2023-07-06T01:09:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.896+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f338014d730 con 0x7f33800b6110 2023-07-06T01:09:54.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.897+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338015c770 con 0x7f33800b6110 2023-07-06T01:09:54.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.898+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3368003a20 con 0x7f33800b6110 2023-07-06T01:09:54.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.898+0000 7f3376ffd700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f336006ace0 0x7f336006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:54.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.899+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3368088a80 con 0x7f33800b6110 2023-07-06T01:09:54.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.899+0000 7f337e59c700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f336006ace0 0x7f336006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.900+0000 7f337e59c700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f336006ace0 0x7f336006d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f33700090b0 tx=0x7f3370008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:54.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:54.903+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f338015c770 con 0x7f33800b6110 2023-07-06T01:09:55.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.097+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33800008d0 con 0x7f33800b6110 2023-07-06T01:09:55.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.098+0000 7f3376ffd700 1 -- 172.21.15.71:0/2212624897 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18351 (secure 0 0 0) 0x7f3368053a50 con 0x7f33800b6110 2023-07-06T01:09:55.100 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:09:55.100 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:32.545085+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:08:49.137166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T01:08:49.986109+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.28","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:09:55.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f336006ace0 msgr2=0x7f336006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f336006ace0 0x7f336006d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f33700090b0 tx=0x7f3370008030 comp rx=0 tx=0).stop 2023-07-06T01:09:55.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 msgr2=0x7f33800cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 0x7f33800cc320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f336800c4e0 tx=0x7f336800c8a0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 shutdown_connections 2023-07-06T01:09:55.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f336006ace0 0x7f336006d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f338015fca0 0x7f33800c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33800b5c90 0x7f338014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 --2- 172.21.15.71:0/2212624897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33800b6110 0x7f33800cc320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.100+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 >> 172.21.15.71:0/2212624897 conn(0x7f338006c150 msgr2=0x7f33800d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.101+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 shutdown_connections 2023-07-06T01:09:55.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.101+0000 7f3384dff700 1 -- 172.21.15.71:0/2212624897 wait complete. 2023-07-06T01:09:55.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T01:09:55.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.314+0000 7f895f3ff700 1 Processor -- start 2023-07-06T01:09:55.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.314+0000 7f895f3ff700 1 -- start start 2023-07-06T01:09:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.315+0000 7f895f3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 0x7f89580d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.315+0000 7f895f3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580cf780 con 0x7f89580b6100 2023-07-06T01:09:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.315+0000 7f895f3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89580cd490 con 0x7f89580b5c90 2023-07-06T01:09:55.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.315+0000 7f895f3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89580cd770 con 0x7f895815fca0 2023-07-06T01:09:55.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f895d99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f89580b6100 0x7f89580cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41490/0 (socket says 172.21.15.71:41490) 2023-07-06T01:09:55.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f895d99c700 1 -- 172.21.15.71:0/4057078522 learned_addr learned my addr 172.21.15.71:0/4057078522 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:55.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f895d19b700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 0x7f89580d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006962573 0 0) 0x7f89580cf780 con 0x7f89580b6100 2023-07-06T01:09:55.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89440035b0 con 0x7f89580b6100 2023-07-06T01:09:55.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167135206 0 0) 0x7f89580cd490 con 0x7f89580b5c90 2023-07-06T01:09:55.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89580cf780 con 0x7f89580b5c90 2023-07-06T01:09:55.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2554433760 0 0) 0x7f89440035b0 con 0x7f89580b6100 2023-07-06T01:09:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 msgr2=0x7f89580d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 0x7f89580d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 >> v1:172.21.15.194:6789/0 conn(0x7f89580b5c90 legacy=0x7f89580d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89580cda50 con 0x7f89580b6100 2023-07-06T01:09:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f89500019f0 con 0x7f89580b6100 2023-07-06T01:09:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 >> v1:172.21.15.71:6789/0 conn(0x7f89580b6100 legacy=0x7f89580cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.316+0000 7f894ffff700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 0x7f8944003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f894ffff700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8944004170 0x7f8944004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f894ffff700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8944004d90 0x7f8944005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89580cd770 con 0x7f8944004d90 2023-07-06T01:09:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894400bb20 con 0x7f8944004170 2023-07-06T01:09:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894400bce0 con 0x7f895815fca0 2023-07-06T01:09:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8944004d90 0x7f8944005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895c99a700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8944004170 0x7f8944004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d19b700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 0x7f8944003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 -- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 msgr2=0x7f8944003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:55.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f895815fca0 0x7f8944003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 -- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8944004170 msgr2=0x7f8944004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8944004170 0x7f8944004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 -- 172.21.15.71:0/4057078522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440035b0 con 0x7f8944004d90 2023-07-06T01:09:55.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.317+0000 7f895d99c700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8944004d90 0x7f8944005200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f895000a6e0 tx=0x7f8944005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5427b61ca5e4bfb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:55.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500072d0 con 0x7f8944004d90 2023-07-06T01:09:55.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950007430 con 0x7f8944004d90 2023-07-06T01:09:55.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f894ffff700 1 -- 172.21.15.71:0/4057078522 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500077e0 con 0x7f8944004d90 2023-07-06T01:09:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895f3ff700 1 -- 172.21.15.71:0/4057078522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8944004d90 msgr2=0x7f8944005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895f3ff700 1 --2- 172.21.15.71:0/4057078522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8944004d90 0x7f8944005200 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f895000a6e0 tx=0x7f8944005880 comp rx=0 tx=0).stop 2023-07-06T01:09:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895d99c700 1 -- 172.21.15.71:0/4057078522 reap_dead start 2023-07-06T01:09:55.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895f3ff700 1 -- 172.21.15.71:0/4057078522 shutdown_connections 2023-07-06T01:09:55.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895f3ff700 1 -- 172.21.15.71:0/4057078522 >> 172.21.15.71:0/4057078522 conn(0x7f895806c150 msgr2=0x7f895806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:55.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895f3ff700 1 -- 172.21.15.71:0/4057078522 shutdown_connections 2023-07-06T01:09:55.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.318+0000 7f895f3ff700 1 -- 172.21.15.71:0/4057078522 wait complete. 2023-07-06T01:09:55.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.320+0000 7f895f3ff700 1 Processor -- start 2023-07-06T01:09:55.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.320+0000 7f895f3ff700 1 -- start start 2023-07-06T01:09:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895f3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8944004d90 0x7f89581f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895f3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89581f1970 0x7f895815e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895f3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 0x7f895815d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895f3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895815f0a0 con 0x7f895815ec00 2023-07-06T01:09:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895f3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895815e4d0 con 0x7f89581f1970 2023-07-06T01:09:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895f3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8958158da0 con 0x7f8944004d90 2023-07-06T01:09:55.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.321+0000 7f895d99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 0x7f895815d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 0x7f895815d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33618/0 (socket says 172.21.15.71:33618) 2023-07-06T01:09:55.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 -- 172.21.15.71:0/3739878485 learned_addr learned my addr 172.21.15.71:0/3739878485 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:55.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d19b700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8944004d90 0x7f89581f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895c99a700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89581f1970 0x7f895815e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 -- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8944004d90 msgr2=0x7f89581f1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8944004d90 0x7f89581f1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 -- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89581f1970 msgr2=0x7f895815e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89581f1970 0x7f895815e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 -- 172.21.15.71:0/3739878485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958158470 con 0x7f895815ec00 2023-07-06T01:09:55.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895d99c700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 0x7f895815d780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8950002230 tx=0x7f8950001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950025070 con 0x7f895815ec00 2023-07-06T01:09:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950001960 con 0x7f895815ec00 2023-07-06T01:09:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8958158750 con 0x7f895815ec00 2023-07-06T01:09:55.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.322+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500079d0 con 0x7f895815ec00 2023-07-06T01:09:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.323+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895815dcc0 con 0x7f895815ec00 2023-07-06T01:09:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.323+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89580b2730 con 0x7f895815ec00 2023-07-06T01:09:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.324+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f895001a070 con 0x7f895815ec00 2023-07-06T01:09:55.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.325+0000 7f894dffb700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f893c06ad10 0x7f893c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.326+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f895008aa90 con 0x7f895815ec00 2023-07-06T01:09:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.326+0000 7f895d19b700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f893c06ad10 0x7f893c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.326+0000 7f895d19b700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f893c06ad10 0x7f893c06d1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8954009c60 tx=0x7f8954009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:55.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.329+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8950055af0 con 0x7f895815ec00 2023-07-06T01:09:55.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.570+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89580d27c0 con 0x7f895815ec00 2023-07-06T01:09:55.572 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-07-06T01:09:55.571+0000 7f38d51f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T01:09:55.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.575+0000 7f894dffb700 1 -- 172.21.15.71:0/3739878485 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8950018090 con 0x7f895815ec00 2023-07-06T01:09:55.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f893c06ad10 msgr2=0x7f893c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f893c06ad10 0x7f893c06d1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8954009c60 tx=0x7f8954009210 comp rx=0 tx=0).stop 2023-07-06T01:09:55.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 msgr2=0x7f895815d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 0x7f895815d780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8950002230 tx=0x7f8950001cb0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 shutdown_connections 2023-07-06T01:09:55.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f893c06ad10 0x7f893c06d1c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f895815ec00 0x7f895815d780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8944004d90 0x7f89581f1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 --2- 172.21.15.71:0/3739878485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89581f1970 0x7f895815e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 >> 172.21.15.71:0/3739878485 conn(0x7f895806c150 msgr2=0x7f89580b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:55.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 shutdown_connections 2023-07-06T01:09:55.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.578+0000 7f895f3ff700 1 -- 172.21.15.71:0/3739878485 wait complete. 2023-07-06T01:09:55.582 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T01:09:55.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T01:09:55.648 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-07-06T01:09:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.799+0000 7f3132bff700 1 Processor -- start 2023-07-06T01:09:55.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.799+0000 7f3132bff700 1 -- start start 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f3132bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f312c06c330 0x7f312c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f3132bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f312c0c9010 0x7f312c0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f3132bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c06cc40 con 0x7f312c1565f0 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f3132bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0c9a60 con 0x7f312c0c9010 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f3132bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c159b70 con 0x7f312c06c330 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f312bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f312c0c9010 0x7f312c0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f313119c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f312c1565f0 0x7f312c156a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41510/0 (socket says 172.21.15.71:41510) 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f313119c700 1 -- 172.21.15.71:0/2430547918 learned_addr learned my addr 172.21.15.71:0/2430547918 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f313099b700 1 --2- 172.21.15.71:0/2430547918 >> v2:172.21.15.194:3300/0 conn(0x7f312c06c330 0x7f312c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f312b7fe700 1 -- 172.21.15.71:0/2430547918 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46411920 0 0) 0x7f312c06cc40 con 0x7f312c1565f0 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f312bfff700 1 -- 172.21.15.71:0/2430547918 >> v2:172.21.15.194:3300/0 conn(0x7f312c06c330 msgr2=0x7f312c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f312bfff700 1 --2- 172.21.15.71:0/2430547918 >> v2:172.21.15.194:3300/0 conn(0x7f312c06c330 0x7f312c06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f312bfff700 1 -- 172.21.15.71:0/2430547918 >> v1:172.21.15.71:6789/0 conn(0x7f312c1565f0 legacy=0x7f312c156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.801+0000 7f312bfff700 1 -- 172.21.15.71:0/2430547918 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c159e50 con 0x7f312c0c9010 2023-07-06T01:09:55.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f312bfff700 1 --2- 172.21.15.71:0/2430547918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c0c9010 0x7f312c0c9480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f312c06f160 tx=0x7f3118009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc78e2c0570f10c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f312b7fe700 1 -- 172.21.15.71:0/2430547918 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118011830 con 0x7f312c0c9010 2023-07-06T01:09:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f312b7fe700 1 -- 172.21.15.71:0/2430547918 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3118011990 con 0x7f312c0c9010 2023-07-06T01:09:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f312b7fe700 1 -- 172.21.15.71:0/2430547918 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118011d20 con 0x7f312c0c9010 2023-07-06T01:09:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f3132bff700 1 -- 172.21.15.71:0/2430547918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c0c9010 msgr2=0x7f312c0c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f3132bff700 1 --2- 172.21.15.71:0/2430547918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c0c9010 0x7f312c0c9480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f312c06f160 tx=0x7f3118009b20 comp rx=0 tx=0).stop 2023-07-06T01:09:55.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.802+0000 7f3132bff700 1 -- 172.21.15.71:0/2430547918 shutdown_connections 2023-07-06T01:09:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.803+0000 7f3132bff700 1 --2- 172.21.15.71:0/2430547918 >> v2:172.21.15.194:3300/0 conn(0x7f312c06c330 0x7f312c06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.803+0000 7f3132bff700 1 --2- 172.21.15.71:0/2430547918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c0c9010 0x7f312c0c9480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.803+0000 7f3132bff700 1 -- 172.21.15.71:0/2430547918 >> 172.21.15.71:0/2430547918 conn(0x7f312c0cb440 msgr2=0x7f312c0cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.803+0000 7f3132bff700 1 -- 172.21.15.71:0/2430547918 shutdown_connections 2023-07-06T01:09:55.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.803+0000 7f3132bff700 1 -- 172.21.15.71:0/2430547918 wait complete. 2023-07-06T01:09:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.805+0000 7f3132bff700 1 Processor -- start 2023-07-06T01:09:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.805+0000 7f3132bff700 1 -- start start 2023-07-06T01:09:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.806+0000 7f3132bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06c330 0x7f312c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.806+0000 7f3132bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c0c9010 0x7f312c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.806+0000 7f3132bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 0x7f312c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.806+0000 7f3132bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0b2200 con 0x7f312c1565f0 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.806+0000 7f3132bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0b2d80 con 0x7f312c06c330 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.806+0000 7f3132bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0b2450 con 0x7f312c0c9010 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 0x7f312c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 0x7f312c0b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33658/0 (socket says 172.21.15.71:33658) 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 -- 172.21.15.71:0/2533271702 learned_addr learned my addr 172.21.15.71:0/2533271702 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:55.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313099b700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06c330 0x7f312c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f312bfff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c0c9010 0x7f312c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 -- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c0c9010 msgr2=0x7f312c0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c0c9010 0x7f312c0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 -- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06c330 msgr2=0x7f312c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06c330 0x7f312c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 -- 172.21.15.71:0/2533271702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180094a0 con 0x7f312c1565f0 2023-07-06T01:09:55.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f312bfff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c0c9010 0x7f312c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.807+0000 7f313119c700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 0x7f312c0b04f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f312400cc70 tx=0x7f312400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.808+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400ab70 con 0x7f312c1565f0 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.808+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400acf0 con 0x7f312c1565f0 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.808+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124007310 con 0x7f312c1565f0 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.808+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c0b2730 con 0x7f312c1565f0 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.808+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c1562e0 con 0x7f312c1565f0 2023-07-06T01:09:55.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.809+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c0008d0 con 0x7f312c1565f0 2023-07-06T01:09:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.810+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3124007470 con 0x7f312c1565f0 2023-07-06T01:09:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.811+0000 7f31297fa700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f311006ace0 0x7f311006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:55.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.811+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f3124088ff0 con 0x7f312c1565f0 2023-07-06T01:09:55.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.811+0000 7f313099b700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f311006ace0 0x7f311006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:55.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.812+0000 7f313099b700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f311006ace0 0x7f311006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3120006b20 tx=0x7f3120008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:55.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:55.814+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3124054000 con 0x7f312c1565f0 2023-07-06T01:09:56.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.053+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f312c0b2ec0 con 0x7f312c1565f0 2023-07-06T01:09:56.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.655+0000 7f31297fa700 1 -- 172.21.15.71:0/2533271702 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f312400ae60 con 0x7f312c1565f0 2023-07-06T01:09:56.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f311006ace0 msgr2=0x7f311006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:56.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f311006ace0 0x7f311006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3120006b20 tx=0x7f3120008040 comp rx=0 tx=0).stop 2023-07-06T01:09:56.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 msgr2=0x7f312c0b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 0x7f312c0b04f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f312400cc70 tx=0x7f312400cf80 comp rx=0 tx=0).stop 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 shutdown_connections 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f311006ace0 0x7f311006d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f312c1565f0 0x7f312c0b04f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06c330 0x7f312c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 --2- 172.21.15.71:0/2533271702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c0c9010 0x7f312c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 >> 172.21.15.71:0/2533271702 conn(0x7f312c0cb440 msgr2=0x7f312c0c9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:56.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 shutdown_connections 2023-07-06T01:09:56.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.658+0000 7f3132bff700 1 -- 172.21.15.71:0/2533271702 wait complete. 2023-07-06T01:09:56.680 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T01:09:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.878+0000 7f4cf0bff700 1 Processor -- start 2023-07-06T01:09:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.878+0000 7f4cf0bff700 1 -- start start 2023-07-06T01:09:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cf0bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4cec0b8440 0x7f4cec0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:56.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cf0bff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4cec0b2180 0x7f4cec0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cf0bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec160cc0 con 0x7f4cec0b1c30 2023-07-06T01:09:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cf0bff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec160ae0 con 0x7f4cec0b2180 2023-07-06T01:09:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cf0bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec160f80 con 0x7f4cec0b8440 2023-07-06T01:09:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4ce3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4cec0b2180 0x7f4cec0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cead9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4cec0b1c30 0x7f4cec0d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41520/0 (socket says 172.21.15.71:41520) 2023-07-06T01:09:56.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cead9d700 1 -- 172.21.15.71:0/2777370000 learned_addr learned my addr 172.21.15.71:0/2777370000 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:56.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4cea59c700 1 --2- 172.21.15.71:0/2777370000 >> v2:172.21.15.194:3300/0 conn(0x7f4cec0b8440 0x7f4cec0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:56.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4ce3fff700 1 -- 172.21.15.71:0/2777370000 >> v2:172.21.15.194:3300/0 conn(0x7f4cec0b8440 msgr2=0x7f4cec0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:56.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4ce3fff700 1 --2- 172.21.15.71:0/2777370000 >> v2:172.21.15.194:3300/0 conn(0x7f4cec0b8440 0x7f4cec0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4ce3fff700 1 -- 172.21.15.71:0/2777370000 >> v1:172.21.15.71:6789/0 conn(0x7f4cec0b1c30 legacy=0x7f4cec0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:56.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4ce3fff700 1 -- 172.21.15.71:0/2777370000 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0cf0e0 con 0x7f4cec0b2180 2023-07-06T01:09:56.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.880+0000 7f4ce9d9b700 1 -- 172.21.15.71:0/2777370000 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684769 0 0) 0x7f4cec160cc0 con 0x7f4cec0b1c30 2023-07-06T01:09:56.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4ce3fff700 1 --2- 172.21.15.71:0/2777370000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b2180 0x7f4cec0cf730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0d3e30 tx=0x7f4cd4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ea41ab0d51d075 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:56.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4ce9d9b700 1 -- 172.21.15.71:0/2777370000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011830 con 0x7f4cec0b2180 2023-07-06T01:09:56.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4ce9d9b700 1 -- 172.21.15.71:0/2777370000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4011990 con 0x7f4cec0b2180 2023-07-06T01:09:56.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4ce9d9b700 1 -- 172.21.15.71:0/2777370000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4011d20 con 0x7f4cec0b2180 2023-07-06T01:09:56.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4cf0bff700 1 -- 172.21.15.71:0/2777370000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b2180 msgr2=0x7f4cec0cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/2777370000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b2180 0x7f4cec0cf730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0d3e30 tx=0x7f4cd4009b20 comp rx=0 tx=0).stop 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4cf0bff700 1 -- 172.21.15.71:0/2777370000 shutdown_connections 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/2777370000 >> v2:172.21.15.194:3300/0 conn(0x7f4cec0b8440 0x7f4cec0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.881+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/2777370000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b2180 0x7f4cec0cf730 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.882+0000 7f4cf0bff700 1 -- 172.21.15.71:0/2777370000 >> 172.21.15.71:0/2777370000 conn(0x7f4cec06be10 msgr2=0x7f4cec071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.882+0000 7f4cf0bff700 1 -- 172.21.15.71:0/2777370000 shutdown_connections 2023-07-06T01:09:56.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.882+0000 7f4cf0bff700 1 -- 172.21.15.71:0/2777370000 wait complete. 2023-07-06T01:09:56.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.883+0000 7f4cf0bff700 1 Processor -- start 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.883+0000 7f4cf0bff700 1 -- start start 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.884+0000 7f4cf0bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 0x7f4cec151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.884+0000 7f4cf0bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec0b2180 0x7f4cec15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.884+0000 7f4cf0bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cec0b8440 0x7f4cec15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.884+0000 7f4cf0bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec152430 con 0x7f4cec0b1c30 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.884+0000 7f4cf0bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec15f0c0 con 0x7f4cec0b2180 2023-07-06T01:09:56.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.884+0000 7f4cf0bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec15d800 con 0x7f4cec0b8440 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 0x7f4cec151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 0x7f4cec151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33678/0 (socket says 172.21.15.71:33678) 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 -- 172.21.15.71:0/3088088934 learned_addr learned my addr 172.21.15.71:0/3088088934 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 -- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cec0b8440 msgr2=0x7f4cec15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cec0b8440 0x7f4cec15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 -- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec0b2180 msgr2=0x7f4cec15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:56.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4ce3fff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec0b2180 0x7f4cec15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec0b2180 0x7f4cec15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 -- 172.21.15.71:0/3088088934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40094a0 con 0x7f4cec0b1c30 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4ce3fff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec0b2180 0x7f4cec15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4cea59c700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 0x7f4cec151ef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00e810 tx=0x7f4cdc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc013610 con 0x7f4cec0b1c30 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.885+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc013770 con 0x7f4cec0b1c30 2023-07-06T01:09:56.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.886+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc013b20 con 0x7f4cec0b1c30 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.886+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec15dae0 con 0x7f4cec0b1c30 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.886+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec15e0a0 con 0x7f4cec0b1c30 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.887+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec0008d0 con 0x7f4cec0b1c30 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.888+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cdc013c80 con 0x7f4cec0b1c30 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.888+0000 7f4ce2ffd700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ccc06ace0 0x7f4ccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.889+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f4cdc089280 con 0x7f4cec0b1c30 2023-07-06T01:09:56.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.889+0000 7f4ce3fff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ccc06ace0 0x7f4ccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:56.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.890+0000 7f4ce3fff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ccc06ace0 0x7f4ccc06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0d3e30 tx=0x7f4cd4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:56.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:56.894+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4cdc054210 con 0x7f4cec0b1c30 2023-07-06T01:09:57.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.087+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4cec0c6210 con 0x7f4cec0b1c30 2023-07-06T01:09:57.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.669+0000 7f4ce2ffd700 1 -- 172.21.15.71:0/3088088934 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4cdc057830 con 0x7f4cec0b1c30 2023-07-06T01:09:57.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ccc06ace0 msgr2=0x7f4ccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ccc06ace0 0x7f4ccc06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0d3e30 tx=0x7f4cd4008030 comp rx=0 tx=0).stop 2023-07-06T01:09:57.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 msgr2=0x7f4cec151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 0x7f4cec151ef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00e810 tx=0x7f4cdc00ebd0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 shutdown_connections 2023-07-06T01:09:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ccc06ace0 0x7f4ccc06d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cec0b8440 0x7f4cec15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4cec0b1c30 0x7f4cec151ef0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 --2- 172.21.15.71:0/3088088934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cec0b2180 0x7f4cec15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 >> 172.21.15.71:0/3088088934 conn(0x7f4cec06be10 msgr2=0x7f4cec0cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:57.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 shutdown_connections 2023-07-06T01:09:57.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.674+0000 7f4cf0bff700 1 -- 172.21.15.71:0/3088088934 wait complete. 2023-07-06T01:09:57.681 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-07-06T01:09:57.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T01:09:57.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.900+0000 7f8f9f9ff700 1 Processor -- start 2023-07-06T01:09:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.900+0000 7f8f9f9ff700 1 -- start start 2023-07-06T01:09:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9f9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8f9806b410 0x7f8f9806a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9f9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f9806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9f9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f980cab30 con 0x7f8f9815c830 2023-07-06T01:09:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9f9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9806cb30 con 0x7f8f9806b410 2023-07-06T01:09:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9f9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980ce450 con 0x7f8f9806c170 2023-07-06T01:09:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9df9c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f9806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9cf9a700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8f9806b410 0x7f8f9806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9df9c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f9806c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:56900/0 (socket says 172.21.15.71:56900) 2023-07-06T01:09:57.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.901+0000 7f8f9df9c700 1 -- 172.21.15.71:0/2882598465 learned_addr learned my addr 172.21.15.71:0/2882598465 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f9cf9a700 1 -- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 msgr2=0x7f8f9806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f9cf9a700 1 --2- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f9806c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f9cf9a700 1 -- 172.21.15.71:0/2882598465 >> v1:172.21.15.194:6789/0 conn(0x7f8f9815c830 legacy=0x7f8f980700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f9cf9a700 1 -- 172.21.15.71:0/2882598465 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f980ce710 con 0x7f8f9806b410 2023-07-06T01:09:57.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f9df9c700 1 --2- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f9806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f9cf9a700 1 --2- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9806b410 0x7f8f9806a940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009870 tx=0x7f8f88009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea1cdeef7270c202 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f8ffff700 1 -- 172.21.15.71:0/2882598465 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88011830 con 0x7f8f9806b410 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f8ffff700 1 -- 172.21.15.71:0/2882598465 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f88011990 con 0x7f8f9806b410 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.902+0000 7f8f8ffff700 1 -- 172.21.15.71:0/2882598465 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88011d20 con 0x7f8f9806b410 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9806b410 msgr2=0x7f8f9806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9806b410 0x7f8f9806a940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009870 tx=0x7f8f88009b80 comp rx=0 tx=0).stop 2023-07-06T01:09:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/2882598465 shutdown_connections 2023-07-06T01:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f9806c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/2882598465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9806b410 0x7f8f9806a940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/2882598465 >> 172.21.15.71:0/2882598465 conn(0x7f8f980cf330 msgr2=0x7f8f980cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/2882598465 shutdown_connections 2023-07-06T01:09:57.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.903+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/2882598465 wait complete. 2023-07-06T01:09:57.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.905+0000 7f8f9f9ff700 1 Processor -- start 2023-07-06T01:09:57.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.905+0000 7f8f9f9ff700 1 -- start start 2023-07-06T01:09:57.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9f9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 0x7f8f980c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:57.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9f9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f98152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:57.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9f9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9815c830 0x7f8f980c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:57.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9f9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980c70c0 con 0x7f8f9806b410 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9f9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980b3020 con 0x7f8f9815c830 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9f9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f980b3300 con 0x7f8f9806c170 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9d79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 0x7f8f980c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9d79b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 0x7f8f980c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33684/0 (socket says 172.21.15.71:33684) 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9d79b700 1 -- 172.21.15.71:0/1751376128 learned_addr learned my addr 172.21.15.71:0/1751376128 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9df9c700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9815c830 0x7f8f980c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:57.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.906+0000 7f8f9cf9a700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f98152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9d79b700 1 -- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 msgr2=0x7f8f98152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9d79b700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f98152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9d79b700 1 -- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9815c830 msgr2=0x7f8f980c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9d79b700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9815c830 0x7f8f980c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9d79b700 1 -- 172.21.15.71:0/1751376128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90009b30 con 0x7f8f9806b410 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9cf9a700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f98152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:57.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9d79b700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 0x7f8f980c2b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400c450 tx=0x7f8f9400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940052d0 con 0x7f8f9806b410 2023-07-06T01:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f94005430 con 0x7f8f9806b410 2023-07-06T01:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880094a0 con 0x7f8f9806b410 2023-07-06T01:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940038c0 con 0x7f8f9806b410 2023-07-06T01:09:57.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.907+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f980c73a0 con 0x7f8f9806b410 2023-07-06T01:09:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.908+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f980b2e80 con 0x7f8f9806b410 2023-07-06T01:09:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.909+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f94003a20 con 0x7f8f9806b410 2023-07-06T01:09:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.910+0000 7f8f8dffb700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f7c06ace0 0x7f8f7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.910+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f8f94088740 con 0x7f8f9806b410 2023-07-06T01:09:57.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.911+0000 7f8f9cf9a700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f7c06ace0 0x7f8f7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:57.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.911+0000 7f8f9cf9a700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f7c06ace0 0x7f8f7c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f880090b0 tx=0x7f8f88008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:57.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:57.914+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f980b2e80 con 0x7f8f9806b410 2023-07-06T01:09:58.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.111+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f980b2e80 con 0x7f8f9806b410 2023-07-06T01:09:58.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.671+0000 7f8f8dffb700 1 -- 172.21.15.71:0/1751376128 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8f980b2e80 con 0x7f8f9806b410 2023-07-06T01:09:58.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f7c06ace0 msgr2=0x7f8f7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:58.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f7c06ace0 0x7f8f7c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8f880090b0 tx=0x7f8f88008030 comp rx=0 tx=0).stop 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 msgr2=0x7f8f980c2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 0x7f8f980c2b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400c450 tx=0x7f8f9400c760 comp rx=0 tx=0).stop 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 shutdown_connections 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8f7c06ace0 0x7f8f7c06d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f9815c830 0x7f8f980c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f9806b410 0x7f8f980c2b30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 --2- 172.21.15.71:0/1751376128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f9806c170 0x7f8f98152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.675+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 >> 172.21.15.71:0/1751376128 conn(0x7f8f980cf330 msgr2=0x7f8f98071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:58.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.676+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 shutdown_connections 2023-07-06T01:09:58.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.676+0000 7f8f9f9ff700 1 -- 172.21.15.71:0/1751376128 wait complete. 2023-07-06T01:09:58.681 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-07-06T01:09:58.700 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T01:09:58.700 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T01:09:58.700 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T01:09:58.701 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:09:58.701 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T01:09:58.701 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T01:09:58.701 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T01:09:58.701 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:09:58.702 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T01:09:58.702 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T01:09:58.703 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T01:09:58.703 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:09:58.703 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T01:09:58.703 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T01:09:58.704 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T01:09:58.704 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:09:58.716 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T01:09:58.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T01:09:58.717 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T01:09:58.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T01:09:58.719 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T01:09:58.719 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T01:09:58.720 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T01:09:58.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T01:09:58.761 INFO:tasks.ceph.mds.c:Started 2023-07-06T01:09:58.761 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:58.763 INFO:tasks.ceph.mds.a:Started 2023-07-06T01:09:58.764 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:58.764 INFO:tasks.ceph.mds.b:Started 2023-07-06T01:09:58.765 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:58.768 INFO:tasks.ceph.mds.d:Started 2023-07-06T01:09:58.768 DEBUG:teuthology.parallel:result is None 2023-07-06T01:09:58.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T01:09:58.915 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2023-07-06T01:09:58.916 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2023-07-06T01:09:58.917 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-07-06T01:09:58.917 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-07-06T01:09:58.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.976+0000 7fbde8dff700 1 Processor -- start 2023-07-06T01:09:58.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.976+0000 7fbde8dff700 1 -- start start 2023-07-06T01:09:58.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.977+0000 7fbde8dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde4160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:58.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.977+0000 7fbde8dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbde40ae4c0 0x7fbde415d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:58.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.977+0000 7fbde8dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde41601f0 con 0x7fbde415cbf0 2023-07-06T01:09:58.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.977+0000 7fbde8dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde41607b0 con 0x7fbde40ae4c0 2023-07-06T01:09:58.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.977+0000 7fbde8dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde415d670 con 0x7fbde415c820 2023-07-06T01:09:58.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.977+0000 7fbde1d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbde415cbf0 0x7fbde40addb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41550/0 (socket says 172.21.15.71:41550) 2023-07-06T01:09:58.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde1d9b700 1 -- 172.21.15.71:0/2681451956 learned_addr learned my addr 172.21.15.71:0/2681451956 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:09:58.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde259c700 1 --2- 172.21.15.71:0/2681451956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde4160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:58.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde2d9d700 1 --2- 172.21.15.71:0/2681451956 >> v2:172.21.15.194:3300/0 conn(0x7fbde40ae4c0 0x7fbde415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:58.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde159a700 1 -- 172.21.15.71:0/2681451956 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629505593 0 0) 0x7fbde41601f0 con 0x7fbde415cbf0 2023-07-06T01:09:58.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde159a700 1 -- 172.21.15.71:0/2681451956 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdcc0035b0 con 0x7fbde415cbf0 2023-07-06T01:09:58.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde259c700 1 -- 172.21.15.71:0/2681451956 >> v2:172.21.15.194:3300/0 conn(0x7fbde40ae4c0 msgr2=0x7fbde415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:58.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde259c700 1 --2- 172.21.15.71:0/2681451956 >> v2:172.21.15.194:3300/0 conn(0x7fbde40ae4c0 0x7fbde415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde259c700 1 -- 172.21.15.71:0/2681451956 >> v1:172.21.15.71:6789/0 conn(0x7fbde415cbf0 legacy=0x7fbde40addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde259c700 1 -- 172.21.15.71:0/2681451956 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde415d950 con 0x7fbde415c820 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.978+0000 7fbde259c700 1 --2- 172.21.15.71:0/2681451956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde4160c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009840 tx=0x7fbdd4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ff05cfc1b123408 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde159a700 1 -- 172.21.15.71:0/2681451956 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4011830 con 0x7fbde415c820 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde159a700 1 -- 172.21.15.71:0/2681451956 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd4011990 con 0x7fbde415c820 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde159a700 1 -- 172.21.15.71:0/2681451956 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4011d20 con 0x7fbde415c820 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 -- 172.21.15.71:0/2681451956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 msgr2=0x7fbde4160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:58.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 --2- 172.21.15.71:0/2681451956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde4160c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009840 tx=0x7fbdd4009b50 comp rx=0 tx=0).stop 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 -- 172.21.15.71:0/2681451956 shutdown_connections 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 --2- 172.21.15.71:0/2681451956 >> v2:172.21.15.194:3300/0 conn(0x7fbde40ae4c0 0x7fbde415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 --2- 172.21.15.71:0/2681451956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde4160c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 -- 172.21.15.71:0/2681451956 >> 172.21.15.71:0/2681451956 conn(0x7fbde40cfbe0 msgr2=0x7fbde40b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 -- 172.21.15.71:0/2681451956 shutdown_connections 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.979+0000 7fbde8dff700 1 -- 172.21.15.71:0/2681451956 wait complete. 2023-07-06T01:09:58.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.981+0000 7fbde8dff700 1 Processor -- start 2023-07-06T01:09:58.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.981+0000 7fbde8dff700 1 -- start start 2023-07-06T01:09:58.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde8dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 0x7fbde40c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:58.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde8dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde40c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:58.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde8dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde415cbf0 0x7fbde40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:58.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde8dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40c5910 con 0x7fbde40ae4c0 2023-07-06T01:09:58.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde8dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde415e1d0 con 0x7fbde415cbf0 2023-07-06T01:09:58.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde8dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40c3630 con 0x7fbde415c820 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 0x7fbde40c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 0x7fbde40c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33734/0 (socket says 172.21.15.71:33734) 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde259c700 1 -- 172.21.15.71:0/1257153150 learned_addr learned my addr 172.21.15.71:0/1257153150 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde1d9b700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde40c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde2d9d700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde415cbf0 0x7fbde40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.982+0000 7fbde259c700 1 -- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 msgr2=0x7fbde40c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:58.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde259c700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde40c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde259c700 1 -- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde415cbf0 msgr2=0x7fbde40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde259c700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde415cbf0 0x7fbde40ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde259c700 1 -- 172.21.15.71:0/1257153150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40094a0 con 0x7fbde40ae4c0 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde259c700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 0x7fbde40c30f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4000c00 tx=0x7fbdd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40036a0 con 0x7fbde40ae4c0 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd401f070 con 0x7fbde40ae4c0 2023-07-06T01:09:58.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4003a40 con 0x7fbde40ae4c0 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde40c5350 con 0x7fbde40ae4c0 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.983+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde415de60 con 0x7fbde40ae4c0 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.984+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde4068270 con 0x7fbde40ae4c0 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.985+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdd4003ba0 con 0x7fbde40ae4c0 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.986+0000 7fbdd2ffd700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbdc406ace0 0x7fbdc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.986+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbdd4021070 con 0x7fbde40ae4c0 2023-07-06T01:09:58.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.987+0000 7fbde1d9b700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbdc406ace0 0x7fbdc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.987+0000 7fbde1d9b700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbdc406ace0 0x7fbdc406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbde4158770 tx=0x7fbdd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:58.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:58.990+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbdd4056160 con 0x7fbde40ae4c0 2023-07-06T01:09:59.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.202+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbde40008d0 con 0x7fbde40ae4c0 2023-07-06T01:09:59.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.689+0000 7fbdd2ffd700 1 -- 172.21.15.71:0/1257153150 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbdd4059780 con 0x7fbde40ae4c0 2023-07-06T01:09:59.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbdc406ace0 msgr2=0x7fbdc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:59.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbdc406ace0 0x7fbdc406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbde4158770 tx=0x7fbdd8009040 comp rx=0 tx=0).stop 2023-07-06T01:09:59.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 msgr2=0x7fbde40c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:59.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 0x7fbde40c30f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4000c00 tx=0x7fbdd4004750 comp rx=0 tx=0).stop 2023-07-06T01:09:59.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 shutdown_connections 2023-07-06T01:09:59.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbdc406ace0 0x7fbdc406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbde415cbf0 0x7fbde40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde40ae4c0 0x7fbde40c30f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 --2- 172.21.15.71:0/1257153150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbde415c820 0x7fbde40c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.692+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 >> 172.21.15.71:0/1257153150 conn(0x7fbde40cfbe0 msgr2=0x7fbde40ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:59.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.693+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 shutdown_connections 2023-07-06T01:09:59.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.693+0000 7fbde8dff700 1 -- 172.21.15.71:0/1257153150 wait complete. 2023-07-06T01:09:59.697 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-07-06T01:09:59.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T01:09:59.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.907+0000 7fa3f7dff700 1 Processor -- start 2023-07-06T01:09:59.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.908+0000 7fa3f7dff700 1 -- start start 2023-07-06T01:09:59.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f7dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3f015fca0 0x7fa3f00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:59.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f7dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:59.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f7dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00cf780 con 0x7fa3f00b60e0 2023-07-06T01:09:59.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f7dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00cd490 con 0x7fa3f015fca0 2023-07-06T01:09:59.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f7dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00cd770 con 0x7fa3f00b5c90 2023-07-06T01:09:59.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f5b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3f015fca0 0x7fa3f00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:59.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f5b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa3f015fca0 0x7fa3f00d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33742/0 (socket says 172.21.15.71:33742) 2023-07-06T01:09:59.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f639c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa3f00b60e0 0x7fa3f00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41554/0 (socket says 172.21.15.71:41554) 2023-07-06T01:09:59.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f5b9b700 1 -- 172.21.15.71:0/1769646686 learned_addr learned my addr 172.21.15.71:0/1769646686 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:59.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f539a700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:59.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f5b9b700 1 -- 172.21.15.71:0/1769646686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 msgr2=0x7fa3f00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:09:59.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f5b9b700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f00d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.909+0000 7fa3f5b9b700 1 -- 172.21.15.71:0/1769646686 >> v1:172.21.15.71:6789/0 conn(0x7fa3f00b60e0 legacy=0x7fa3f00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:59.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f5b9b700 1 -- 172.21.15.71:0/1769646686 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00cda50 con 0x7fa3f015fca0 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f4b99700 1 -- 172.21.15.71:0/1769646686 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33822077 0 0) 0x7fa3f00cf780 con 0x7fa3f00b60e0 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f539a700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f5b9b700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f015fca0 0x7fa3f00d1420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0098f0 tx=0x7fa3ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4d06778497bdc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f4b99700 1 -- 172.21.15.71:0/1769646686 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00b8a0 con 0x7fa3f015fca0 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f4b99700 1 -- 172.21.15.71:0/1769646686 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00ba00 con 0x7fa3f015fca0 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f4b99700 1 -- 172.21.15.71:0/1769646686 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00bd90 con 0x7fa3f015fca0 2023-07-06T01:09:59.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f7dff700 1 -- 172.21.15.71:0/1769646686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f015fca0 msgr2=0x7fa3f00d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.910+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f015fca0 0x7fa3f00d1420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0098f0 tx=0x7fa3ec009c00 comp rx=0 tx=0).stop 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.911+0000 7fa3f7dff700 1 -- 172.21.15.71:0/1769646686 shutdown_connections 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.911+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f015fca0 0x7fa3f00d1420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.911+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/1769646686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.911+0000 7fa3f7dff700 1 -- 172.21.15.71:0/1769646686 >> 172.21.15.71:0/1769646686 conn(0x7fa3f006c150 msgr2=0x7fa3f006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.911+0000 7fa3f7dff700 1 -- 172.21.15.71:0/1769646686 shutdown_connections 2023-07-06T01:09:59.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.911+0000 7fa3f7dff700 1 -- 172.21.15.71:0/1769646686 wait complete. 2023-07-06T01:09:59.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.912+0000 7fa3f7dff700 1 Processor -- start 2023-07-06T01:09:59.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 -- start start 2023-07-06T01:09:59.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:59.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 0x7fa3f0152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f015fca0 0x7fa3f0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00c9fb0 con 0x7fa3f00b60e0 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00ca290 con 0x7fa3f015fca0 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.913+0000 7fa3f7dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00ca570 con 0x7fa3f00b5c90 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 0x7fa3f0152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 0x7fa3f0152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33756/0 (socket says 172.21.15.71:33756) 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 -- 172.21.15.71:0/4078537579 learned_addr learned my addr 172.21.15.71:0/4078537579 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:09:59.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f5b9b700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f639c700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f015fca0 0x7fa3f0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 -- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 msgr2=0x7fa3f014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 -- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f015fca0 msgr2=0x7fa3f0159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f015fca0 0x7fa3f0159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 -- 172.21.15.71:0/4078537579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec009550 con 0x7fa3f00b60e0 2023-07-06T01:09:59.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f639c700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f015fca0 0x7fa3f0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.914+0000 7fa3f539a700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 0x7fa3f0152d70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000e810 tx=0x7fa3e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.915+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0004230 con 0x7fa3f00b60e0 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.915+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e00043b0 con 0x7fa3f00b60e0 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.915+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e00038e0 con 0x7fa3f00b60e0 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.915+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00ca850 con 0x7fa3f00b60e0 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.915+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f014e130 con 0x7fa3f00b60e0 2023-07-06T01:09:59.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.916+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00ce120 con 0x7fa3f00b60e0 2023-07-06T01:09:59.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.917+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3e0003a40 con 0x7fa3f00b60e0 2023-07-06T01:09:59.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.918+0000 7fa3e67fc700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa3d406ace0 0x7fa3d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:09:59.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.918+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3e0088b50 con 0x7fa3f00b60e0 2023-07-06T01:09:59.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.919+0000 7fa3f5b9b700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa3d406ace0 0x7fa3d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:09:59.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.919+0000 7fa3f5b9b700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa3d406ace0 0x7fa3d406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec014040 tx=0x7fa3ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:09:59.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:09:59.923+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3e00579d0 con 0x7fa3f00b60e0 2023-07-06T01:10:00.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.191+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa3f00ca0f0 con 0x7fa3f00b60e0 2023-07-06T01:10:00.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.192+0000 7fa3e67fc700 1 -- 172.21.15.71:0/4078537579 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa3f00ca0f0 con 0x7fa3f00b60e0 2023-07-06T01:10:00.194 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:00.195 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:00.195 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-07-06T01:10:00.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.195 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-07-06T01:10:00.195 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDhE6ZkweSeNBAAbB1tK2pCmw4pXUN8iQlxJA==", 2023-07-06T01:10:00.196 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-07-06T01:10:00.196 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-07-06T01:10:00.196 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDiE6ZkFtkbEBAANoTePxPvCD/oYp17q4N0Cg==", 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.197 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDiE6ZkQKN/BBAA3o7Q8u+yJ+bEt4prnsXqUg==", 2023-07-06T01:10:00.198 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.199 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-07-06T01:10:00.200 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDiE6ZkAY65GxAAheP2as13roTmaYT7boNQyA==", 2023-07-06T01:10:00.200 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-07-06T01:10:00.200 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDmE6Zkk7WxMhAA88Tetkf95whY37AgIrC/Hg==", 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.201 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-07-06T01:10:00.202 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDpE6ZkuDAaNhAAItdBDYa9zBZr/fQKrCY1Pg==", 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.203 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDsE6ZkSgYrORAALgAPdMxwqjAaN0QHpWLk9w==", 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDwE6Zkc7NHARAAyFbEI24Vi6Ga2Ub7BIPFOg==", 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQD2E6ZkNm29FhAAStt4urz8jqHbSMoERSEnmw==", 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.206 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQD5E6ZkttchGhAAQ4/V8xvGztIU7bMVsIwnqg==", 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.207 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.208 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.208 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-07-06T01:10:00.208 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQD8E6Zk6Ie5HRAASeYosHk9ICshB/OpQ3En4A==", 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.209 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQD/E6Zkx/YUIRAAwioJsTbk5U8UqUUArKFcjQ==", 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDiE6ZkSzPRJRAAmgb9CVEUw/PXwFq+mKxoFg==", 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-07-06T01:10:00.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.212 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-07-06T01:10:00.212 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDiE6ZkkumoNBAA0UkxAJL2wIveN2aW4qZ15Q==", 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDiE6ZkrU86LRAA2uZKu0vNeItQHde5ZLasuA==", 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-07-06T01:10:00.214 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDjE6ZkZ3RzABAARBuSN5hGsUNT4xYD/w1CXg==", 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-07-06T01:10:00.215 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-07-06T01:10:00.216 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDgE6ZkupFWORAA4/by4q0d2bu2viCvxM68Sw==", 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mds", 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAHFKZk/J21IxAAXFMeTGXQBAyUKa4i3Jeggw==", 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mds" 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mgr", 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAHFKZkfae1IxAAsDwktWRdPQ2ZF+3RYBhIUg==", 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.219 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-osd", 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAHFKZkjLG1IxAAcjisZFVs5EGpMuSOVzAw/g==", 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-osd" 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.220 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd", 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAHFKZk97m1IxAAT4Ven4h2Xg4aaPQ1eLmoeg==", 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-06T01:10:00.221 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAHFKZkacK1IxAAN5O5w2JdpkFD0ybNwTjR/A==", 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rgw", 2023-07-06T01:10:00.222 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQAHFKZk7cq1IxAAqHsmtFTWCfs/4YnkpzzwzA==", 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDhE6ZkD98MLRAA4B5otR+ybcrSF23Z0XR1Bw==", 2023-07-06T01:10:00.223 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.224 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-07-06T01:10:00.224 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-07-06T01:10:00.224 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.224 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:00.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:00.225 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-07-06T01:10:00.225 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQDhE6ZkqSHBJBAAalKKakpiGT35gIEVwLwbzQ==", 2023-07-06T01:10:00.225 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-07-06T01:10:00.225 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-07-06T01:10:00.225 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-07-06T01:10:00.226 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-07-06T01:10:00.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:00.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-07-06T01:10:00.226 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:00.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa3d406ace0 msgr2=0x7fa3d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa3d406ace0 0x7fa3d406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec014040 tx=0x7fa3ec008030 comp rx=0 tx=0).stop 2023-07-06T01:10:00.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 msgr2=0x7fa3f0152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 0x7fa3f0152d70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000e810 tx=0x7fa3e000eb20 comp rx=0 tx=0).stop 2023-07-06T01:10:00.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 shutdown_connections 2023-07-06T01:10:00.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa3d406ace0 0x7fa3d406d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3f015fca0 0x7fa3f0159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3f00b5c90 0x7fa3f014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 --2- 172.21.15.71:0/4078537579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3f00b60e0 0x7fa3f0152d70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 >> 172.21.15.71:0/4078537579 conn(0x7fa3f006c150 msgr2=0x7fa3f0073060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:00.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 shutdown_connections 2023-07-06T01:10:00.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.194+0000 7fa3f7dff700 1 -- 172.21.15.71:0/4078537579 wait complete. 2023-07-06T01:10:00.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-06T01:10:00.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.431+0000 7faa6dfff700 1 Processor -- start 2023-07-06T01:10:00.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.432+0000 7faa6dfff700 1 -- start start 2023-07-06T01:10:00.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa6dfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa680b5c90 0x7faa680d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa6dfff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa680b6110 0x7faa680d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa6dfff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680cf780 con 0x7faa6815fca0 2023-07-06T01:10:00.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa6dfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680cd490 con 0x7faa680b5c90 2023-07-06T01:10:00.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa6dfff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa680cd770 con 0x7faa680b6110 2023-07-06T01:10:00.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa5ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa680b5c90 0x7faa680d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa5ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7faa680b5c90 0x7faa680d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33770/0 (socket says 172.21.15.71:33770) 2023-07-06T01:10:00.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa5ffff700 1 -- 172.21.15.71:0/83951897 learned_addr learned my addr 172.21.15.71:0/83951897 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:00.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa5ffff700 1 -- 172.21.15.71:0/83951897 >> v2:172.21.15.194:3300/0 conn(0x7faa680b6110 msgr2=0x7faa680d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:00.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa5ffff700 1 --2- 172.21.15.71:0/83951897 >> v2:172.21.15.194:3300/0 conn(0x7faa680b6110 0x7faa680d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.433+0000 7faa5ffff700 1 -- 172.21.15.71:0/83951897 >> v1:172.21.15.194:6789/0 conn(0x7faa6815fca0 legacy=0x7faa680d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:00.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa5ffff700 1 -- 172.21.15.71:0/83951897 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680cda50 con 0x7faa680b5c90 2023-07-06T01:10:00.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa5ffff700 1 --2- 172.21.15.71:0/83951897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa680d2d40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faa680cd410 tx=0x7faa50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799280ef1c5598ae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:00.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa66ffd700 1 -- 172.21.15.71:0/83951897 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50004230 con 0x7faa680b5c90 2023-07-06T01:10:00.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa66ffd700 1 -- 172.21.15.71:0/83951897 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50004390 con 0x7faa680b5c90 2023-07-06T01:10:00.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa66ffd700 1 -- 172.21.15.71:0/83951897 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500036a0 con 0x7faa680b5c90 2023-07-06T01:10:00.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa6dfff700 1 -- 172.21.15.71:0/83951897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 msgr2=0x7faa680d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.434+0000 7faa6dfff700 1 --2- 172.21.15.71:0/83951897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa680d2d40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faa680cd410 tx=0x7faa50009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.435+0000 7faa6dfff700 1 -- 172.21.15.71:0/83951897 shutdown_connections 2023-07-06T01:10:00.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.435+0000 7faa6dfff700 1 --2- 172.21.15.71:0/83951897 >> v2:172.21.15.194:3300/0 conn(0x7faa680b6110 0x7faa680d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.435+0000 7faa6dfff700 1 --2- 172.21.15.71:0/83951897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa680d2d40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.435+0000 7faa6dfff700 1 -- 172.21.15.71:0/83951897 >> 172.21.15.71:0/83951897 conn(0x7faa6806c150 msgr2=0x7faa6806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:00.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.435+0000 7faa6dfff700 1 -- 172.21.15.71:0/83951897 shutdown_connections 2023-07-06T01:10:00.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.435+0000 7faa6dfff700 1 -- 172.21.15.71:0/83951897 wait complete. 2023-07-06T01:10:00.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.436+0000 7faa6dfff700 1 Processor -- start 2023-07-06T01:10:00.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.436+0000 7faa6dfff700 1 -- start start 2023-07-06T01:10:00.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.437+0000 7faa6dfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa681573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.437+0000 7faa6dfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa680b6110 0x7faa680c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.437+0000 7faa6dfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa6815fca0 0x7faa680c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.437+0000 7faa6dfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680cb700 con 0x7faa680b5c90 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.437+0000 7faa6dfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa680cc450 con 0x7faa680b6110 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.437+0000 7faa6dfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680caaf0 con 0x7faa6815fca0 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa681573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa681573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33778/0 (socket says 172.21.15.71:33778) 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 -- 172.21.15.71:0/3587067779 learned_addr learned my addr 172.21.15.71:0/3587067779 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa5ffff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa680b6110 0x7faa680c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa67fff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa6815fca0 0x7faa680c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 -- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa6815fca0 msgr2=0x7faa680c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa6815fca0 0x7faa680c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 -- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa680b6110 msgr2=0x7faa680c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa680b6110 0x7faa680c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 -- 172.21.15.71:0/3587067779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa50009550 con 0x7faa680b5c90 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa5ffff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa680b6110 0x7faa680c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.438+0000 7faa677fe700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa681573b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faa5800b4a0 tx=0x7faa5800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:00.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.439+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58011830 con 0x7faa680b5c90 2023-07-06T01:10:00.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.439+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580119b0 con 0x7faa680b5c90 2023-07-06T01:10:00.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.439+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa680cadd0 con 0x7faa680b5c90 2023-07-06T01:10:00.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.439+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58011d60 con 0x7faa680b5c90 2023-07-06T01:10:00.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.439+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa680cb390 con 0x7faa680b5c90 2023-07-06T01:10:00.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.440+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa680008d0 con 0x7faa680b5c90 2023-07-06T01:10:00.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.441+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa5801a400 con 0x7faa680b5c90 2023-07-06T01:10:00.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.442+0000 7faa64ff9700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7faa4806ace0 0x7faa4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.442+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faa58089120 con 0x7faa680b5c90 2023-07-06T01:10:00.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.442+0000 7faa5ffff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7faa4806ace0 0x7faa4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.443+0000 7faa5ffff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7faa4806ace0 0x7faa4806d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa50009130 tx=0x7faa50008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:00.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.446+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faa580545b0 con 0x7faa680b5c90 2023-07-06T01:10:00.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.722+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7faa6815ab40 con 0x7faa680b5c90 2023-07-06T01:10:00.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.727+0000 7faa64ff9700 1 -- 172.21.15.71:0/3587067779 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7faa58057bd0 con 0x7faa680b5c90 2023-07-06T01:10:00.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7faa4806ace0 msgr2=0x7faa4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7faa4806ace0 0x7faa4806d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa50009130 tx=0x7faa50008030 comp rx=0 tx=0).stop 2023-07-06T01:10:00.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 msgr2=0x7faa681573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa681573b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faa5800b4a0 tx=0x7faa5800b860 comp rx=0 tx=0).stop 2023-07-06T01:10:00.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 shutdown_connections 2023-07-06T01:10:00.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7faa4806ace0 0x7faa4806d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa6815fca0 0x7faa680c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa680b5c90 0x7faa681573b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 --2- 172.21.15.71:0/3587067779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa680b6110 0x7faa680c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 >> 172.21.15.71:0/3587067779 conn(0x7faa6806c150 msgr2=0x7faa680b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:00.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 shutdown_connections 2023-07-06T01:10:00.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.730+0000 7faa6dfff700 1 -- 172.21.15.71:0/3587067779 wait complete. 2023-07-06T01:10:00.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-06T01:10:00.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.944+0000 7fa8b53ff700 1 Processor -- start 2023-07-06T01:10:00.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.944+0000 7fa8b53ff700 1 -- start start 2023-07-06T01:10:00.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8b53ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8b00b5c90 0x7fa8b00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8b53ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cf780 con 0x7fa8b00b6110 2023-07-06T01:10:00.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8b53ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cd490 con 0x7fa8b015fca0 2023-07-06T01:10:00.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8b53ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00cd770 con 0x7fa8b00b5c90 2023-07-06T01:10:00.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8a7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8b00b5c90 0x7fa8b00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8af7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa8b00b6110 0x7fa8b00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41570/0 (socket says 172.21.15.71:41570) 2023-07-06T01:10:00.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8af7fe700 1 -- 172.21.15.71:0/1520464247 learned_addr learned my addr 172.21.15.71:0/1520464247 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:00.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8ae7fc700 1 -- 172.21.15.71:0/1520464247 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480398 0 0) 0x7fa8b00cf780 con 0x7fa8b00b6110 2023-07-06T01:10:00.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8ae7fc700 1 -- 172.21.15.71:0/1520464247 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c0035b0 con 0x7fa8b00b6110 2023-07-06T01:10:00.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8a7fff700 1 -- 172.21.15.71:0/1520464247 >> v1:172.21.15.194:6789/0 conn(0x7fa8b015fca0 legacy=0x7fa8b00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8a7fff700 1 -- 172.21.15.71:0/1520464247 >> v1:172.21.15.71:6789/0 conn(0x7fa8b00b6110 legacy=0x7fa8b00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.946+0000 7fa8a7fff700 1 -- 172.21.15.71:0/1520464247 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00cda50 con 0x7fa8b00b5c90 2023-07-06T01:10:00.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8a7fff700 1 --2- 172.21.15.71:0/1520464247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00d2d40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa898009840 tx=0x7fa898009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e31b76b2b4735 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:00.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8ae7fc700 1 -- 172.21.15.71:0/1520464247 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011830 con 0x7fa8b00b5c90 2023-07-06T01:10:00.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8ae7fc700 1 -- 172.21.15.71:0/1520464247 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898011990 con 0x7fa8b00b5c90 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8ae7fc700 1 -- 172.21.15.71:0/1520464247 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011d20 con 0x7fa8b00b5c90 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1520464247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 msgr2=0x7fa8b00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1520464247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00d2d40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa898009840 tx=0x7fa898009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1520464247 shutdown_connections 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1520464247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00d2d40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1520464247 >> 172.21.15.71:0/1520464247 conn(0x7fa8b006c150 msgr2=0x7fa8b006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:00.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.947+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1520464247 shutdown_connections 2023-07-06T01:10:00.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.948+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1520464247 wait complete. 2023-07-06T01:10:00.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.949+0000 7fa8b53ff700 1 Processor -- start 2023-07-06T01:10:00.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.949+0000 7fa8b53ff700 1 -- start start 2023-07-06T01:10:00.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8b53ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8b53ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b6110 0x7fa8b015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8b53ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b015fca0 0x7fa8b0148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8b53ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00cb4a0 con 0x7fa8b00b5c90 2023-07-06T01:10:00.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8b53ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00cc2c0 con 0x7fa8b015fca0 2023-07-06T01:10:00.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8b53ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00cb6b0 con 0x7fa8b00b6110 2023-07-06T01:10:00.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8aeffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8aeffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33792/0 (socket says 172.21.15.71:33792) 2023-07-06T01:10:00.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.950+0000 7fa8aeffd700 1 -- 172.21.15.71:0/1994593647 learned_addr learned my addr 172.21.15.71:0/1994593647 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:00.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8a7fff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b6110 0x7fa8b015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8af7fe700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b015fca0 0x7fa8b0148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8aeffd700 1 -- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b6110 msgr2=0x7fa8b015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8aeffd700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b6110 0x7fa8b015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8aeffd700 1 -- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b015fca0 msgr2=0x7fa8b0148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:00.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8aeffd700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b015fca0 0x7fa8b0148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:00.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8aeffd700 1 -- 172.21.15.71:0/1994593647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8980094a0 con 0x7fa8b00b5c90 2023-07-06T01:10:00.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8a7fff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b6110 0x7fa8b015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:00.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8af7fe700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b015fca0 0x7fa8b0148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:00.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8aeffd700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00caf60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c450 tx=0x7fa8a000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:00.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00052d0 con 0x7fa8b00b5c90 2023-07-06T01:10:00.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0005430 con 0x7fa8b00b5c90 2023-07-06T01:10:00.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00cb990 con 0x7fa8b00b5c90 2023-07-06T01:10:00.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00038c0 con 0x7fa8b00b5c90 2023-07-06T01:10:00.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.951+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00cbf50 con 0x7fa8b00b5c90 2023-07-06T01:10:00.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.952+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b00008d0 con 0x7fa8b00b5c90 2023-07-06T01:10:00.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.953+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8a0003a20 con 0x7fa8b00b5c90 2023-07-06T01:10:00.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.954+0000 7fa8a77fe700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa89006ad10 0x7fa89006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:00.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.954+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa8a0088600 con 0x7fa8b00b5c90 2023-07-06T01:10:00.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.955+0000 7fa8a7fff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa89006ad10 0x7fa89006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:00.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.956+0000 7fa8a7fff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa89006ad10 0x7fa89006d1c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00ccb10 tx=0x7fa898008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:00.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:00.959+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8a00538d0 con 0x7fa8b00b5c90 2023-07-06T01:10:01.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.232+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fa8b00d11c0 con 0x7fa8b00b5c90 2023-07-06T01:10:01.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.238+0000 7fa8a77fe700 1 -- 172.21.15.71:0/1994593647 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa8a0056ef0 con 0x7fa8b00b5c90 2023-07-06T01:10:01.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa89006ad10 msgr2=0x7fa89006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa89006ad10 0x7fa89006d1c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00ccb10 tx=0x7fa898008030 comp rx=0 tx=0).stop 2023-07-06T01:10:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 msgr2=0x7fa8b00caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00caf60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c450 tx=0x7fa8a000c810 comp rx=0 tx=0).stop 2023-07-06T01:10:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 shutdown_connections 2023-07-06T01:10:01.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa89006ad10 0x7fa89006d1c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8b015fca0 0x7fa8b0148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8b00b5c90 0x7fa8b00caf60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 --2- 172.21.15.71:0/1994593647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8b00b6110 0x7fa8b015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 >> 172.21.15.71:0/1994593647 conn(0x7fa8b006c150 msgr2=0x7fa8b00d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 shutdown_connections 2023-07-06T01:10:01.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.240+0000 7fa8b53ff700 1 -- 172.21.15.71:0/1994593647 wait complete. 2023-07-06T01:10:01.261 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-06T01:10:01.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.453+0000 7fe7195ff700 1 Processor -- start 2023-07-06T01:10:01.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.453+0000 7fe7195ff700 1 -- start start 2023-07-06T01:10:01.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 0x7fe7140d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7195ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140cf780 con 0x7fe71415fca0 2023-07-06T01:10:01.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7195ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140cd490 con 0x7fe7140b60e0 2023-07-06T01:10:01.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7195ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140cd770 con 0x7fe7140b5c90 2023-07-06T01:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe712ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe71415fca0 0x7fe7140d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41582/0 (socket says 172.21.15.71:41582) 2023-07-06T01:10:01.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe712ffd700 1 -- 172.21.15.71:0/2308085344 learned_addr learned my addr 172.21.15.71:0/2308085344 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:01.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe70bfff700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 0x7fe7140d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176475459 0 0) 0x7fe7140cf780 con 0x7fe71415fca0 2023-07-06T01:10:01.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7000035b0 con 0x7fe71415fca0 2023-07-06T01:10:01.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.455+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903200818 0 0) 0x7fe7140cd490 con 0x7fe7140b60e0 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7140cf780 con 0x7fe7140b60e0 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1440839698 0 0) 0x7fe7000035b0 con 0x7fe71415fca0 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 msgr2=0x7fe7140d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 0x7fe7140d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 >> v1:172.21.15.194:6789/0 conn(0x7fe7140b60e0 legacy=0x7fe7140cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140cda50 con 0x7fe71415fca0 2023-07-06T01:10:01.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fe704001670 con 0x7fe71415fca0 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 >> v1:172.21.15.71:6789/0 conn(0x7fe71415fca0 legacy=0x7fe7140d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe700003bc0 0x7fe700003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 0x7fe700004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe700004d90 0x7fe700005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140cd770 con 0x7fe700003bc0 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000bac0 con 0x7fe700004d90 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000bc50 con 0x7fe7140b5c90 2023-07-06T01:10:01.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe712ffd700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe700003bc0 0x7fe700003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe70bfff700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 0x7fe700004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7137fe700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe700004d90 0x7fe700005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe712ffd700 1 -- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 msgr2=0x7fe700004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe712ffd700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7140b5c90 0x7fe700004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe712ffd700 1 -- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe700004d90 msgr2=0x7fe700005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe712ffd700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe700004d90 0x7fe700005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe712ffd700 1 -- 172.21.15.71:0/2308085344 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000035b0 con 0x7fe700003bc0 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.456+0000 7fe7137fe700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe700004d90 0x7fe700005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe712ffd700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe700003bc0 0x7fe700003fb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c210 tx=0x7fe700005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a57892ec8b0f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400cdb0 con 0x7fe700003bc0 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704001af0 con 0x7fe700003bc0 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7127fc700 1 -- 172.21.15.71:0/2308085344 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704005ba0 con 0x7fe700003bc0 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7195ff700 1 -- 172.21.15.71:0/2308085344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe700003bc0 msgr2=0x7fe700003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7195ff700 1 --2- 172.21.15.71:0/2308085344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe700003bc0 0x7fe700003fb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c210 tx=0x7fe700005880 comp rx=0 tx=0).stop 2023-07-06T01:10:01.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7137fe700 1 -- 172.21.15.71:0/2308085344 reap_dead start 2023-07-06T01:10:01.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7195ff700 1 -- 172.21.15.71:0/2308085344 shutdown_connections 2023-07-06T01:10:01.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.457+0000 7fe7195ff700 1 -- 172.21.15.71:0/2308085344 >> 172.21.15.71:0/2308085344 conn(0x7fe71406c150 msgr2=0x7fe71406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:01.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.458+0000 7fe7195ff700 1 -- 172.21.15.71:0/2308085344 shutdown_connections 2023-07-06T01:10:01.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.458+0000 7fe7195ff700 1 -- 172.21.15.71:0/2308085344 wait complete. 2023-07-06T01:10:01.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.459+0000 7fe7195ff700 1 Processor -- start 2023-07-06T01:10:01.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.459+0000 7fe7195ff700 1 -- start start 2023-07-06T01:10:01.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe700003bc0 0x7fe7140cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7140cb6e0 0x7fe714156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7195ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 0x7fe7141e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7195ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141e88d0 con 0x7fe7141e7f20 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7195ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140ccc50 con 0x7fe7140cb6e0 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7195ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140cac00 con 0x7fe700003bc0 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.460+0000 7fe7137fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 0x7fe7141e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 0x7fe7141e8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33804/0 (socket says 172.21.15.71:33804) 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 -- 172.21.15.71:0/1444556993 learned_addr learned my addr 172.21.15.71:0/1444556993 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe712ffd700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe700003bc0 0x7fe7140cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe70bfff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7140cb6e0 0x7fe714156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 -- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe700003bc0 msgr2=0x7fe7140cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe700003bc0 0x7fe7140cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 -- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7140cb6e0 msgr2=0x7fe714156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7140cb6e0 0x7fe714156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 -- 172.21.15.71:0/1444556993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140caee0 con 0x7fe7141e7f20 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe712ffd700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe700003bc0 0x7fe7140cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7137fe700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 0x7fe7141e8390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe70c001a50 tx=0x7fe70c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:01.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c003c10 con 0x7fe7141e7f20 2023-07-06T01:10:01.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c003d90 con 0x7fe7141e7f20 2023-07-06T01:10:01.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7140cb1c0 con 0x7fe7141e7f20 2023-07-06T01:10:01.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.461+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c005310 con 0x7fe7141e7f20 2023-07-06T01:10:01.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.462+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7140ca8f0 con 0x7fe7141e7f20 2023-07-06T01:10:01.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.463+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7140008d0 con 0x7fe7141e7f20 2023-07-06T01:10:01.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.463+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe70c005470 con 0x7fe7141e7f20 2023-07-06T01:10:01.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.465+0000 7fe70b7fe700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe6f406ace0 0x7fe6f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.465+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe70c089290 con 0x7fe7141e7f20 2023-07-06T01:10:01.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.465+0000 7fe712ffd700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe6f406ace0 0x7fe6f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.466+0000 7fe712ffd700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe6f406ace0 0x7fe6f406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7040018b0 tx=0x7fe70400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:01.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.469+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe70c054680 con 0x7fe7141e7f20 2023-07-06T01:10:01.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.751+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe7140d0740 con 0x7fe7141e7f20 2023-07-06T01:10:01.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.756+0000 7fe70b7fe700 1 -- 172.21.15.71:0/1444556993 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe70c001ca0 con 0x7fe7141e7f20 2023-07-06T01:10:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe6f406ace0 msgr2=0x7fe6f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe6f406ace0 0x7fe6f406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7040018b0 tx=0x7fe70400a000 comp rx=0 tx=0).stop 2023-07-06T01:10:01.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 msgr2=0x7fe7141e8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 0x7fe7141e8390 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe70c001a50 tx=0x7fe70c00ef40 comp rx=0 tx=0).stop 2023-07-06T01:10:01.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 shutdown_connections 2023-07-06T01:10:01.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe6f406ace0 0x7fe6f406d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7141e7f20 0x7fe7141e8390 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe700003bc0 0x7fe7140cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 --2- 172.21.15.71:0/1444556993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7140cb6e0 0x7fe714156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 >> 172.21.15.71:0/1444556993 conn(0x7fe71406c150 msgr2=0x7fe71415a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 shutdown_connections 2023-07-06T01:10:01.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.759+0000 7fe7195ff700 1 -- 172.21.15.71:0/1444556993 wait complete. 2023-07-06T01:10:01.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-06T01:10:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.970+0000 7ff4bd79d700 1 Processor -- start 2023-07-06T01:10:01.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.971+0000 7ff4bd79d700 1 -- start start 2023-07-06T01:10:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4bd79d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 0x7ff4b815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4bd79d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80cd250 con 0x7ff4b80b1f80 2023-07-06T01:10:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4bd79d700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80cd530 con 0x7ff4b80d2b90 2023-07-06T01:10:01.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4bd79d700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80cd810 con 0x7ff4b815d000 2023-07-06T01:10:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4b77fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff4b80b1f80 0x7ff4b80cf9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41588/0 (socket says 172.21.15.71:41588) 2023-07-06T01:10:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4b77fe700 1 -- 172.21.15.71:0/1231382267 learned_addr learned my addr 172.21.15.71:0/1231382267 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4b7fff700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 0x7ff4b815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932605241 0 0) 0x7ff4b80cd250 con 0x7ff4b80b1f80 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.972+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a00035b0 con 0x7ff4b80b1f80 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142384606 0 0) 0x7ff4a00035b0 con 0x7ff4b80b1f80 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 msgr2=0x7ff4b815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 0x7ff4b815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 >> v1:172.21.15.194:6789/0 conn(0x7ff4b80d2b90 legacy=0x7ff4b80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80cf1d0 con 0x7ff4b80b1f80 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7ff4ac001670 con 0x7ff4b80b1f80 2023-07-06T01:10:01.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 >> v1:172.21.15.71:6789/0 conn(0x7ff4b80b1f80 legacy=0x7ff4b80cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 0x7ff4a0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4a0003f70 0x7ff4a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80cd810 con 0x7ff4a0004d90 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000baf0 con 0x7ff4a0003f70 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000bcb0 con 0x7ff4b815d000 2023-07-06T01:10:01.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4bcf9c700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b7fff700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 0x7ff4a0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.973+0000 7ff4b77fe700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4a0003f70 0x7ff4a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 -- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 msgr2=0x7ff4a0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b815d000 0x7ff4a0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 -- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4a0003f70 msgr2=0x7ff4a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4a0003f70 0x7ff4a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 -- 172.21.15.71:0/1231382267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00035b0 con 0x7ff4a0004d90 2023-07-06T01:10:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4a0005200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c260 tx=0x7ff4a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5a150fc0d51a96 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0001e70 con 0x7ff4a0004d90 2023-07-06T01:10:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000ce20 con 0x7ff4a0004d90 2023-07-06T01:10:01.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4b6ffd700 1 -- 172.21.15.71:0/1231382267 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0012660 con 0x7ff4a0004d90 2023-07-06T01:10:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bd79d700 1 -- 172.21.15.71:0/1231382267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 msgr2=0x7ff4a0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/1231382267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4a0005200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000c260 tx=0x7ff4a0005880 comp rx=0 tx=0).stop 2023-07-06T01:10:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.974+0000 7ff4bcf9c700 1 -- 172.21.15.71:0/1231382267 reap_dead start 2023-07-06T01:10:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.975+0000 7ff4bd79d700 1 -- 172.21.15.71:0/1231382267 shutdown_connections 2023-07-06T01:10:01.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.975+0000 7ff4bd79d700 1 -- 172.21.15.71:0/1231382267 >> 172.21.15.71:0/1231382267 conn(0x7ff4b806a4e0 msgr2=0x7ff4b806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.975+0000 7ff4bd79d700 1 -- 172.21.15.71:0/1231382267 shutdown_connections 2023-07-06T01:10:01.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.975+0000 7ff4bd79d700 1 -- 172.21.15.71:0/1231382267 wait complete. 2023-07-06T01:10:01.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.977+0000 7ff4bd79d700 1 Processor -- start 2023-07-06T01:10:01.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.977+0000 7ff4bd79d700 1 -- start start 2023-07-06T01:10:01.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.978+0000 7ff4bd79d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4b814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.978+0000 7ff4bd79d700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b80cc870 0x7ff4b80c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4bd79d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b80c9380 0x7ff4b80b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4bd79d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80ccce0 con 0x7ff4a0004d90 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4bd79d700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c68d0 con 0x7ff4b80cc870 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4bd79d700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c6bb0 con 0x7ff4b80c9380 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4b814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4b814be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33824/0 (socket says 172.21.15.71:33824) 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 -- 172.21.15.71:0/50059826 learned_addr learned my addr 172.21.15.71:0/50059826 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:01.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4bcf9c700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b80c9380 0x7ff4b80b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b77fe700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b80cc870 0x7ff4b80c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 -- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b80c9380 msgr2=0x7ff4b80b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b80c9380 0x7ff4b80b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 -- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b80cc870 msgr2=0x7ff4b80c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b80cc870 0x7ff4b80c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 -- 172.21.15.71:0/50059826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80c6e90 con 0x7ff4a0004d90 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.979+0000 7ff4b7fff700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4b814be40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8011aa0 tx=0x7ff4a8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:01.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.980+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800f980 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.980+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800fae0 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.980+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800fe90 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.980+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b80c7170 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.980+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b80b4230 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.981+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b804eb90 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.982+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4a8014440 con 0x7ff4a0004d90 2023-07-06T01:10:01.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.982+0000 7ff4b4ff9700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff4a406ace0 0x7ff4a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:01.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.983+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff4a80899c0 con 0x7ff4a0004d90 2023-07-06T01:10:01.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.983+0000 7ff4b77fe700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff4a406ace0 0x7ff4a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:01.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.984+0000 7ff4b77fe700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff4a406ace0 0x7ff4a406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000c00 tx=0x7ff4ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:01.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:01.987+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4a8058870 con 0x7ff4a0004d90 2023-07-06T01:10:02.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.257+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff4b80b4fb0 con 0x7ff4a0004d90 2023-07-06T01:10:02.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.263+0000 7ff4b4ff9700 1 -- 172.21.15.71:0/50059826 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff4a80220a0 con 0x7ff4a0004d90 2023-07-06T01:10:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff4a406ace0 msgr2=0x7ff4a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff4a406ace0 0x7ff4a406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac000c00 tx=0x7ff4ac009040 comp rx=0 tx=0).stop 2023-07-06T01:10:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 msgr2=0x7ff4b814be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4b814be40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8011aa0 tx=0x7ff4a8011e60 comp rx=0 tx=0).stop 2023-07-06T01:10:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 shutdown_connections 2023-07-06T01:10:02.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff4a406ace0 0x7ff4a406d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b80c9380 0x7ff4b80b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4a0004d90 0x7ff4b814be40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 --2- 172.21.15.71:0/50059826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b80cc870 0x7ff4b80c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 >> 172.21.15.71:0/50059826 conn(0x7ff4b806a4e0 msgr2=0x7ff4b80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 shutdown_connections 2023-07-06T01:10:02.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.265+0000 7ff4bd79d700 1 -- 172.21.15.71:0/50059826 wait complete. 2023-07-06T01:10:02.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-06T01:10:02.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.477+0000 7fd5e37ff700 1 Processor -- start 2023-07-06T01:10:02.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.478+0000 7fd5e37ff700 1 -- start start 2023-07-06T01:10:02.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e37ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5dc15fca0 0x7fd5dc0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e37ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5dc0b5c90 0x7fd5dc0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e37ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e37ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0cf780 con 0x7fd5dc15fca0 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e37ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0cd490 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e37ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0cd770 con 0x7fd5dc0b6110 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e159b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5dc15fca0 0x7fd5dc0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e159b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5dc15fca0 0x7fd5dc0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33840/0 (socket says 172.21.15.71:33840) 2023-07-06T01:10:02.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.479+0000 7fd5e159b700 1 -- 172.21.15.71:0/1541364640 learned_addr learned my addr 172.21.15.71:0/1541364640 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:02.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e1d9c700 1 --2- 172.21.15.71:0/1541364640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e0d9a700 1 --2- 172.21.15.71:0/1541364640 >> v2:172.21.15.194:3300/0 conn(0x7fd5dc0b5c90 0x7fd5dc0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e159b700 1 -- 172.21.15.71:0/1541364640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 msgr2=0x7fd5dc0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:02.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e159b700 1 --2- 172.21.15.71:0/1541364640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e159b700 1 -- 172.21.15.71:0/1541364640 >> v2:172.21.15.194:3300/0 conn(0x7fd5dc0b5c90 msgr2=0x7fd5dc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e159b700 1 --2- 172.21.15.71:0/1541364640 >> v2:172.21.15.194:3300/0 conn(0x7fd5dc0b5c90 0x7fd5dc0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e159b700 1 -- 172.21.15.71:0/1541364640 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0cda50 con 0x7fd5dc15fca0 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5e159b700 1 --2- 172.21.15.71:0/1541364640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc15fca0 0x7fd5dc0d1420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc06b6f0 tx=0x7fd5d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9d46d756b91b8c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5d3fff700 1 -- 172.21.15.71:0/1541364640 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800b870 con 0x7fd5dc15fca0 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5d3fff700 1 -- 172.21.15.71:0/1541364640 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800b9d0 con 0x7fd5dc15fca0 2023-07-06T01:10:02.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.480+0000 7fd5d3fff700 1 -- 172.21.15.71:0/1541364640 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800bd60 con 0x7fd5dc15fca0 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 -- 172.21.15.71:0/1541364640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc15fca0 msgr2=0x7fd5dc0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/1541364640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc15fca0 0x7fd5dc0d1420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc06b6f0 tx=0x7fd5d8009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 -- 172.21.15.71:0/1541364640 shutdown_connections 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/1541364640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/1541364640 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc15fca0 0x7fd5dc0d1420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/1541364640 >> v2:172.21.15.194:3300/0 conn(0x7fd5dc0b5c90 0x7fd5dc0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 -- 172.21.15.71:0/1541364640 >> 172.21.15.71:0/1541364640 conn(0x7fd5dc06c150 msgr2=0x7fd5dc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:02.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 -- 172.21.15.71:0/1541364640 shutdown_connections 2023-07-06T01:10:02.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.481+0000 7fd5e37ff700 1 -- 172.21.15.71:0/1541364640 wait complete. 2023-07-06T01:10:02.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.483+0000 7fd5e37ff700 1 Processor -- start 2023-07-06T01:10:02.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.483+0000 7fd5e37ff700 1 -- start start 2023-07-06T01:10:02.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.484+0000 7fd5e37ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 0x7fd5dc1f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e37ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e37ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5dc15fca0 0x7fd5dc1f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e37ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b4590 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e37ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc15b9e0 con 0x7fd5dc15fca0 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e37ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc15bcc0 con 0x7fd5dc0b6110 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 0x7fd5dc1f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 0x7fd5dc1f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33856/0 (socket says 172.21.15.71:33856) 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 -- 172.21.15.71:0/200041472 learned_addr learned my addr 172.21.15.71:0/200041472 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 -- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 msgr2=0x7fd5dc0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 -- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5dc15fca0 msgr2=0x7fd5dc1f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5dc15fca0 0x7fd5dc1f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 -- 172.21.15.71:0/200041472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8009550 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.485+0000 7fd5e159b700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 0x7fd5dc1f6170 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000c00 tx=0x7fd5d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:02.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.486+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d801a710 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.486+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d801f070 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.486+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc15bfa0 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.486+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d801aab0 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.486+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc15c560 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.487+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc04eb90 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.488+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5d8021030 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.489+0000 7fd5d1ffb700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd5c006ad10 0x7fd5c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.489+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd5d808a600 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.489+0000 7fd5e0d9a700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd5c006ad10 0x7fd5c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.490+0000 7fd5e0d9a700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd5c006ad10 0x7fd5c006d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0b8d40 tx=0x7fd5cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:02.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.493+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5d8055b10 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.764+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd5dc0008d0 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.768+0000 7fd5d1ffb700 1 -- 172.21.15.71:0/200041472 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd5d8059130 con 0x7fd5dc0b5c90 2023-07-06T01:10:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd5c006ad10 msgr2=0x7fd5c006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd5c006ad10 0x7fd5c006d1c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc0b8d40 tx=0x7fd5cc008040 comp rx=0 tx=0).stop 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 msgr2=0x7fd5dc1f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 0x7fd5dc1f6170 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000c00 tx=0x7fd5d8004750 comp rx=0 tx=0).stop 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 shutdown_connections 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd5c006ad10 0x7fd5c006d1c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5dc15fca0 0x7fd5dc1f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5dc0b5c90 0x7fd5dc1f6170 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 --2- 172.21.15.71:0/200041472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5dc0b6110 0x7fd5dc0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 >> 172.21.15.71:0/200041472 conn(0x7fd5dc06c150 msgr2=0x7fd5dc0d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:02.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 shutdown_connections 2023-07-06T01:10:02.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.770+0000 7fd5e37ff700 1 -- 172.21.15.71:0/200041472 wait complete. 2023-07-06T01:10:02.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-06T01:10:02.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.983+0000 7f1e69bff700 1 Processor -- start 2023-07-06T01:10:02.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.983+0000 7f1e69bff700 1 -- start start 2023-07-06T01:10:02.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.984+0000 7f1e69bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.984+0000 7f1e69bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640cf780 con 0x7f1e640b60e0 2023-07-06T01:10:02.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.984+0000 7f1e69bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640cd490 con 0x7f1e6415fca0 2023-07-06T01:10:02.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.984+0000 7f1e69bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640cd770 con 0x7f1e640b5c90 2023-07-06T01:10:02.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e63fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1e640b60e0 0x7f1e640cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:41596/0 (socket says 172.21.15.71:41596) 2023-07-06T01:10:02.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e63fff700 1 -- 172.21.15.71:0/1749964822 learned_addr learned my addr 172.21.15.71:0/1749964822 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:02.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e62ffd700 1 --2- 172.21.15.71:0/1749964822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e627fc700 1 -- 172.21.15.71:0/1749964822 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721647156 0 0) 0x7f1e640cf780 con 0x7f1e640b60e0 2023-07-06T01:10:02.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e627fc700 1 -- 172.21.15.71:0/1749964822 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e4c0035b0 con 0x7f1e640b60e0 2023-07-06T01:10:02.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e627fc700 1 -- 172.21.15.71:0/1749964822 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767517191 0 0) 0x7f1e640cd490 con 0x7f1e6415fca0 2023-07-06T01:10:02.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e62ffd700 1 -- 172.21.15.71:0/1749964822 >> v1:172.21.15.194:6789/0 conn(0x7f1e6415fca0 legacy=0x7f1e640d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e62ffd700 1 -- 172.21.15.71:0/1749964822 >> v1:172.21.15.71:6789/0 conn(0x7f1e640b60e0 legacy=0x7f1e640cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.985+0000 7f1e62ffd700 1 -- 172.21.15.71:0/1749964822 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640cda50 con 0x7f1e640b5c90 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e62ffd700 1 --2- 172.21.15.71:0/1749964822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640d2d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009870 tx=0x7f1e58009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddc833a58e5053f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e627fc700 1 -- 172.21.15.71:0/1749964822 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58011830 con 0x7f1e640b5c90 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e627fc700 1 -- 172.21.15.71:0/1749964822 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e58011990 con 0x7f1e640b5c90 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e627fc700 1 -- 172.21.15.71:0/1749964822 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58011d20 con 0x7f1e640b5c90 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e69bff700 1 -- 172.21.15.71:0/1749964822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 msgr2=0x7f1e640d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e69bff700 1 --2- 172.21.15.71:0/1749964822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640d2d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009870 tx=0x7f1e58009b80 comp rx=0 tx=0).stop 2023-07-06T01:10:02.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e69bff700 1 -- 172.21.15.71:0/1749964822 shutdown_connections 2023-07-06T01:10:02.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e69bff700 1 --2- 172.21.15.71:0/1749964822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640d2d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.986+0000 7f1e69bff700 1 -- 172.21.15.71:0/1749964822 >> 172.21.15.71:0/1749964822 conn(0x7f1e6406c150 msgr2=0x7f1e6406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:02.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.987+0000 7f1e69bff700 1 -- 172.21.15.71:0/1749964822 shutdown_connections 2023-07-06T01:10:02.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.987+0000 7f1e69bff700 1 -- 172.21.15.71:0/1749964822 wait complete. 2023-07-06T01:10:02.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.988+0000 7f1e69bff700 1 Processor -- start 2023-07-06T01:10:02.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.988+0000 7f1e69bff700 1 -- start start 2023-07-06T01:10:02.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e69bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e69bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 0x7f1e640ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e69bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e6415fca0 0x7f1e6414b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e69bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640cbdc0 con 0x7f1e640b60e0 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e69bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640cc090 con 0x7f1e6415fca0 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e69bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640cc370 con 0x7f1e640b5c90 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e62ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 0x7f1e640ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e62ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 0x7f1e640ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33870/0 (socket says 172.21.15.71:33870) 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.989+0000 7f1e62ffd700 1 -- 172.21.15.71:0/3915301074 learned_addr learned my addr 172.21.15.71:0/3915301074 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:02.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e637fe700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e63fff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e6415fca0 0x7f1e6414b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e62ffd700 1 -- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 msgr2=0x7f1e640cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e62ffd700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e62ffd700 1 -- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e6415fca0 msgr2=0x7f1e6414b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e62ffd700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e6415fca0 0x7f1e6414b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e62ffd700 1 -- 172.21.15.71:0/3915301074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e580094a0 con 0x7f1e640b60e0 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e63fff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e6415fca0 0x7f1e6414b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:02.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e62ffd700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 0x7f1e640ca890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009bc0 tx=0x7f1e58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:02.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5801a910 con 0x7f1e640b60e0 2023-07-06T01:10:02.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5801aa70 con 0x7f1e640b60e0 2023-07-06T01:10:02.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e640ca090 con 0x7f1e640b60e0 2023-07-06T01:10:02.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.990+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5801ae00 con 0x7f1e640b60e0 2023-07-06T01:10:02.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.991+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e640cadd0 con 0x7f1e640b60e0 2023-07-06T01:10:02.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.992+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e640c9ef0 con 0x7f1e640b60e0 2023-07-06T01:10:02.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.993+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e58022070 con 0x7f1e640b60e0 2023-07-06T01:10:02.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.993+0000 7f1e4bfff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e5006ace0 0x7f1e5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:02.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.994+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e58089f90 con 0x7f1e640b60e0 2023-07-06T01:10:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.994+0000 7f1e637fe700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e5006ace0 0x7f1e5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:02.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.995+0000 7f1e637fe700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e5006ace0 0x7f1e5006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e54000f60 tx=0x7f1e54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:02.998+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e640c9ef0 con 0x7f1e640b60e0 2023-07-06T01:10:03.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.265+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1e640ca5b0 con 0x7f1e640b60e0 2023-07-06T01:10:03.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.270+0000 7f1e4bfff700 1 -- 172.21.15.71:0/3915301074 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1e640ca5b0 con 0x7f1e640b60e0 2023-07-06T01:10:03.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e5006ace0 msgr2=0x7f1e5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e5006ace0 0x7f1e5006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e54000f60 tx=0x7f1e54009040 comp rx=0 tx=0).stop 2023-07-06T01:10:03.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 msgr2=0x7f1e640ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 0x7f1e640ca890 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009bc0 tx=0x7f1e58004750 comp rx=0 tx=0).stop 2023-07-06T01:10:03.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 shutdown_connections 2023-07-06T01:10:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e5006ace0 0x7f1e5006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e6415fca0 0x7f1e6414b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e640b5c90 0x7f1e640cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 --2- 172.21.15.71:0/3915301074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e640b60e0 0x7f1e640ca890 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 >> 172.21.15.71:0/3915301074 conn(0x7f1e6406c150 msgr2=0x7f1e6415a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 shutdown_connections 2023-07-06T01:10:03.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.272+0000 7f1e69bff700 1 -- 172.21.15.71:0/3915301074 wait complete. 2023-07-06T01:10:03.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:03.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.483+0000 7f3a3b9ff700 1 Processor -- start 2023-07-06T01:10:03.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.483+0000 7f3a3b9ff700 1 -- start start 2023-07-06T01:10:03.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a3b9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a3415fca0 0x7f3a340d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a3b9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 0x7f3a340d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a3b9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340cf780 con 0x7f3a340b60e0 2023-07-06T01:10:03.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a3b9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340cd490 con 0x7f3a3415fca0 2023-07-06T01:10:03.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a3b9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340cd770 con 0x7f3a340b5c90 2023-07-06T01:10:03.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a38f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 0x7f3a340d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a38f9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 0x7f3a340d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:44978/0 (socket says 172.21.15.71:44978) 2023-07-06T01:10:03.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a39f9c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3a340b60e0 0x7f3a340cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:42138/0 (socket says 172.21.15.71:42138) 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a38f9a700 1 -- 172.21.15.71:0/2823639361 learned_addr learned my addr 172.21.15.71:0/2823639361 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.485+0000 7f3a3979b700 1 --2- 172.21.15.71:0/2823639361 >> v2:172.21.15.194:3300/0 conn(0x7f3a3415fca0 0x7f3a340d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a2bfff700 1 -- 172.21.15.71:0/2823639361 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004414672 0 0) 0x7f3a340cf780 con 0x7f3a340b60e0 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a2bfff700 1 -- 172.21.15.71:0/2823639361 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a200035b0 con 0x7f3a340b60e0 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a38f9a700 1 -- 172.21.15.71:0/2823639361 >> v2:172.21.15.194:3300/0 conn(0x7f3a3415fca0 msgr2=0x7f3a340d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a38f9a700 1 --2- 172.21.15.71:0/2823639361 >> v2:172.21.15.194:3300/0 conn(0x7f3a3415fca0 0x7f3a340d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a38f9a700 1 -- 172.21.15.71:0/2823639361 >> v1:172.21.15.194:6789/0 conn(0x7f3a340b60e0 legacy=0x7f3a340cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a38f9a700 1 -- 172.21.15.71:0/2823639361 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340cda50 con 0x7f3a340b5c90 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a38f9a700 1 --2- 172.21.15.71:0/2823639361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 0x7f3a340d2d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098f0 tx=0x7f3a24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93fe00cec1d88c2f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a2bfff700 1 -- 172.21.15.71:0/2823639361 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24011830 con 0x7f3a340b5c90 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a2bfff700 1 -- 172.21.15.71:0/2823639361 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24011990 con 0x7f3a340b5c90 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.486+0000 7f3a2bfff700 1 -- 172.21.15.71:0/2823639361 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24011d20 con 0x7f3a340b5c90 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/2823639361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 msgr2=0x7f3a340d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/2823639361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 0x7f3a340d2d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098f0 tx=0x7f3a24009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:03.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/2823639361 shutdown_connections 2023-07-06T01:10:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/2823639361 >> v2:172.21.15.194:3300/0 conn(0x7f3a3415fca0 0x7f3a340d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/2823639361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a340b5c90 0x7f3a340d2d40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/2823639361 >> 172.21.15.71:0/2823639361 conn(0x7f3a3406c150 msgr2=0x7f3a3406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/2823639361 shutdown_connections 2023-07-06T01:10:03.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.487+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/2823639361 wait complete. 2023-07-06T01:10:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.489+0000 7f3a3b9ff700 1 Processor -- start 2023-07-06T01:10:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.489+0000 7f3a3b9ff700 1 -- start start 2023-07-06T01:10:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3b9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 0x7f3a341f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3b9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a340b60e0 0x7f3a340b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3b9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3415fca0 0x7f3a340b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3b9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341f62f0 con 0x7f3a340b5c90 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3b9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341f5420 con 0x7f3a340b60e0 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3b9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341f5670 con 0x7f3a3415fca0 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3979b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 0x7f3a341f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3979b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 0x7f3a341f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55056/0 (socket says 172.21.15.71:55056) 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a3979b700 1 -- 172.21.15.71:0/233133941 learned_addr learned my addr 172.21.15.71:0/233133941 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a39f9c700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3415fca0 0x7f3a340b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.490+0000 7f3a38f9a700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a340b60e0 0x7f3a340b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3979b700 1 -- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3415fca0 msgr2=0x7f3a340b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3979b700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3415fca0 0x7f3a340b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3979b700 1 -- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a340b60e0 msgr2=0x7f3a340b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3979b700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a340b60e0 0x7f3a340b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3979b700 1 -- 172.21.15.71:0/233133941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24009550 con 0x7f3a340b5c90 2023-07-06T01:10:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3979b700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 0x7f3a341f16f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000e870 tx=0x7f3a3000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30009590 con 0x7f3a340b5c90 2023-07-06T01:10:03.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a30013680 con 0x7f3a340b5c90 2023-07-06T01:10:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300139f0 con 0x7f3a340b5c90 2023-07-06T01:10:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a341f5950 con 0x7f3a340b5c90 2023-07-06T01:10:03.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.491+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a341f5f10 con 0x7f3a340b5c90 2023-07-06T01:10:03.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.492+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a340008d0 con 0x7f3a340b5c90 2023-07-06T01:10:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.493+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a30013b50 con 0x7f3a340b5c90 2023-07-06T01:10:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.494+0000 7f3a29ffb700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a1806ace0 0x7f3a1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.494+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3a30088f30 con 0x7f3a340b5c90 2023-07-06T01:10:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.495+0000 7f3a38f9a700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a1806ace0 0x7f3a1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.495+0000 7f3a38f9a700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a1806ace0 0x7f3a1806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009c40 tx=0x7f3a24008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.498+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a30057dc0 con 0x7f3a340b5c90 2023-07-06T01:10:03.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.695+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a340ca360 con 0x7f3a340b5c90 2023-07-06T01:10:03.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.695+0000 7f3a29ffb700 1 -- 172.21.15.71:0/233133941 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f3a30017090 con 0x7f3a340b5c90 2023-07-06T01:10:03.698 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:03.698 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":32,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:09:59.696262+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:03.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a1806ace0 msgr2=0x7f3a1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a1806ace0 0x7f3a1806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009c40 tx=0x7f3a24008030 comp rx=0 tx=0).stop 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 msgr2=0x7f3a341f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 0x7f3a341f16f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000e870 tx=0x7f3a3000eb80 comp rx=0 tx=0).stop 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 shutdown_connections 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3a1806ace0 0x7f3a1806d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3415fca0 0x7f3a340b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a340b5c90 0x7f3a341f16f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 --2- 172.21.15.71:0/233133941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a340b60e0 0x7f3a340b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 >> 172.21.15.71:0/233133941 conn(0x7f3a3406c150 msgr2=0x7f3a340cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 shutdown_connections 2023-07-06T01:10:03.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.698+0000 7f3a3b9ff700 1 -- 172.21.15.71:0/233133941 wait complete. 2023-07-06T01:10:03.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:10:03.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:10:03.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.915+0000 7f81b01ff700 1 Processor -- start 2023-07-06T01:10:03.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.915+0000 7f81b01ff700 1 -- start start 2023-07-06T01:10:03.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.916+0000 7f81b01ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81a815fca0 0x7f81a80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.916+0000 7f81b01ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81b01ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80cf780 con 0x7f81a80b60e0 2023-07-06T01:10:03.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81b01ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80cd490 con 0x7f81a815fca0 2023-07-06T01:10:03.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81b01ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80cd770 con 0x7f81a80b5c90 2023-07-06T01:10:03.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81a815fca0 0x7f81a80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81a815fca0 0x7f81a80d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55062/0 (socket says 172.21.15.71:55062) 2023-07-06T01:10:03.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 -- 172.21.15.71:0/2061950186 learned_addr learned my addr 172.21.15.71:0/2061950186 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:03.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81ad79a700 1 --2- 172.21.15.71:0/2061950186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 -- 172.21.15.71:0/2061950186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 msgr2=0x7f81a80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 --2- 172.21.15.71:0/2061950186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 -- 172.21.15.71:0/2061950186 >> v1:172.21.15.194:6789/0 conn(0x7f81a80b60e0 legacy=0x7f81a80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 -- 172.21.15.71:0/2061950186 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80cda50 con 0x7f81a815fca0 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.917+0000 7f81adf9b700 1 --2- 172.21.15.71:0/2061950186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a815fca0 0x7f81a80d1420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f81a40098f0 tx=0x7f81a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae51033f58172eda server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81acf99700 1 -- 172.21.15.71:0/2061950186 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400b8a0 con 0x7f81a815fca0 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81acf99700 1 -- 172.21.15.71:0/2061950186 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a400ba00 con 0x7f81a815fca0 2023-07-06T01:10:03.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81acf99700 1 -- 172.21.15.71:0/2061950186 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400bd90 con 0x7f81a815fca0 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 -- 172.21.15.71:0/2061950186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a815fca0 msgr2=0x7f81a80d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2061950186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a815fca0 0x7f81a80d1420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f81a40098f0 tx=0x7f81a4009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 -- 172.21.15.71:0/2061950186 shutdown_connections 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2061950186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a815fca0 0x7f81a80d1420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2061950186 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 -- 172.21.15.71:0/2061950186 >> 172.21.15.71:0/2061950186 conn(0x7f81a806c150 msgr2=0x7f81a806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:03.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 -- 172.21.15.71:0/2061950186 shutdown_connections 2023-07-06T01:10:03.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.918+0000 7f81b01ff700 1 -- 172.21.15.71:0/2061950186 wait complete. 2023-07-06T01:10:03.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.920+0000 7f81b01ff700 1 Processor -- start 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.920+0000 7f81b01ff700 1 -- start start 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81b01ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81b01ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 0x7f81a8149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81b01ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81a815fca0 0x7f81a81e8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81b01ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8147ae0 con 0x7f81a80b60e0 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81b01ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814a390 con 0x7f81a815fca0 2023-07-06T01:10:03.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81b01ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814a670 con 0x7f81a80b5c90 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81ad79a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 0x7f81a8149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81ad79a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 0x7f81a8149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55070/0 (socket says 172.21.15.71:55070) 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.921+0000 7f81ad79a700 1 -- 172.21.15.71:0/2038082476 learned_addr learned my addr 172.21.15.71:0/2038082476 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81ad79a700 1 -- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 msgr2=0x7f81a80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81ad79a700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81ad79a700 1 -- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81a815fca0 msgr2=0x7f81a81e8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81ad79a700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81a815fca0 0x7f81a81e8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:03.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81ad79a700 1 -- 172.21.15.71:0/2038082476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4009550 con 0x7f81a80b60e0 2023-07-06T01:10:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81ad79a700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 0x7f81a8149a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f819800e810 tx=0x7f819800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198013610 con 0x7f81a80b60e0 2023-07-06T01:10:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198013770 con 0x7f81a80b60e0 2023-07-06T01:10:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198013b20 con 0x7f81a80b60e0 2023-07-06T01:10:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a8147d50 con 0x7f81a80b60e0 2023-07-06T01:10:03.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.922+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a80c9110 con 0x7f81a80b60e0 2023-07-06T01:10:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.923+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a8147f70 con 0x7f81a80b60e0 2023-07-06T01:10:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.924+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8198013c80 con 0x7f81a80b60e0 2023-07-06T01:10:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.926+0000 7f819e7fc700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f818c06ace0 0x7f818c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:03.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.926+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8198088f40 con 0x7f81a80b60e0 2023-07-06T01:10:03.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.926+0000 7f81adf9b700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f818c06ace0 0x7f818c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:03.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.927+0000 7f81adf9b700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f818c06ace0 0x7f818c06d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81a4014040 tx=0x7f81a4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:03.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:03.930+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8198057d40 con 0x7f81a80b60e0 2023-07-06T01:10:04.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.127+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81a80008d0 con 0x7f81a80b60e0 2023-07-06T01:10:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.127+0000 7f819e7fc700 1 -- 172.21.15.71:0/2038082476 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81980210a0 con 0x7f81a80b60e0 2023-07-06T01:10:04.130 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:10:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f818c06ace0 msgr2=0x7f818c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f818c06ace0 0x7f818c06d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81a4014040 tx=0x7f81a4010000 comp rx=0 tx=0).stop 2023-07-06T01:10:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 msgr2=0x7f81a8149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 0x7f81a8149a70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f819800e810 tx=0x7f819800ebd0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 shutdown_connections 2023-07-06T01:10:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f818c06ace0 0x7f818c06d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81a815fca0 0x7f81a81e8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81a80b5c90 0x7f81a80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 --2- 172.21.15.71:0/2038082476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81a80b60e0 0x7f81a8149a70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 >> 172.21.15.71:0/2038082476 conn(0x7f81a806c150 msgr2=0x7f81a80cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 shutdown_connections 2023-07-06T01:10:04.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.130+0000 7f81b01ff700 1 -- 172.21.15.71:0/2038082476 wait complete. 2023-07-06T01:10:04.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:10:04.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.343+0000 7ff6a3dff700 1 Processor -- start 2023-07-06T01:10:04.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.344+0000 7ff6a3dff700 1 -- start start 2023-07-06T01:10:04.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a3dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff69c15fca0 0x7ff69c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a3dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a3dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0cf780 con 0x7ff69c0b5c90 2023-07-06T01:10:04.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a3dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0cd490 con 0x7ff69c15fca0 2023-07-06T01:10:04.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a3dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0cd770 con 0x7ff69c0b6110 2023-07-06T01:10:04.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff69c15fca0 0x7ff69c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff69c15fca0 0x7ff69c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55086/0 (socket says 172.21.15.71:55086) 2023-07-06T01:10:04.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 -- 172.21.15.71:0/3245108527 learned_addr learned my addr 172.21.15.71:0/3245108527 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:04.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a239c700 1 --2- 172.21.15.71:0/3245108527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 -- 172.21.15.71:0/3245108527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 msgr2=0x7ff69c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 --2- 172.21.15.71:0/3245108527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 -- 172.21.15.71:0/3245108527 >> v1:172.21.15.194:6789/0 conn(0x7ff69c0b5c90 legacy=0x7ff69c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.345+0000 7ff6a1b9b700 1 -- 172.21.15.71:0/3245108527 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0cda50 con 0x7ff69c15fca0 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.346+0000 7ff6a1b9b700 1 --2- 172.21.15.71:0/3245108527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0d1420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6980098f0 tx=0x7ff698009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3eb9ce0f36637f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.346+0000 7ff6a0b99700 1 -- 172.21.15.71:0/3245108527 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800b8a0 con 0x7ff69c15fca0 2023-07-06T01:10:04.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.346+0000 7ff6a0b99700 1 -- 172.21.15.71:0/3245108527 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69800ba00 con 0x7ff69c15fca0 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.346+0000 7ff6a0b99700 1 -- 172.21.15.71:0/3245108527 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800bd90 con 0x7ff69c15fca0 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.346+0000 7ff6a3dff700 1 -- 172.21.15.71:0/3245108527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 msgr2=0x7ff69c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.346+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/3245108527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0d1420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff6980098f0 tx=0x7ff698009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.347+0000 7ff6a3dff700 1 -- 172.21.15.71:0/3245108527 shutdown_connections 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.347+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/3245108527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.347+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/3245108527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0d1420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.347+0000 7ff6a3dff700 1 -- 172.21.15.71:0/3245108527 >> 172.21.15.71:0/3245108527 conn(0x7ff69c06c150 msgr2=0x7ff69c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:04.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.347+0000 7ff6a3dff700 1 -- 172.21.15.71:0/3245108527 shutdown_connections 2023-07-06T01:10:04.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.347+0000 7ff6a3dff700 1 -- 172.21.15.71:0/3245108527 wait complete. 2023-07-06T01:10:04.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.348+0000 7ff6a3dff700 1 Processor -- start 2023-07-06T01:10:04.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.349+0000 7ff6a3dff700 1 -- start start 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.349+0000 7ff6a3dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c0b5c90 0x7ff69c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.349+0000 7ff6a3dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a3dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a3dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c1f5f60 con 0x7ff69c15fca0 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a3dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c1f63f0 con 0x7ff69c0b5c90 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a3dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0c8ea0 con 0x7ff69c0b6110 2023-07-06T01:10:04.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55092/0 (socket says 172.21.15.71:55092) 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 -- 172.21.15.71:0/25768791 learned_addr learned my addr 172.21.15.71:0/25768791 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a1b9b700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c0b5c90 0x7ff69c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a139a700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 -- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 msgr2=0x7ff69c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 -- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c0b5c90 msgr2=0x7ff69c0c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c0b5c90 0x7ff69c0c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 -- 172.21.15.71:0/25768791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698009550 con 0x7ff69c15fca0 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.350+0000 7ff6a239c700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0b7a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff694007e70 tx=0x7ff69400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.351+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400ee50 con 0x7ff69c15fca0 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.351+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694014420 con 0x7ff69c15fca0 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.351+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c0ccd60 con 0x7ff69c15fca0 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.351+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940147d0 con 0x7ff69c15fca0 2023-07-06T01:10:04.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.351+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c1f5910 con 0x7ff69c15fca0 2023-07-06T01:10:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.352+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c1f6110 con 0x7ff69c15fca0 2023-07-06T01:10:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.353+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff694014930 con 0x7ff69c15fca0 2023-07-06T01:10:04.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.354+0000 7ff6927fc700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff68006ace0 0x7ff68006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.354+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff6940899a0 con 0x7ff69c15fca0 2023-07-06T01:10:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.355+0000 7ff6a1b9b700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff68006ace0 0x7ff68006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.356+0000 7ff6a1b9b700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff68006ace0 0x7ff68006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff698014040 tx=0x7ff698008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.359+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff69c1f6110 con 0x7ff69c15fca0 2023-07-06T01:10:04.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.553+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff69c1f6110 con 0x7ff69c15fca0 2023-07-06T01:10:04.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.554+0000 7ff6927fc700 1 -- 172.21.15.71:0/25768791 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff69c1f6110 con 0x7ff69c15fca0 2023-07-06T01:10:04.557 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:10:04.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff68006ace0 msgr2=0x7ff68006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff68006ace0 0x7ff68006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff698014040 tx=0x7ff698008030 comp rx=0 tx=0).stop 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 msgr2=0x7ff69c0b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0b7a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff694007e70 tx=0x7ff69400e3c0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 shutdown_connections 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff68006ace0 0x7ff68006d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c15fca0 0x7ff69c0b7a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff69c0b5c90 0x7ff69c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 --2- 172.21.15.71:0/25768791 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff69c0b6110 0x7ff69c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 >> 172.21.15.71:0/25768791 conn(0x7ff69c06c150 msgr2=0x7ff69c15a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 shutdown_connections 2023-07-06T01:10:04.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.556+0000 7ff6a3dff700 1 -- 172.21.15.71:0/25768791 wait complete. 2023-07-06T01:10:04.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T01:10:04.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.768+0000 7f0f769ff700 1 Processor -- start 2023-07-06T01:10:04.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.768+0000 7f0f769ff700 1 -- start start 2023-07-06T01:10:04.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.769+0000 7f0f769ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0f700b5c90 0x7f0f700d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f769ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f700b6110 0x7f0f700d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f769ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f700cf780 con 0x7f0f7015fca0 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f769ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f700cd490 con 0x7f0f700b5c90 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f769ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f700cd770 con 0x7f0f700b6110 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0f700b5c90 0x7f0f700d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0f700b5c90 0x7f0f700d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55108/0 (socket says 172.21.15.71:55108) 2023-07-06T01:10:04.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/1609705303 learned_addr learned my addr 172.21.15.71:0/1609705303 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:04.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f74f9c700 1 --2- 172.21.15.71:0/1609705303 >> v2:172.21.15.194:3300/0 conn(0x7f0f700b6110 0x7f0f700d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/1609705303 >> v2:172.21.15.194:3300/0 conn(0x7f0f700b6110 msgr2=0x7f0f700d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:04.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 --2- 172.21.15.71:0/1609705303 >> v2:172.21.15.194:3300/0 conn(0x7f0f700b6110 0x7f0f700d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/1609705303 >> v1:172.21.15.194:6789/0 conn(0x7f0f7015fca0 legacy=0x7f0f700d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.770+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/1609705303 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700cda50 con 0x7f0f700b5c90 2023-07-06T01:10:04.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.771+0000 7f0f6f7fe700 1 --2- 172.21.15.71:0/1609705303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b5c90 0x7f0f700d2d40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0f700cd410 tx=0x7f0f64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7754507a238fb58f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:04.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.772+0000 7f0f6effd700 1 -- 172.21.15.71:0/1609705303 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400b870 con 0x7f0f700b5c90 2023-07-06T01:10:04.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.772+0000 7f0f6effd700 1 -- 172.21.15.71:0/1609705303 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400b9d0 con 0x7f0f700b5c90 2023-07-06T01:10:04.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.772+0000 7f0f6effd700 1 -- 172.21.15.71:0/1609705303 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400bd60 con 0x7f0f700b5c90 2023-07-06T01:10:04.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 -- 172.21.15.71:0/1609705303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b5c90 msgr2=0x7f0f700d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 --2- 172.21.15.71:0/1609705303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b5c90 0x7f0f700d2d40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0f700cd410 tx=0x7f0f64009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 -- 172.21.15.71:0/1609705303 shutdown_connections 2023-07-06T01:10:04.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 --2- 172.21.15.71:0/1609705303 >> v2:172.21.15.194:3300/0 conn(0x7f0f700b6110 0x7f0f700d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 --2- 172.21.15.71:0/1609705303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b5c90 0x7f0f700d2d40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 -- 172.21.15.71:0/1609705303 >> 172.21.15.71:0/1609705303 conn(0x7f0f7006c150 msgr2=0x7f0f7006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:04.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 -- 172.21.15.71:0/1609705303 shutdown_connections 2023-07-06T01:10:04.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.773+0000 7f0f769ff700 1 -- 172.21.15.71:0/1609705303 wait complete. 2023-07-06T01:10:04.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.775+0000 7f0f769ff700 1 Processor -- start 2023-07-06T01:10:04.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.775+0000 7f0f769ff700 1 -- start start 2023-07-06T01:10:04.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f769ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f700b5c90 0x7f0f700c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f769ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 0x7f0f70157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f769ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7015fca0 0x7f0f700cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f769ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c7630 con 0x7f0f700b6110 2023-07-06T01:10:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f769ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c7f90 con 0x7f0f7015fca0 2023-07-06T01:10:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f769ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c69b0 con 0x7f0f700b5c90 2023-07-06T01:10:04.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 0x7f0f70157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 0x7f0f70157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55116/0 (socket says 172.21.15.71:55116) 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/766143276 learned_addr learned my addr 172.21.15.71:0/766143276 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f74f9c700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7015fca0 0x7f0f700cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6ffff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f700b5c90 0x7f0f700c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f700b5c90 msgr2=0x7f0f700c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f700b5c90 0x7f0f700c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7015fca0 msgr2=0x7f0f700cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7015fca0 0x7f0f700cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6f7fe700 1 -- 172.21.15.71:0/766143276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009550 con 0x7f0f700b6110 2023-07-06T01:10:04.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.776+0000 7f0f6ffff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f700b5c90 0x7f0f700c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:04.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.777+0000 7f0f6f7fe700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 0x7f0f70157300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:04.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.777+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004540 con 0x7f0f700b6110 2023-07-06T01:10:04.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.777+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640036a0 con 0x7f0f700b6110 2023-07-06T01:10:04.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.777+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f700c6c90 con 0x7f0f700b6110 2023-07-06T01:10:04.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.777+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64003a10 con 0x7f0f700b6110 2023-07-06T01:10:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.777+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f700c7250 con 0x7f0f700b6110 2023-07-06T01:10:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.778+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f700c7770 con 0x7f0f700b6110 2023-07-06T01:10:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.779+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f64021070 con 0x7f0f700b6110 2023-07-06T01:10:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.780+0000 7f0f6cff9700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f5c06ace0 0x7f0f5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:04.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.780+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f6408a7c0 con 0x7f0f700b6110 2023-07-06T01:10:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.780+0000 7f0f6ffff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f5c06ace0 0x7f0f5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:04.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.781+0000 7f0f6ffff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f5c06ace0 0x7f0f5c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0f60000f60 tx=0x7f0f60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:04.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.784+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f700c7770 con 0x7f0f700b6110 2023-07-06T01:10:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.980+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f700c7770 con 0x7f0f700b6110 2023-07-06T01:10:04.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.980+0000 7f0f6cff9700 1 -- 172.21.15.71:0/766143276 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0f64015090 con 0x7f0f700b6110 2023-07-06T01:10:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:04.984 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-07-06T01:10:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-07-06T01:10:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-07-06T01:10:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-07-06T01:10:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-07-06T01:10:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 2, 2023-07-06T01:10:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": "rbd" 2023-07-06T01:10:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-07-06T01:10:04.987 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-07-06T01:10:04.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f5c06ace0 msgr2=0x7f0f5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f5c06ace0 0x7f0f5c06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0f60000f60 tx=0x7f0f60009040 comp rx=0 tx=0).stop 2023-07-06T01:10:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 msgr2=0x7f0f70157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 0x7f0f70157300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f64004750 comp rx=0 tx=0).stop 2023-07-06T01:10:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 shutdown_connections 2023-07-06T01:10:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f5c06ace0 0x7f0f5c06d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f7015fca0 0x7f0f700cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f700b5c90 0x7f0f700c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 --2- 172.21.15.71:0/766143276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f700b6110 0x7f0f70157300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.982+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 >> 172.21.15.71:0/766143276 conn(0x7f0f7006c150 msgr2=0x7f0f700d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.983+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 shutdown_connections 2023-07-06T01:10:04.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:04.983+0000 7f0f769ff700 1 -- 172.21.15.71:0/766143276 wait complete. 2023-07-06T01:10:05.002 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T01:10:05.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T01:10:05.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.199+0000 7f1f485ff700 1 Processor -- start 2023-07-06T01:10:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.199+0000 7f1f485ff700 1 -- start start 2023-07-06T01:10:05.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.200+0000 7f1f485ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400b8440 0x7f1f400cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.200+0000 7f1f485ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f400cfe40 0x7f1f400d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.200+0000 7f1f485ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f40160cc0 con 0x7f1f400b2180 2023-07-06T01:10:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.200+0000 7f1f485ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f40160ae0 con 0x7f1f400cfe40 2023-07-06T01:10:05.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.200+0000 7f1f485ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40160f80 con 0x7f1f400b8440 2023-07-06T01:10:05.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f4639b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400b8440 0x7f1f400cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f46b9c700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f400cfe40 0x7f1f400d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f45b9a700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1f400b2180 0x7f1f400cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:42168/0 (socket says 172.21.15.71:42168) 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f4639b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400b8440 0x7f1f400cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:45044/0 (socket says 172.21.15.71:45044) 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f45b9a700 1 -- 172.21.15.71:0/3373013712 learned_addr learned my addr 172.21.15.71:0/3373013712 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f46b9c700 1 -- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400b8440 msgr2=0x7f1f400cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f46b9c700 1 --2- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400b8440 0x7f1f400cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f46b9c700 1 -- 172.21.15.71:0/3373013712 >> v1:172.21.15.194:6789/0 conn(0x7f1f400b2180 legacy=0x7f1f400cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f46b9c700 1 -- 172.21.15.71:0/3373013712 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400cf0e0 con 0x7f1f400cfe40 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.201+0000 7f1f46b9c700 1 --2- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400cfe40 0x7f1f400d0960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009d90 tx=0x7f1f3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c085ff5638845d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f45399700 1 -- 172.21.15.71:0/3373013712 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800e070 con 0x7f1f400cfe40 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f45399700 1 -- 172.21.15.71:0/3373013712 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3800bb20 con 0x7f1f400cfe40 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f45399700 1 -- 172.21.15.71:0/3373013712 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38012430 con 0x7f1f400cfe40 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 -- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400cfe40 msgr2=0x7f1f400d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400cfe40 0x7f1f400d0960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009d90 tx=0x7f1f3800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:05.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 -- 172.21.15.71:0/3373013712 shutdown_connections 2023-07-06T01:10:05.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400cfe40 0x7f1f400d0960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3373013712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400b8440 0x7f1f400cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 -- 172.21.15.71:0/3373013712 >> 172.21.15.71:0/3373013712 conn(0x7f1f4006be10 msgr2=0x7f1f40071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:05.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 -- 172.21.15.71:0/3373013712 shutdown_connections 2023-07-06T01:10:05.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.202+0000 7f1f485ff700 1 -- 172.21.15.71:0/3373013712 wait complete. 2023-07-06T01:10:05.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.204+0000 7f1f485ff700 1 Processor -- start 2023-07-06T01:10:05.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.204+0000 7f1f485ff700 1 -- start start 2023-07-06T01:10:05.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f485ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 0x7f1f40155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:05.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f485ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400b8440 0x7f1f40149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f485ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400cfe40 0x7f1f4015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f485ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f401e5f10 con 0x7f1f400b2180 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f485ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4015cf20 con 0x7f1f400b8440 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f485ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40149660 con 0x7f1f400cfe40 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f4639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 0x7f1f40155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f4639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 0x7f1f40155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55130/0 (socket says 172.21.15.71:55130) 2023-07-06T01:10:05.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.205+0000 7f1f4639b700 1 -- 172.21.15.71:0/3294969762 learned_addr learned my addr 172.21.15.71:0/3294969762 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f45b9a700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400b8440 0x7f1f40149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f4639b700 1 -- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400cfe40 msgr2=0x7f1f4015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f46b9c700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400cfe40 0x7f1f4015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f4639b700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400cfe40 0x7f1f4015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f4639b700 1 -- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400b8440 msgr2=0x7f1f40149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f4639b700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400b8440 0x7f1f40149120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f4639b700 1 -- 172.21.15.71:0/3294969762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38009a70 con 0x7f1f400b2180 2023-07-06T01:10:05.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f45b9a700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400b8440 0x7f1f40149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f46b9c700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400cfe40 0x7f1f4015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f4639b700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 0x7f1f40155fd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00e9b0 tx=0x7f1f3c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c009710 con 0x7f1f400b2180 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00c850 con 0x7f1f400b2180 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4015f3c0 con 0x7f1f400b2180 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00cbc0 con 0x7f1f400b2180 2023-07-06T01:10:05.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.206+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4015f970 con 0x7f1f400b2180 2023-07-06T01:10:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.208+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f400008d0 con 0x7f1f400b2180 2023-07-06T01:10:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.208+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f3c00cd20 con 0x7f1f400b2180 2023-07-06T01:10:05.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.209+0000 7f1f36ffd700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1f2406ace0 0x7f1f2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.209+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1f3c089240 con 0x7f1f400b2180 2023-07-06T01:10:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.210+0000 7f1f45b9a700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1f2406ace0 0x7f1f2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:05.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.211+0000 7f1f45b9a700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1f2406ace0 0x7f1f2406d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1f400d1160 tx=0x7f1f30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:05.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.213+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f3c0580d0 con 0x7f1f400b2180 2023-07-06T01:10:05.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.408+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1f400b5140 con 0x7f1f400b2180 2023-07-06T01:10:05.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.780+0000 7f1f36ffd700 1 -- 172.21.15.71:0/3294969762 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1f3c057c60 con 0x7f1f400b2180 2023-07-06T01:10:05.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1f2406ace0 msgr2=0x7f1f2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1f2406ace0 0x7f1f2406d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1f400d1160 tx=0x7f1f30009040 comp rx=0 tx=0).stop 2023-07-06T01:10:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 msgr2=0x7f1f40155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 0x7f1f40155fd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00e9b0 tx=0x7f1f3c00ed70 comp rx=0 tx=0).stop 2023-07-06T01:10:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 shutdown_connections 2023-07-06T01:10:05.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1f2406ace0 0x7f1f2406d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f400cfe40 0x7f1f4015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f400b2180 0x7f1f40155fd0 secure :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00e9b0 tx=0x7f1f3c00ed70 comp rx=0 tx=0).stop 2023-07-06T01:10:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 --2- 172.21.15.71:0/3294969762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f400b8440 0x7f1f40149120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:05.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.783+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 >> 172.21.15.71:0/3294969762 conn(0x7f1f4006be10 msgr2=0x7f1f400cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.784+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 shutdown_connections 2023-07-06T01:10:05.789 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:05.784+0000 7f1f485ff700 1 -- 172.21.15.71:0/3294969762 wait complete. 2023-07-06T01:10:05.790 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-07-06T01:10:05.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T01:10:06.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.009+0000 7f4afb7ff700 1 Processor -- start 2023-07-06T01:10:06.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.009+0000 7f4afb7ff700 1 -- start start 2023-07-06T01:10:06.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4afb7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4af40b5c90 0x7f4af40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:06.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4afb7ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4af40b6110 0x7f4af40d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:06.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4afb7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af40cf780 con 0x7f4af415fca0 2023-07-06T01:10:06.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4afb7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40cd490 con 0x7f4af40b5c90 2023-07-06T01:10:06.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4afb7ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40cd770 con 0x7f4af40b6110 2023-07-06T01:10:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4af8d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4af40b5c90 0x7f4af40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4af8d9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4af40b5c90 0x7f4af40d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55138/0 (socket says 172.21.15.71:55138) 2023-07-06T01:10:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4af8d9a700 1 -- 172.21.15.71:0/334764243 learned_addr learned my addr 172.21.15.71:0/334764243 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.010+0000 7f4af959b700 1 --1- 172.21.15.71:0/334764243 >> v1:172.21.15.71:6789/0 conn(0x7f4af415fca0 0x7f4af40d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48766/0 (socket says 172.21.15.71:48766) 2023-07-06T01:10:06.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4af9d9c700 1 --2- 172.21.15.71:0/334764243 >> v2:172.21.15.194:3300/0 conn(0x7f4af40b6110 0x7f4af40d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4af8d9a700 1 -- 172.21.15.71:0/334764243 >> v2:172.21.15.194:3300/0 conn(0x7f4af40b6110 msgr2=0x7f4af40d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4af8d9a700 1 --2- 172.21.15.71:0/334764243 >> v2:172.21.15.194:3300/0 conn(0x7f4af40b6110 0x7f4af40d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4af8d9a700 1 -- 172.21.15.71:0/334764243 >> v1:172.21.15.71:6789/0 conn(0x7f4af415fca0 legacy=0x7f4af40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4af8d9a700 1 -- 172.21.15.71:0/334764243 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af40cda50 con 0x7f4af40b5c90 2023-07-06T01:10:06.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4af8d9a700 1 --2- 172.21.15.71:0/334764243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b5c90 0x7f4af40d2d40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4af40cd410 tx=0x7f4ae4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5beb19a3601578a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4aebfff700 1 -- 172.21.15.71:0/334764243 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400b870 con 0x7f4af40b5c90 2023-07-06T01:10:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4aebfff700 1 -- 172.21.15.71:0/334764243 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae400b9d0 con 0x7f4af40b5c90 2023-07-06T01:10:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.011+0000 7f4aebfff700 1 -- 172.21.15.71:0/334764243 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400bd60 con 0x7f4af40b5c90 2023-07-06T01:10:06.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 -- 172.21.15.71:0/334764243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b5c90 msgr2=0x7f4af40d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/334764243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b5c90 0x7f4af40d2d40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4af40cd410 tx=0x7f4ae4009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 -- 172.21.15.71:0/334764243 shutdown_connections 2023-07-06T01:10:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/334764243 >> v2:172.21.15.194:3300/0 conn(0x7f4af40b6110 0x7f4af40d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/334764243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b5c90 0x7f4af40d2d40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 -- 172.21.15.71:0/334764243 >> 172.21.15.71:0/334764243 conn(0x7f4af406c150 msgr2=0x7f4af406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:06.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 -- 172.21.15.71:0/334764243 shutdown_connections 2023-07-06T01:10:06.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.012+0000 7f4afb7ff700 1 -- 172.21.15.71:0/334764243 wait complete. 2023-07-06T01:10:06.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.014+0000 7f4afb7ff700 1 Processor -- start 2023-07-06T01:10:06.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.014+0000 7f4afb7ff700 1 -- start start 2023-07-06T01:10:06.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4afb7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af40b5c90 0x7f4af414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:06.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4afb7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 0x7f4af415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4afb7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af415fca0 0x7f4af415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4afb7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40c7800 con 0x7f4af40b6110 2023-07-06T01:10:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4afb7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40c7c90 con 0x7f4af40b5c90 2023-07-06T01:10:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4afb7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af40c6910 con 0x7f4af415fca0 2023-07-06T01:10:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 0x7f4af415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:06.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 0x7f4af415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55148/0 (socket says 172.21.15.71:55148) 2023-07-06T01:10:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 -- 172.21.15.71:0/2389970823 learned_addr learned my addr 172.21.15.71:0/2389970823 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af959b700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af40b5c90 0x7f4af414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af9d9c700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af415fca0 0x7f4af415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 -- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af415fca0 msgr2=0x7f4af415aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af415fca0 0x7f4af415aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 -- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af40b5c90 msgr2=0x7f4af414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af40b5c90 0x7f4af414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.015+0000 7f4af8d9a700 1 -- 172.21.15.71:0/2389970823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009550 con 0x7f4af40b6110 2023-07-06T01:10:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4af959b700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af40b5c90 0x7f4af414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4af8d9a700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 0x7f4af415a4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000c00 tx=0x7f4ae4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4004540 con 0x7f4af40b6110 2023-07-06T01:10:06.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae40036a0 con 0x7f4af40b6110 2023-07-06T01:10:06.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af40c6bf0 con 0x7f4af40b6110 2023-07-06T01:10:06.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4003a30 con 0x7f4af40b6110 2023-07-06T01:10:06.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.016+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af40c71b0 con 0x7f4af40b6110 2023-07-06T01:10:06.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.017+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af40008d0 con 0x7f4af40b6110 2023-07-06T01:10:06.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.019+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ae4021070 con 0x7f4af40b6110 2023-07-06T01:10:06.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.019+0000 7f4ae9ffb700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ad806ace0 0x7f4ad806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:06.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.020+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f4ae408ada0 con 0x7f4af40b6110 2023-07-06T01:10:06.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.020+0000 7f4af959b700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ad806ace0 0x7f4ad806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:06.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.021+0000 7f4af959b700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ad806ace0 0x7f4ad806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000f60 tx=0x7f4af0007dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:06.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.023+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4ae40560c0 con 0x7f4af40b6110 2023-07-06T01:10:06.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.216+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4af40c7940 con 0x7f4af40b6110 2023-07-06T01:10:06.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.783+0000 7f4ae9ffb700 1 -- 172.21.15.71:0/2389970823 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4ae40596e0 con 0x7f4af40b6110 2023-07-06T01:10:06.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ad806ace0 msgr2=0x7f4ad806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ad806ace0 0x7f4ad806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000f60 tx=0x7f4af0007dd0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 msgr2=0x7f4af415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 0x7f4af415a4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000c00 tx=0x7f4ae4004750 comp rx=0 tx=0).stop 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 shutdown_connections 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f4ad806ace0 0x7f4ad806d190 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000f60 tx=0x7f4af0007dd0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4af415fca0 0x7f4af415aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4af40b5c90 0x7f4af414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 --2- 172.21.15.71:0/2389970823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4af40b6110 0x7f4af415a4f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.791+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 >> 172.21.15.71:0/2389970823 conn(0x7f4af406c150 msgr2=0x7f4af40b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.793+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 shutdown_connections 2023-07-06T01:10:06.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:06.795+0000 7f4afb7ff700 1 -- 172.21.15.71:0/2389970823 wait complete. 2023-07-06T01:10:06.801 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-07-06T01:10:06.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T01:10:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.017+0000 7f9e0a7ff700 1 Processor -- start 2023-07-06T01:10:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.018+0000 7f9e0a7ff700 1 -- start start 2023-07-06T01:10:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e0a7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e0415fca0 0x7f9e040d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e0a7ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e040b5c90 0x7f9e040d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e0a7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e040d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e0a7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040cf780 con 0x7f9e0415fca0 2023-07-06T01:10:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e0a7ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e040cd490 con 0x7f9e040b5c90 2023-07-06T01:10:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e0a7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040cd770 con 0x7f9e040b6110 2023-07-06T01:10:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e0415fca0 0x7f9e040d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e0415fca0 0x7f9e040d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55158/0 (socket says 172.21.15.71:55158) 2023-07-06T01:10:07.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e03fff700 1 -- 172.21.15.71:0/3350598582 learned_addr learned my addr 172.21.15.71:0/3350598582 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e037fe700 1 --2- 172.21.15.71:0/3350598582 >> v2:172.21.15.194:3300/0 conn(0x7f9e040b5c90 0x7f9e040d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.019+0000 7f9e08d9c700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e040d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e03fff700 1 -- 172.21.15.71:0/3350598582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 msgr2=0x7f9e040d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e03fff700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e040d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e03fff700 1 -- 172.21.15.71:0/3350598582 >> v2:172.21.15.194:3300/0 conn(0x7f9e040b5c90 msgr2=0x7f9e040d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e03fff700 1 --2- 172.21.15.71:0/3350598582 >> v2:172.21.15.194:3300/0 conn(0x7f9e040b5c90 0x7f9e040d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e03fff700 1 -- 172.21.15.71:0/3350598582 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040cda50 con 0x7f9e0415fca0 2023-07-06T01:10:07.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e08d9c700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e040d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e03fff700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e0415fca0 0x7f9e040d1420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e0406b6f0 tx=0x7f9df4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebda7b4efa44d5e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e02ffd700 1 -- 172.21.15.71:0/3350598582 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011830 con 0x7f9e0415fca0 2023-07-06T01:10:07.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e02ffd700 1 -- 172.21.15.71:0/3350598582 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4011990 con 0x7f9e0415fca0 2023-07-06T01:10:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.020+0000 7f9e02ffd700 1 -- 172.21.15.71:0/3350598582 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011d20 con 0x7f9e0415fca0 2023-07-06T01:10:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3350598582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e0415fca0 msgr2=0x7f9e040d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e0415fca0 0x7f9e040d1420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e0406b6f0 tx=0x7f9df4009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3350598582 shutdown_connections 2023-07-06T01:10:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e040d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3350598582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e0415fca0 0x7f9e040d1420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3350598582 >> v2:172.21.15.194:3300/0 conn(0x7f9e040b5c90 0x7f9e040d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3350598582 >> 172.21.15.71:0/3350598582 conn(0x7f9e0406c150 msgr2=0x7f9e0406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3350598582 shutdown_connections 2023-07-06T01:10:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.021+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3350598582 wait complete. 2023-07-06T01:10:07.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.022+0000 7f9e0a7ff700 1 Processor -- start 2023-07-06T01:10:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.023+0000 7f9e0a7ff700 1 -- start start 2023-07-06T01:10:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e0a7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 0x7f9e041f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e0a7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e04159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e0a7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e0415fca0 0x7f9e041f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e0a7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041f6490 con 0x7f9e040b5c90 2023-07-06T01:10:07.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e0a7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041f5ed0 con 0x7f9e0415fca0 2023-07-06T01:10:07.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e0a7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e041f61b0 con 0x7f9e040b6110 2023-07-06T01:10:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 0x7f9e041f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 0x7f9e041f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55168/0 (socket says 172.21.15.71:55168) 2023-07-06T01:10:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 -- 172.21.15.71:0/3933149575 learned_addr learned my addr 172.21.15.71:0/3933149575 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:07.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e037fe700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e04159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e08d9c700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e0415fca0 0x7f9e041f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 -- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 msgr2=0x7f9e04159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:07.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e04159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 -- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e0415fca0 msgr2=0x7f9e041f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e0415fca0 0x7f9e041f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 -- 172.21.15.71:0/3933149575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009550 con 0x7f9e040b5c90 2023-07-06T01:10:07.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e08d9c700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e0415fca0 0x7f9e041f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:07.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.024+0000 7f9e03fff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 0x7f9e041f55f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c00 tx=0x7f9df4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:07.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.025+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4004300 con 0x7f9e040b5c90 2023-07-06T01:10:07.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.025+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df401f070 con 0x7f9e040b5c90 2023-07-06T01:10:07.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.025+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0415b8d0 con 0x7f9e040b5c90 2023-07-06T01:10:07.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.025+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40036a0 con 0x7f9e040b5c90 2023-07-06T01:10:07.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.025+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e041f5b30 con 0x7f9e040b5c90 2023-07-06T01:10:07.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.026+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040008d0 con 0x7f9e040b5c90 2023-07-06T01:10:07.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.027+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9df4021030 con 0x7f9e040b5c90 2023-07-06T01:10:07.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.028+0000 7f9e00ff9700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9df006ace0 0x7f9df006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:07.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.028+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f9df408a9d0 con 0x7f9e040b5c90 2023-07-06T01:10:07.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.029+0000 7f9e037fe700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9df006ace0 0x7f9df006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:07.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.029+0000 7f9e037fe700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9df006ace0 0x7f9df006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e040b7310 tx=0x7f9df8009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:07.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.032+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9df4055c50 con 0x7f9e040b5c90 2023-07-06T01:10:07.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.269+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9e040d06b0 con 0x7f9e040b5c90 2023-07-06T01:10:07.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.808+0000 7f9e00ff9700 1 -- 172.21.15.71:0/3933149575 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9df4059270 con 0x7f9e040b5c90 2023-07-06T01:10:07.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9df006ace0 msgr2=0x7f9df006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:07.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9df006ace0 0x7f9df006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9e040b7310 tx=0x7f9df8009210 comp rx=0 tx=0).stop 2023-07-06T01:10:07.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 msgr2=0x7f9e041f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:07.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 0x7f9e041f55f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c00 tx=0x7f9df4004750 comp rx=0 tx=0).stop 2023-07-06T01:10:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 shutdown_connections 2023-07-06T01:10:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9df006ace0 0x7f9df006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e0415fca0 0x7f9e041f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e040b5c90 0x7f9e041f55f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 --2- 172.21.15.71:0/3933149575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e040b6110 0x7f9e04159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:07.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.816+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 >> 172.21.15.71:0/3933149575 conn(0x7f9e0406c150 msgr2=0x7f9e040d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:07.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.818+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 shutdown_connections 2023-07-06T01:10:07.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:07.819+0000 7f9e0a7ff700 1 -- 172.21.15.71:0/3933149575 wait complete. 2023-07-06T01:10:07.824 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 5 and data pool 6 2023-07-06T01:10:07.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.038+0000 7f2f63fff700 1 Processor -- start 2023-07-06T01:10:08.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.038+0000 7f2f63fff700 1 -- start start 2023-07-06T01:10:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.039+0000 7f2f63fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c15fca0 0x7f2f5c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.039+0000 7f2f63fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f5c0b6100 0x7f2f5c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.039+0000 7f2f63fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c0cf780 con 0x7f2f5c0b5c90 2023-07-06T01:10:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.039+0000 7f2f63fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c0cd490 con 0x7f2f5c0b6100 2023-07-06T01:10:08.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.039+0000 7f2f63fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0cd770 con 0x7f2f5c15fca0 2023-07-06T01:10:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f61d9b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c15fca0 0x7f2f5c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6259c700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f5c0b6100 0x7f2f5c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6159a700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2f5c0b5c90 0x7f2f5c0d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:42180/0 (socket says 172.21.15.71:42180) 2023-07-06T01:10:08.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6159a700 1 -- 172.21.15.71:0/1596627059 learned_addr learned my addr 172.21.15.71:0/1596627059 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f60d99700 1 -- 172.21.15.71:0/1596627059 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110148311 0 0) 0x7f2f5c0cf780 con 0x7f2f5c0b5c90 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f60d99700 1 -- 172.21.15.71:0/1596627059 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f480035b0 con 0x7f2f5c0b5c90 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6259c700 1 -- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c15fca0 msgr2=0x7f2f5c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6259c700 1 --2- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c15fca0 0x7f2f5c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6259c700 1 -- 172.21.15.71:0/1596627059 >> v1:172.21.15.194:6789/0 conn(0x7f2f5c0b5c90 legacy=0x7f2f5c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6259c700 1 -- 172.21.15.71:0/1596627059 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0cda50 con 0x7f2f5c0b6100 2023-07-06T01:10:08.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.040+0000 7f2f6259c700 1 --2- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c0cfc10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009d90 tx=0x7f2f5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac5465df00b3df1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f60d99700 1 -- 172.21.15.71:0/1596627059 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400e070 con 0x7f2f5c0b6100 2023-07-06T01:10:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f60d99700 1 -- 172.21.15.71:0/1596627059 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400bb20 con 0x7f2f5c0b6100 2023-07-06T01:10:08.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f60d99700 1 -- 172.21.15.71:0/1596627059 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54012430 con 0x7f2f5c0b6100 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 -- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c0b6100 msgr2=0x7f2f5c0cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 --2- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c0cfc10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009d90 tx=0x7f2f5400b330 comp rx=0 tx=0).stop 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 -- 172.21.15.71:0/1596627059 shutdown_connections 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 --2- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c0cfc10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 --2- 172.21.15.71:0/1596627059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c15fca0 0x7f2f5c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 -- 172.21.15.71:0/1596627059 >> 172.21.15.71:0/1596627059 conn(0x7f2f5c06c150 msgr2=0x7f2f5c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:08.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 -- 172.21.15.71:0/1596627059 shutdown_connections 2023-07-06T01:10:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.041+0000 7f2f63fff700 1 -- 172.21.15.71:0/1596627059 wait complete. 2023-07-06T01:10:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.043+0000 7f2f63fff700 1 Processor -- start 2023-07-06T01:10:08.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.043+0000 7f2f63fff700 1 -- start start 2023-07-06T01:10:08.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f63fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c0b5c90 0x7f2f5c1f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f63fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f63fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c15fca0 0x7f2f5c148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f63fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0cb910 con 0x7f2f5c0b6100 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f63fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c149000 con 0x7f2f5c15fca0 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f63fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c1492a0 con 0x7f2f5c0b5c90 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f6159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f6159a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55176/0 (socket says 172.21.15.71:55176) 2023-07-06T01:10:08.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f6159a700 1 -- 172.21.15.71:0/3881300518 learned_addr learned my addr 172.21.15.71:0/3881300518 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f61d9b700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c0b5c90 0x7f2f5c1f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.044+0000 7f2f6259c700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c15fca0 0x7f2f5c148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f6159a700 1 -- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c0b5c90 msgr2=0x7f2f5c1f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f6159a700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c0b5c90 0x7f2f5c1f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f6159a700 1 -- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c15fca0 msgr2=0x7f2f5c148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f6159a700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c15fca0 0x7f2f5c148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f6159a700 1 -- 172.21.15.71:0/3881300518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009a70 con 0x7f2f5c0b6100 2023-07-06T01:10:08.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f6159a700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c146a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c700 tx=0x7f2f4c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c005d70 con 0x7f2f5c0b6100 2023-07-06T01:10:08.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0070d0 con 0x7f2f5c0b6100 2023-07-06T01:10:08.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c007460 con 0x7f2f5c0b6100 2023-07-06T01:10:08.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c149580 con 0x7f2f5c0b6100 2023-07-06T01:10:08.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.045+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c0cbb20 con 0x7f2f5c0b6100 2023-07-06T01:10:08.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.046+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c0008d0 con 0x7f2f5c0b6100 2023-07-06T01:10:08.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.048+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f4c0075c0 con 0x7f2f5c0b6100 2023-07-06T01:10:08.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.048+0000 7f2f527fc700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f4006ace0 0x7f2f4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.049+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f4c0889a0 con 0x7f2f5c0b6100 2023-07-06T01:10:08.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.049+0000 7f2f61d9b700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f4006ace0 0x7f2f4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.050+0000 7f2f61d9b700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f4006ace0 0x7f2f4006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009b40 tx=0x7f2f58009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.053+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f4c0539b0 con 0x7f2f5c0b6100 2023-07-06T01:10:08.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.247+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f5c0b2cd0 con 0x7f2f5c0b6100 2023-07-06T01:10:08.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.249+0000 7f2f527fc700 1 -- 172.21.15.71:0/3881300518 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f2f4c017090 con 0x7f2f5c0b6100 2023-07-06T01:10:08.251 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:08.252 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":35,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:07.270907+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:08.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f4006ace0 msgr2=0x7f2f4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f4006ace0 0x7f2f4006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009b40 tx=0x7f2f58009210 comp rx=0 tx=0).stop 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 msgr2=0x7f2f5c146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c146a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00c700 tx=0x7f2f4c00ca10 comp rx=0 tx=0).stop 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 shutdown_connections 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f2f4006ace0 0x7f2f4006d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f5c15fca0 0x7f2f5c148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f5c0b5c90 0x7f2f5c1f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 --2- 172.21.15.71:0/3881300518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f5c0b6100 0x7f2f5c146a30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 >> 172.21.15.71:0/3881300518 conn(0x7f2f5c06c150 msgr2=0x7f2f5c0d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 shutdown_connections 2023-07-06T01:10:08.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.251+0000 7f2f63fff700 1 -- 172.21.15.71:0/3881300518 wait complete. 2023-07-06T01:10:08.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:08.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.463+0000 7fdd303ff700 1 Processor -- start 2023-07-06T01:10:08.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.464+0000 7fdd303ff700 1 -- start start 2023-07-06T01:10:08.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd303ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd2815c790 0x7fdd280cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd303ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd280d0220 0x7fdd28069f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd303ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd280ce6f0 con 0x7fdd2806a4a0 2023-07-06T01:10:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd303ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280d06c0 con 0x7fdd280d0220 2023-07-06T01:10:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd303ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280ca500 con 0x7fdd2815c790 2023-07-06T01:10:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd2d99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd280d0220 0x7fdd28069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd2d99a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd280d0220 0x7fdd28069f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55192/0 (socket says 172.21.15.71:55192) 2023-07-06T01:10:08.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd2d99a700 1 -- 172.21.15.71:0/3725603668 learned_addr learned my addr 172.21.15.71:0/3725603668 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.465+0000 7fdd2e19b700 1 --2- 172.21.15.71:0/3725603668 >> v2:172.21.15.194:3300/0 conn(0x7fdd2815c790 0x7fdd280cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d99a700 1 -- 172.21.15.71:0/3725603668 >> v2:172.21.15.194:3300/0 conn(0x7fdd2815c790 msgr2=0x7fdd280cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d99a700 1 --2- 172.21.15.71:0/3725603668 >> v2:172.21.15.194:3300/0 conn(0x7fdd2815c790 0x7fdd280cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d99a700 1 -- 172.21.15.71:0/3725603668 >> v1:172.21.15.194:6789/0 conn(0x7fdd2806a4a0 legacy=0x7fdd28160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d99a700 1 -- 172.21.15.71:0/3725603668 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280cf920 con 0x7fdd280d0220 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2e19b700 1 --2- 172.21.15.71:0/3725603668 >> v2:172.21.15.194:3300/0 conn(0x7fdd2815c790 0x7fdd280cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:08.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d99a700 1 --2- 172.21.15.71:0/3725603668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd280d0220 0x7fdd28069f60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdd28070610 tx=0x7fdd18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d5d19c2614d4df server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d199700 1 -- 172.21.15.71:0/3725603668 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800b870 con 0x7fdd280d0220 2023-07-06T01:10:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d199700 1 -- 172.21.15.71:0/3725603668 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1800b9d0 con 0x7fdd280d0220 2023-07-06T01:10:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.466+0000 7fdd2d199700 1 -- 172.21.15.71:0/3725603668 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800bd60 con 0x7fdd280d0220 2023-07-06T01:10:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 -- 172.21.15.71:0/3725603668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd280d0220 msgr2=0x7fdd28069f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 --2- 172.21.15.71:0/3725603668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd280d0220 0x7fdd28069f60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdd28070610 tx=0x7fdd18009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.472 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 -- 172.21.15.71:0/3725603668 shutdown_connections 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 --2- 172.21.15.71:0/3725603668 >> v2:172.21.15.194:3300/0 conn(0x7fdd2815c790 0x7fdd280cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 --2- 172.21.15.71:0/3725603668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd280d0220 0x7fdd28069f60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 -- 172.21.15.71:0/3725603668 >> 172.21.15.71:0/3725603668 conn(0x7fdd280b22f0 msgr2=0x7fdd280cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 -- 172.21.15.71:0/3725603668 shutdown_connections 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.467+0000 7fdd303ff700 1 -- 172.21.15.71:0/3725603668 wait complete. 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.469+0000 7fdd303ff700 1 Processor -- start 2023-07-06T01:10:08.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.469+0000 7fdd303ff700 1 -- start start 2023-07-06T01:10:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd303ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 0x7fdd280b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd303ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280d0220 0x7fdd280ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd303ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd2815c790 0x7fdd280c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd303ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28146a90 con 0x7fdd2806a4a0 2023-07-06T01:10:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd303ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28146d70 con 0x7fdd2815c790 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd303ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28147050 con 0x7fdd280d0220 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 0x7fdd280b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 0x7fdd280b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55208/0 (socket says 172.21.15.71:55208) 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 -- 172.21.15.71:0/351771547 learned_addr learned my addr 172.21.15.71:0/351771547 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2d99a700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280d0220 0x7fdd280ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e99c700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd2815c790 0x7fdd280c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 -- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280d0220 msgr2=0x7fdd280ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280d0220 0x7fdd280ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 -- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd2815c790 msgr2=0x7fdd280c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd2815c790 0x7fdd280c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.471+0000 7fdd2e19b700 1 -- 172.21.15.71:0/351771547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18009550 con 0x7fdd2806a4a0 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.472+0000 7fdd2e19b700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 0x7fdd280b29c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400e810 tx=0x7fdd2400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.472+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400c020 con 0x7fdd2806a4a0 2023-07-06T01:10:08.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.472+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24004250 con 0x7fdd2806a4a0 2023-07-06T01:10:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.472+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240036a0 con 0x7fdd2806a4a0 2023-07-06T01:10:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.472+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd28147330 con 0x7fdd2806a4a0 2023-07-06T01:10:08.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.472+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd280c5940 con 0x7fdd2806a4a0 2023-07-06T01:10:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.473+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28147850 con 0x7fdd2806a4a0 2023-07-06T01:10:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.474+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd24003800 con 0x7fdd2806a4a0 2023-07-06T01:10:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.475+0000 7fdd1effd700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdd0c06ace0 0x7fdd0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.475+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdd24088ef0 con 0x7fdd2806a4a0 2023-07-06T01:10:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.475+0000 7fdd2d99a700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdd0c06ace0 0x7fdd0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.476+0000 7fdd2d99a700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdd0c06ace0 0x7fdd0c06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdd18000c00 tx=0x7fdd18008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.479+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd28147850 con 0x7fdd2806a4a0 2023-07-06T01:10:08.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.678+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd280008d0 con 0x7fdd2806a4a0 2023-07-06T01:10:08.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.679+0000 7fdd1effd700 1 -- 172.21.15.71:0/351771547 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18340 (secure 0 0 0) 0x7fdd24057a30 con 0x7fdd2806a4a0 2023-07-06T01:10:08.682 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:08.682 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":35,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:07.270907+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdd0c06ace0 msgr2=0x7fdd0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdd0c06ace0 0x7fdd0c06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdd18000c00 tx=0x7fdd18008030 comp rx=0 tx=0).stop 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 msgr2=0x7fdd280b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 0x7fdd280b29c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400e810 tx=0x7fdd2400eb20 comp rx=0 tx=0).stop 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 shutdown_connections 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdd0c06ace0 0x7fdd0c06d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd2815c790 0x7fdd280c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd2806a4a0 0x7fdd280b29c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 --2- 172.21.15.71:0/351771547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd280d0220 0x7fdd280ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 >> 172.21.15.71:0/351771547 conn(0x7fdd280b22f0 msgr2=0x7fdd28073060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 shutdown_connections 2023-07-06T01:10:08.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.682+0000 7fdd303ff700 1 -- 172.21.15.71:0/351771547 wait complete. 2023-07-06T01:10:08.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T01:10:08.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.899+0000 7fc32e7ff700 1 Processor -- start 2023-07-06T01:10:08.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.900+0000 7fc32e7ff700 1 -- start start 2023-07-06T01:10:08.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc32e7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc32e7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280cf780 con 0x7fc3280b5c90 2023-07-06T01:10:08.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc32e7ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280cd490 con 0x7fc3280b6100 2023-07-06T01:10:08.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc32e7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280cd770 con 0x7fc32815fca0 2023-07-06T01:10:08.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc3277fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc3280b5c90 0x7fc3280d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48768/0 (socket says 172.21.15.71:48768) 2023-07-06T01:10:08.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc3277fe700 1 -- 172.21.15.71:0/374372253 learned_addr learned my addr 172.21.15.71:0/374372253 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:08.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc327fff700 1 --2- 172.21.15.71:0/374372253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.901+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309066859 0 0) 0x7fc3280cf780 con 0x7fc3280b5c90 2023-07-06T01:10:08.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3100035b0 con 0x7fc3280b5c90 2023-07-06T01:10:08.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655328217 0 0) 0x7fc3280cd490 con 0x7fc3280b6100 2023-07-06T01:10:08.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3280cf780 con 0x7fc3280b6100 2023-07-06T01:10:08.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc327fff700 1 -- 172.21.15.71:0/374372253 >> v1:172.21.15.194:6789/0 conn(0x7fc3280b6100 legacy=0x7fc3280cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc327fff700 1 -- 172.21.15.71:0/374372253 >> v1:172.21.15.71:6789/0 conn(0x7fc3280b5c90 legacy=0x7fc3280d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc327fff700 1 -- 172.21.15.71:0/374372253 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280cda50 con 0x7fc32815fca0 2023-07-06T01:10:08.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc327fff700 1 --2- 172.21.15.71:0/374372253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280d1420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc318009870 tx=0x7fc318009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f078f2b7672dd858 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011830 con 0x7fc32815fca0 2023-07-06T01:10:08.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318011990 con 0x7fc32815fca0 2023-07-06T01:10:08.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.902+0000 7fc326ffd700 1 -- 172.21.15.71:0/374372253 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011d20 con 0x7fc32815fca0 2023-07-06T01:10:08.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 -- 172.21.15.71:0/374372253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 msgr2=0x7fc3280d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/374372253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280d1420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc318009870 tx=0x7fc318009b80 comp rx=0 tx=0).stop 2023-07-06T01:10:08.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 -- 172.21.15.71:0/374372253 shutdown_connections 2023-07-06T01:10:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/374372253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280d1420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 -- 172.21.15.71:0/374372253 >> 172.21.15.71:0/374372253 conn(0x7fc32806c150 msgr2=0x7fc32806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:08.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 -- 172.21.15.71:0/374372253 shutdown_connections 2023-07-06T01:10:08.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.903+0000 7fc32e7ff700 1 -- 172.21.15.71:0/374372253 wait complete. 2023-07-06T01:10:08.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.905+0000 7fc32e7ff700 1 Processor -- start 2023-07-06T01:10:08.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.905+0000 7fc32e7ff700 1 -- start start 2023-07-06T01:10:08.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32e7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3280b5c90 0x7fc3281574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32e7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 0x7fc32815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32e7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32e7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32815d0a0 con 0x7fc3280b6100 2023-07-06T01:10:08.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32e7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32815c140 con 0x7fc3280b5c90 2023-07-06T01:10:08.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32e7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32815c420 con 0x7fc32815fca0 2023-07-06T01:10:08.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 0x7fc32815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 0x7fc32815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55210/0 (socket says 172.21.15.71:55210) 2023-07-06T01:10:08.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 -- 172.21.15.71:0/2435547267 learned_addr learned my addr 172.21.15.71:0/2435547267 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:08.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc327fff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3280b5c90 0x7fc3281574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc32cd9c700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 -- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 msgr2=0x7fc3280b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 -- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3280b5c90 msgr2=0x7fc3281574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3280b5c90 0x7fc3281574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:08.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.906+0000 7fc3277fe700 1 -- 172.21.15.71:0/2435547267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180094a0 con 0x7fc3280b6100 2023-07-06T01:10:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.907+0000 7fc3277fe700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 0x7fc32815b730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c700 tx=0x7fc31c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.907+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c005d70 con 0x7fc3280b6100 2023-07-06T01:10:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.907+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c0070d0 con 0x7fc3280b6100 2023-07-06T01:10:08.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.907+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c007460 con 0x7fc3280b6100 2023-07-06T01:10:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.907+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32815c700 con 0x7fc3280b6100 2023-07-06T01:10:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.907+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281f2230 con 0x7fc3280b6100 2023-07-06T01:10:08.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.908+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3280b2730 con 0x7fc3280b6100 2023-07-06T01:10:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.909+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc31c0075c0 con 0x7fc3280b6100 2023-07-06T01:10:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.910+0000 7fc324ff9700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc31406ad10 0x7fc31406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:08.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.910+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc31c088810 con 0x7fc3280b6100 2023-07-06T01:10:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.911+0000 7fc327fff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc31406ad10 0x7fc31406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:08.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.911+0000 7fc327fff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc31406ad10 0x7fc31406d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3180090b0 tx=0x7fc31801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:08.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:08.915+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc31c053950 con 0x7fc3280b6100 2023-07-06T01:10:09.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.154+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc32815cf00 con 0x7fc3280b6100 2023-07-06T01:10:09.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.811+0000 7fc324ff9700 1 -- 172.21.15.71:0/2435547267 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc32815cf00 con 0x7fc3280b6100 2023-07-06T01:10:09.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc31406ad10 msgr2=0x7fc31406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:09.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc31406ad10 0x7fc31406d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3180090b0 tx=0x7fc31801c040 comp rx=0 tx=0).stop 2023-07-06T01:10:09.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 msgr2=0x7fc32815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:09.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 0x7fc32815b730 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c700 tx=0x7fc31c00ca10 comp rx=0 tx=0).stop 2023-07-06T01:10:09.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 shutdown_connections 2023-07-06T01:10:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc31406ad10 0x7fc31406d1c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc32815fca0 0x7fc3280b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3280b5c90 0x7fc3281574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:09.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 --2- 172.21.15.71:0/2435547267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3280b6100 0x7fc32815b730 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:09.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.813+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 >> 172.21.15.71:0/2435547267 conn(0x7fc32806c150 msgr2=0x7fc32815a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:09.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.814+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 shutdown_connections 2023-07-06T01:10:09.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:09.814+0000 7fc32e7ff700 1 -- 172.21.15.71:0/2435547267 wait complete. 2023-07-06T01:10:09.834 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T01:10:09.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T01:10:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.030+0000 7ff2ce3ff700 1 Processor -- start 2023-07-06T01:10:10.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.030+0000 7ff2ce3ff700 1 -- start start 2023-07-06T01:10:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.031+0000 7ff2ce3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2c815fca0 0x7ff2c80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2ce3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c80cf780 con 0x7ff2c80b6110 2023-07-06T01:10:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2ce3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c80cd490 con 0x7ff2c80b5c90 2023-07-06T01:10:10.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2ce3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80cd770 con 0x7ff2c815fca0 2023-07-06T01:10:10.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2c7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2c815fca0 0x7ff2c80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2cc99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff2c80b6110 0x7ff2c80cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48774/0 (socket says 172.21.15.71:48774) 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2cc99c700 1 -- 172.21.15.71:0/2101475521 learned_addr learned my addr 172.21.15.71:0/2101475521 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2c7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff2c815fca0 0x7ff2c80d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55218/0 (socket says 172.21.15.71:55218) 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2c7fff700 1 -- 172.21.15.71:0/2101475521 >> v1:172.21.15.194:6789/0 conn(0x7ff2c80b5c90 legacy=0x7ff2c80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2c7fff700 1 -- 172.21.15.71:0/2101475521 >> v1:172.21.15.71:6789/0 conn(0x7ff2c80b6110 legacy=0x7ff2c80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.032+0000 7ff2c7fff700 1 -- 172.21.15.71:0/2101475521 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c80cda50 con 0x7ff2c815fca0 2023-07-06T01:10:10.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2c7fff700 1 --2- 172.21.15.71:0/2101475521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80d1420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009840 tx=0x7ff2b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57582944dc9b9d23 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:10.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2c6ffd700 1 -- 172.21.15.71:0/2101475521 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8004230 con 0x7ff2c815fca0 2023-07-06T01:10:10.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2c6ffd700 1 -- 172.21.15.71:0/2101475521 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8004390 con 0x7ff2c815fca0 2023-07-06T01:10:10.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2c6ffd700 1 -- 172.21.15.71:0/2101475521 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80036a0 con 0x7ff2c815fca0 2023-07-06T01:10:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/2101475521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 msgr2=0x7ff2c80d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/2101475521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80d1420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009840 tx=0x7ff2b8009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.033+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/2101475521 shutdown_connections 2023-07-06T01:10:10.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.034+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/2101475521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80d1420 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.034+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/2101475521 >> 172.21.15.71:0/2101475521 conn(0x7ff2c806c150 msgr2=0x7ff2c806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.034+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/2101475521 shutdown_connections 2023-07-06T01:10:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.034+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/2101475521 wait complete. 2023-07-06T01:10:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.035+0000 7ff2ce3ff700 1 Processor -- start 2023-07-06T01:10:10.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.035+0000 7ff2ce3ff700 1 -- start start 2023-07-06T01:10:10.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.036+0000 7ff2ce3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2c80b5c90 0x7ff2c8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:10.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.036+0000 7ff2ce3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2c80b6110 0x7ff2c815b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:10.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.036+0000 7ff2ce3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:10.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.036+0000 7ff2ce3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80c6930 con 0x7ff2c815fca0 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.036+0000 7ff2ce3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c8157360 con 0x7ff2c80b6110 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.036+0000 7ff2ce3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c815bea0 con 0x7ff2c80b5c90 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55226/0 (socket says 172.21.15.71:55226) 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 -- 172.21.15.71:0/1854060832 learned_addr learned my addr 172.21.15.71:0/1854060832 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2c7fff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2c80b5c90 0x7ff2c8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:10.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2c77fe700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2c80b6110 0x7ff2c815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:10.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 -- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2c80b5c90 msgr2=0x7ff2c8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2c80b5c90 0x7ff2c8156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 -- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2c80b6110 msgr2=0x7ff2c815b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2c80b6110 0x7ff2c815b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 -- 172.21.15.71:0/1854060832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b80094a0 con 0x7ff2c815fca0 2023-07-06T01:10:10.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.037+0000 7ff2cc99c700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80cbe50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0001fd0 tx=0x7ff2c000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.038+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000acb0 con 0x7ff2c815fca0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.038+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000ae10 con 0x7ff2c815fca0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.038+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0007310 con 0x7ff2c815fca0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.038+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c80cc8a0 con 0x7ff2c815fca0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.038+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c80c6b80 con 0x7ff2c815fca0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.039+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80008d0 con 0x7ff2c815fca0 2023-07-06T01:10:10.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.040+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff2c0007470 con 0x7ff2c815fca0 2023-07-06T01:10:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.041+0000 7ff2c4ff9700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff2b406ace0 0x7ff2b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.041+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff2c0088fe0 con 0x7ff2c815fca0 2023-07-06T01:10:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.041+0000 7ff2c7fff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff2b406ace0 0x7ff2b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:10.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.042+0000 7ff2c7fff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff2b406ace0 0x7ff2b406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80090b0 tx=0x7ff2b8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:10.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.045+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff2c0054050 con 0x7ff2c815fca0 2023-07-06T01:10:10.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.282+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff2c80b2a60 con 0x7ff2c815fca0 2023-07-06T01:10:10.696 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-07-06T01:10:10.693+0000 7f472cff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T01:10:10.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.813+0000 7ff2c4ff9700 1 -- 172.21.15.71:0/1854060832 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff2c0057670 con 0x7ff2c815fca0 2023-07-06T01:10:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff2b406ace0 msgr2=0x7ff2b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff2b406ace0 0x7ff2b406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80090b0 tx=0x7ff2b8008030 comp rx=0 tx=0).stop 2023-07-06T01:10:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 msgr2=0x7ff2c80cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:10.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80cbe50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0001fd0 tx=0x7ff2c000a340 comp rx=0 tx=0).stop 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 shutdown_connections 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7ff2b406ace0 0x7ff2b406d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2c815fca0 0x7ff2c80cbe50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2c80b5c90 0x7ff2c8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 --2- 172.21.15.71:0/1854060832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2c80b6110 0x7ff2c815b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 >> 172.21.15.71:0/1854060832 conn(0x7ff2c806c150 msgr2=0x7ff2c80b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:10.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 shutdown_connections 2023-07-06T01:10:10.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:10.816+0000 7ff2ce3ff700 1 -- 172.21.15.71:0/1854060832 wait complete. 2023-07-06T01:10:10.883 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T01:10:10.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:10:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.075+0000 7f26353ff700 1 Processor -- start 2023-07-06T01:10:11.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.075+0000 7f26353ff700 1 -- start start 2023-07-06T01:10:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.076+0000 7f26353ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f26300b5c90 0x7f26300d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.076+0000 7f26353ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26300b6110 0x7f26300d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.076+0000 7f26353ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300cf780 con 0x7f263015fca0 2023-07-06T01:10:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.076+0000 7f26353ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300cd490 con 0x7f26300b6110 2023-07-06T01:10:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.076+0000 7f26353ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300cd770 con 0x7f26300b5c90 2023-07-06T01:10:11.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26300b6110 0x7f26300d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f26300b6110 0x7f26300d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55238/0 (socket says 172.21.15.71:55238) 2023-07-06T01:10:11.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 -- 172.21.15.71:0/2551305422 learned_addr learned my addr 172.21.15.71:0/2551305422 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f2627fff700 1 --2- 172.21.15.71:0/2551305422 >> v2:172.21.15.194:3300/0 conn(0x7f26300b5c90 0x7f26300d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 -- 172.21.15.71:0/2551305422 >> v2:172.21.15.194:3300/0 conn(0x7f26300b5c90 msgr2=0x7f26300d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 --2- 172.21.15.71:0/2551305422 >> v2:172.21.15.194:3300/0 conn(0x7f26300b5c90 0x7f26300d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 -- 172.21.15.71:0/2551305422 >> v1:172.21.15.194:6789/0 conn(0x7f263015fca0 legacy=0x7f26300d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 -- 172.21.15.71:0/2551305422 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300cda50 con 0x7f26300b6110 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.077+0000 7f262f7fe700 1 --2- 172.21.15.71:0/2551305422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b6110 0x7f26300d3280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f263006b6f0 tx=0x7f262800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bede4fb2ef3c1a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f262e7fc700 1 -- 172.21.15.71:0/2551305422 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800e070 con 0x7f26300b6110 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f262e7fc700 1 -- 172.21.15.71:0/2551305422 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262800b9c0 con 0x7f26300b6110 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f262e7fc700 1 -- 172.21.15.71:0/2551305422 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800bd70 con 0x7f26300b6110 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 -- 172.21.15.71:0/2551305422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b6110 msgr2=0x7f26300d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 --2- 172.21.15.71:0/2551305422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b6110 0x7f26300d3280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f263006b6f0 tx=0x7f262800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:11.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 -- 172.21.15.71:0/2551305422 shutdown_connections 2023-07-06T01:10:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 --2- 172.21.15.71:0/2551305422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b6110 0x7f26300d3280 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 --2- 172.21.15.71:0/2551305422 >> v2:172.21.15.194:3300/0 conn(0x7f26300b5c90 0x7f26300d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 -- 172.21.15.71:0/2551305422 >> 172.21.15.71:0/2551305422 conn(0x7f263006c150 msgr2=0x7f263006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:11.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 -- 172.21.15.71:0/2551305422 shutdown_connections 2023-07-06T01:10:11.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.078+0000 7f26353ff700 1 -- 172.21.15.71:0/2551305422 wait complete. 2023-07-06T01:10:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.081+0000 7f26353ff700 1 Processor -- start 2023-07-06T01:10:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.081+0000 7f26353ff700 1 -- start start 2023-07-06T01:10:11.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f26353ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 0x7f26300c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f26353ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26300b6110 0x7f26300cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f26353ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f263015fca0 0x7f26300d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f26353ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300c7c20 con 0x7f26300b5c90 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f26353ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cc010 con 0x7f263015fca0 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f26353ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2630150e20 con 0x7f26300b6110 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f262effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 0x7f26300c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f262effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 0x7f26300c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55240/0 (socket says 172.21.15.71:55240) 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f262effd700 1 -- 172.21.15.71:0/1878217725 learned_addr learned my addr 172.21.15.71:0/1878217725 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f2627fff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26300b6110 0x7f26300cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.082+0000 7f262f7fe700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f263015fca0 0x7f26300d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262effd700 1 -- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26300b6110 msgr2=0x7f26300cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262effd700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26300b6110 0x7f26300cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262effd700 1 -- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f263015fca0 msgr2=0x7f26300d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262effd700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f263015fca0 0x7f26300d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262effd700 1 -- 172.21.15.71:0/1878217725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009b30 con 0x7f26300b5c90 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262f7fe700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f263015fca0 0x7f26300d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f2627fff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26300b6110 0x7f26300cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f262effd700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 0x7f26300c6930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f262000c450 tx=0x7f262000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200052d0 con 0x7f26300b5c90 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620005430 con 0x7f26300b5c90 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300c6fa0 con 0x7f26300b5c90 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26200038c0 con 0x7f26300b5c90 2023-07-06T01:10:11.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.083+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300c7560 con 0x7f26300b5c90 2023-07-06T01:10:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.084+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26300c7d60 con 0x7f26300b5c90 2023-07-06T01:10:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.085+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2620003a20 con 0x7f26300b5c90 2023-07-06T01:10:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.086+0000 7f26277fe700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261006ace0 0x7f261006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.086+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2620088790 con 0x7f26300b5c90 2023-07-06T01:10:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.087+0000 7f2627fff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261006ace0 0x7f261006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.087+0000 7f2627fff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261006ace0 0x7f261006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f26300cbbe0 tx=0x7f2618008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.091+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26200538d0 con 0x7f26300b5c90 2023-07-06T01:10:11.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.325+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26300c7ef0 con 0x7f26300b5c90 2023-07-06T01:10:11.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.326+0000 7f26277fe700 1 -- 172.21.15.71:0/1878217725 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f2620056ef0 con 0x7f26300b5c90 2023-07-06T01:10:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:11.329 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:10:07.271274+0000","modified":"2023-07-06T01:10:10.810493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6835/783929387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":783929387},{"type":"v1","addr":"172.21.15.71:6835","nonce":783929387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T01:10:11.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.328+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261006ace0 msgr2=0x7f261006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.328+0000 7f26353ff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261006ace0 0x7f261006d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f26300cbbe0 tx=0x7f2618008040 comp rx=0 tx=0).stop 2023-07-06T01:10:11.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.328+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 msgr2=0x7f26300c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.328+0000 7f26353ff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 0x7f26300c6930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f262000c450 tx=0x7f262000c810 comp rx=0 tx=0).stop 2023-07-06T01:10:11.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 shutdown_connections 2023-07-06T01:10:11.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261006ace0 0x7f261006d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f263015fca0 0x7f26300d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26300b5c90 0x7f26300c6930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 --2- 172.21.15.71:0/1878217725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26300b6110 0x7f26300cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 >> 172.21.15.71:0/1878217725 conn(0x7f263006c150 msgr2=0x7f263015a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 shutdown_connections 2023-07-06T01:10:11.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.329+0000 7f26353ff700 1 -- 172.21.15.71:0/1878217725 wait complete. 2023-07-06T01:10:11.334 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 16 2023-07-06T01:10:11.349 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:11.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.543+0000 7fc483fff700 1 Processor -- start 2023-07-06T01:10:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.543+0000 7fc483fff700 1 -- start start 2023-07-06T01:10:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.544+0000 7fc483fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc47c0b6110 0x7fc47c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.544+0000 7fc483fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0cf780 con 0x7fc47c15fca0 2023-07-06T01:10:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.544+0000 7fc483fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0cd490 con 0x7fc47c0b5c90 2023-07-06T01:10:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.544+0000 7fc483fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0cd770 con 0x7fc47c0b6110 2023-07-06T01:10:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.544+0000 7fc481d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc47c15fca0 0x7fc47c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48776/0 (socket says 172.21.15.71:48776) 2023-07-06T01:10:11.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.544+0000 7fc481d9b700 1 -- 172.21.15.71:0/1442295266 learned_addr learned my addr 172.21.15.71:0/1442295266 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc48259c700 1 --2- 172.21.15.71:0/1442295266 >> v2:172.21.15.194:3300/0 conn(0x7fc47c0b6110 0x7fc47c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446715662 0 0) 0x7fc47c0cf780 con 0x7fc47c15fca0 2023-07-06T01:10:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4680035b0 con 0x7fc47c15fca0 2023-07-06T01:10:11.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329438660 0 0) 0x7fc4680035b0 con 0x7fc47c15fca0 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 >> v2:172.21.15.194:3300/0 conn(0x7fc47c0b6110 msgr2=0x7fc47c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 --2- 172.21.15.71:0/1442295266 >> v2:172.21.15.194:3300/0 conn(0x7fc47c0b6110 0x7fc47c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 >> v1:172.21.15.194:6789/0 conn(0x7fc47c0b5c90 legacy=0x7fc47c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0cda50 con 0x7fc47c15fca0 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fc478001670 con 0x7fc47c15fca0 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 >> v1:172.21.15.71:6789/0 conn(0x7fc47c15fca0 legacy=0x7fc47c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc468003a00 0x7fc468003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4680043f0 0x7fc4680048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc46800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0cd770 con 0x7fc4680050b0 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46800c000 con 0x7fc4680043f0 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46800c1c0 con 0x7fc468003a00 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc48259c700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc46800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.545+0000 7fc481d9b700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc468003a00 0x7fc468003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48159a700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4680043f0 0x7fc4680048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 -- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc468003a00 msgr2=0x7fc468003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc468003a00 0x7fc468003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 -- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4680043f0 msgr2=0x7fc4680048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4680043f0 0x7fc4680048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 -- 172.21.15.71:0/1442295266 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680035b0 con 0x7fc4680050b0 2023-07-06T01:10:11.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 -- 172.21.15.71:0/1442295266 reap_dead start 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc48259c700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc46800ba10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fc0 tx=0x7fc468005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a0217b3f6f46b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474003a20 con 0x7fc4680050b0 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47400f040 con 0x7fc4680050b0 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.546+0000 7fc480d99700 1 -- 172.21.15.71:0/1442295266 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474003de0 con 0x7fc4680050b0 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 -- 172.21.15.71:0/1442295266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 msgr2=0x7fc46800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc46800ba10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fc0 tx=0x7fc468005880 comp rx=0 tx=0).stop 2023-07-06T01:10:11.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 -- 172.21.15.71:0/1442295266 shutdown_connections 2023-07-06T01:10:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 --2- 172.21.15.71:0/1442295266 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc46800ba10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 -- 172.21.15.71:0/1442295266 >> 172.21.15.71:0/1442295266 conn(0x7fc47c06c150 msgr2=0x7fc47c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:11.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 -- 172.21.15.71:0/1442295266 shutdown_connections 2023-07-06T01:10:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.547+0000 7fc483fff700 1 -- 172.21.15.71:0/1442295266 wait complete. 2023-07-06T01:10:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.549+0000 7fc483fff700 1 Processor -- start 2023-07-06T01:10:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.549+0000 7fc483fff700 1 -- start start 2023-07-06T01:10:11.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc483fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc47c150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc483fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc47c151980 0x7fc47c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc483fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc47c151df0 0x7fc47c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc483fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0cad30 con 0x7fc4680050b0 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc483fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c150aa0 con 0x7fc47c151980 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc483fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0ca0b0 con 0x7fc47c151df0 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc47c150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc47c150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55258/0 (socket says 172.21.15.71:55258) 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 -- 172.21.15.71:0/833813238 learned_addr learned my addr 172.21.15.71:0/833813238 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc48259c700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc47c151df0 0x7fc47c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc48159a700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc47c151980 0x7fc47c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 -- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc47c151df0 msgr2=0x7fc47c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc47c151df0 0x7fc47c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 -- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc47c151980 msgr2=0x7fc47c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc47c151980 0x7fc47c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.550+0000 7fc481d9b700 1 -- 172.21.15.71:0/833813238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0ca390 con 0x7fc4680050b0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.551+0000 7fc481d9b700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc47c150560 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4780072f0 tx=0x7fc478007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.551+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800f5e0 con 0x7fc4680050b0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.551+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800f760 con 0x7fc4680050b0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.551+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c0ca670 con 0x7fc4680050b0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.551+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800fb10 con 0x7fc4680050b0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.551+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c0cc540 con 0x7fc4680050b0 2023-07-06T01:10:11.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.552+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c0cae70 con 0x7fc4680050b0 2023-07-06T01:10:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.553+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc47800fc70 con 0x7fc4680050b0 2023-07-06T01:10:11.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.554+0000 7fc4727fc700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc46006ace0 0x7fc46006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.554+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc478088e40 con 0x7fc4680050b0 2023-07-06T01:10:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.554+0000 7fc48159a700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc46006ace0 0x7fc46006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.555+0000 7fc48159a700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc46006ace0 0x7fc46006d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0cca30 tx=0x7fc46c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.558+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc47c0cae70 con 0x7fc4680050b0 2023-07-06T01:10:11.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.755+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc47c0cae70 con 0x7fc4680050b0 2023-07-06T01:10:11.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.756+0000 7fc4727fc700 1 -- 172.21.15.71:0/833813238 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18327 (secure 0 0 0) 0x7fc47c0cae70 con 0x7fc4680050b0 2023-07-06T01:10:11.759 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:11.759 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":36,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:08.799855+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc46006ace0 msgr2=0x7fc46006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc46006ace0 0x7fc46006d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0cca30 tx=0x7fc46c009040 comp rx=0 tx=0).stop 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 msgr2=0x7fc47c150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc47c150560 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4780072f0 tx=0x7fc478007600 comp rx=0 tx=0).stop 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 shutdown_connections 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc46006ace0 0x7fc46006d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc47c151df0 0x7fc47c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4680050b0 0x7fc47c150560 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 --2- 172.21.15.71:0/833813238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc47c151980 0x7fc47c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 >> 172.21.15.71:0/833813238 conn(0x7fc47c06c150 msgr2=0x7fc47c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 shutdown_connections 2023-07-06T01:10:11.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.759+0000 7fc483fff700 1 -- 172.21.15.71:0/833813238 wait complete. 2023-07-06T01:10:11.780 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T01:10:11.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:11.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.972+0000 7f26385ff700 1 Processor -- start 2023-07-06T01:10:11.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.973+0000 7f26385ff700 1 -- start start 2023-07-06T01:10:11.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f26385ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f26300d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f26385ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f26300b6100 0x7f26300cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f26385ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300cf780 con 0x7f26300b5c90 2023-07-06T01:10:11.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f26385ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300cd490 con 0x7f26300b6100 2023-07-06T01:10:11.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f26385ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cd770 con 0x7f263015fca0 2023-07-06T01:10:11.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f2635b9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f26300b5c90 0x7f26300d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48782/0 (socket says 172.21.15.71:48782) 2023-07-06T01:10:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f2635b9a700 1 -- 172.21.15.71:0/1531951023 learned_addr learned my addr 172.21.15.71:0/1531951023 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f2636b9c700 1 --2- 172.21.15.71:0/1531951023 >> v2:172.21.15.194:3300/0 conn(0x7f26300b6100 0x7f26300cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f263639b700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f26300d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.974+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660169191 0 0) 0x7f26300cf780 con 0x7f26300b5c90 2023-07-06T01:10:11.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f261c0035b0 con 0x7f26300b5c90 2023-07-06T01:10:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3021149288 0 0) 0x7f261c0035b0 con 0x7f26300b5c90 2023-07-06T01:10:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 msgr2=0x7f26300d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f26300d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 >> v2:172.21.15.194:3300/0 conn(0x7f26300b6100 msgr2=0x7f26300cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 --2- 172.21.15.71:0/1531951023 >> v2:172.21.15.194:3300/0 conn(0x7f26300b6100 0x7f26300cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300cda50 con 0x7f26300b5c90 2023-07-06T01:10:11.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f2620001670 con 0x7f26300b5c90 2023-07-06T01:10:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 >> v1:172.21.15.71:6789/0 conn(0x7f26300b5c90 legacy=0x7f26300d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f261c003a00 0x7f261c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f261c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f261c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cd490 con 0x7f261c004430 2023-07-06T01:10:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cd770 con 0x7f261c003a00 2023-07-06T01:10:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c00ba10 con 0x7f263015fca0 2023-07-06T01:10:11.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2635b9a700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f261c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f263639b700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f261c003a00 0x7f261c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.975+0000 7f2636b9c700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f261c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635b9a700 1 -- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 msgr2=0x7f261c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635b9a700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f261c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635b9a700 1 -- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f261c003a00 msgr2=0x7f261c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635b9a700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f261c003a00 0x7f261c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635b9a700 1 -- 172.21.15.71:0/1531951023 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0035b0 con 0x7f261c004430 2023-07-06T01:10:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2636b9c700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f263015fca0 0x7f261c004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635b9a700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f261c0048f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f262000c320 tx=0x7f261c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab49708218072c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000ce60 con 0x7f261c004430 2023-07-06T01:10:11.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2620005960 con 0x7f261c004430 2023-07-06T01:10:11.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.976+0000 7f2635399700 1 -- 172.21.15.71:0/1531951023 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620005cf0 con 0x7f261c004430 2023-07-06T01:10:11.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f26385ff700 1 -- 172.21.15.71:0/1531951023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 msgr2=0x7f261c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f26385ff700 1 --2- 172.21.15.71:0/1531951023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f261c0048f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f262000c320 tx=0x7f261c005880 comp rx=0 tx=0).stop 2023-07-06T01:10:11.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f2636b9c700 1 -- 172.21.15.71:0/1531951023 reap_dead start 2023-07-06T01:10:11.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f26385ff700 1 -- 172.21.15.71:0/1531951023 shutdown_connections 2023-07-06T01:10:11.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f26385ff700 1 -- 172.21.15.71:0/1531951023 >> 172.21.15.71:0/1531951023 conn(0x7f263006c150 msgr2=0x7f263006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:11.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f26385ff700 1 -- 172.21.15.71:0/1531951023 shutdown_connections 2023-07-06T01:10:11.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.977+0000 7f26385ff700 1 -- 172.21.15.71:0/1531951023 wait complete. 2023-07-06T01:10:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.979+0000 7f26385ff700 1 Processor -- start 2023-07-06T01:10:11.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.979+0000 7f26385ff700 1 -- start start 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f26385ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f26301f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f26385ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2630150f80 0x7f26300cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f26385ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26301408e0 0x7f26300b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f26385ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cc3d0 con 0x7f261c004430 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f26385ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cb520 con 0x7f26301408e0 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f26385ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300ccd30 con 0x7f2630150f80 2023-07-06T01:10:11.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f26301f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f26301f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55284/0 (socket says 172.21.15.71:55284) 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 -- 172.21.15.71:0/100468173 learned_addr learned my addr 172.21.15.71:0/100468173 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f2636b9c700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26301408e0 0x7f26300b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f2635b9a700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2630150f80 0x7f26300cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 -- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2630150f80 msgr2=0x7f26300cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2630150f80 0x7f26300cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 -- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26301408e0 msgr2=0x7f26300b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:11.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26301408e0 0x7f26300b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f263639b700 1 -- 172.21.15.71:0/100468173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300cb750 con 0x7f261c004430 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.980+0000 7f2635b9a700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2630150f80 0x7f26300cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.981+0000 7f263639b700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f26301f5170 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f262c0119d0 tx=0x7f262c011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.981+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00f940 con 0x7f261c004430 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.981+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c00faa0 con 0x7f261c004430 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.981+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c00fe30 con 0x7f261c004430 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.981+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300cba30 con 0x7f261c004430 2023-07-06T01:10:11.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.981+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300cbff0 con 0x7f261c004430 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.982+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26300008d0 con 0x7f261c004430 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.983+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f262c014440 con 0x7f261c004430 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.984+0000 7f2626ffd700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261406ace0 0x7f261406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.984+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f262c089ac0 con 0x7f261c004430 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.984+0000 7f2635b9a700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261406ace0 0x7f261406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.985+0000 7f2635b9a700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261406ace0 0x7f261406d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2620008fd0 tx=0x7f262000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:11.988+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f262c054c10 con 0x7f261c004430 2023-07-06T01:10:12.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.179+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f263006ae40 con 0x7f261406ace0 2023-07-06T01:10:12.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.191+0000 7f2626ffd700 1 -- 172.21.15.71:0/100468173 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300464 (secure 0 0 0) 0x7f262000cde0 con 0x7f261406ace0 2023-07-06T01:10:12.197 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261406ace0 msgr2=0x7f261406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261406ace0 0x7f261406d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2620008fd0 tx=0x7f262000a000 comp rx=0 tx=0).stop 2023-07-06T01:10:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 msgr2=0x7f26301f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f26301f5170 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f262c0119d0 tx=0x7f262c011ce0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 shutdown_connections 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f261406ace0 0x7f261406d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26301408e0 0x7f26300b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f261c004430 0x7f26301f5170 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 --2- 172.21.15.71:0/100468173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2630150f80 0x7f26300cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.195+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 >> 172.21.15.71:0/100468173 conn(0x7f263006c150 msgr2=0x7f26300b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.196+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 shutdown_connections 2023-07-06T01:10:12.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.196+0000 7f26385ff700 1 -- 172.21.15.71:0/100468173 wait complete. 2023-07-06T01:10:12.201 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:12.216 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-07-06T01:10:10.850793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219628,"kb_used_data":4012,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755092,"statfs":{"total":773094113280,"available":772869214208,"internally_reserved":0,"allocated":4108288,"data_stored":2344374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071715"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.787096+0000","last_change":"2023-07-06T01:10:06.787096+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.787096+0000","last_undegraded":"2023-07-06T01:10:06.787096+0000","last_fullsized":"2023-07-06T01:10:06.787096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.796146+0000","last_change":"2023-07-06T01:10:06.796146+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.796146+0000","last_undegraded":"2023-07-06T01:10:06.796146+0000","last_fullsized":"2023-07-06T01:10:06.796146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.787298+0000","last_change":"2023-07-06T01:10:06.787298+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.787298+0000","last_undegraded":"2023-07-06T01:10:06.787298+0000","last_fullsized":"2023-07-06T01:10:06.787298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.803333+0000","last_change":"2023-07-06T01:10:06.803333+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.803333+0000","last_undegraded":"2023-07-06T01:10:06.803333+0000","last_fullsized":"2023-07-06T01:10:06.803333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.799326+0000","last_change":"2023-07-06T01:10:06.799326+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.799326+0000","last_undegraded":"2023-07-06T01:10:06.799326+0000","last_fullsized":"2023-07-06T01:10:06.799326+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786883+0000","last_change":"2023-07-06T01:10:06.786883+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786883+0000","last_undegraded":"2023-07-06T01:10:06.786883+0000","last_fullsized":"2023-07-06T01:10:06.786883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.803260+0000","last_change":"2023-07-06T01:10:06.803260+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.803260+0000","last_undegraded":"2023-07-06T01:10:06.803260+0000","last_fullsized":"2023-07-06T01:10:06.803260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.796623+0000","last_change":"2023-07-06T01:10:06.796623+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.796623+0000","last_undegraded":"2023-07-06T01:10:06.796623+0000","last_fullsized":"2023-07-06T01:10:06.796623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.802834+0000","last_change":"2023-07-06T01:10:06.802834+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.802834+0000","last_undegraded":"2023-07-06T01:10:06.802834+0000","last_fullsized":"2023-07-06T01:10:06.802834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.797735+0000","last_change":"2023-07-06T01:10:06.797735+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.797735+0000","last_undegraded":"2023-07-06T01:10:06.797735+0000","last_fullsized":"2023-07-06T01:10:06.797735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785242+0000","last_change":"2023-07-06T01:10:05.785242+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785242+0000","last_undegraded":"2023-07-06T01:10:05.785242+0000","last_fullsized":"2023-07-06T01:10:05.785242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.793941+0000","last_change":"2023-07-06T01:10:06.790212+0000","last_active":"2023-07-06T01:10:06.793941+0000","last_peered":"2023-07-06T01:10:06.793941+0000","last_clean":"2023-07-06T01:10:06.793941+0000","last_became_active":"2023-07-06T01:10:06.789874+0000","last_became_peered":"2023-07-06T01:10:06.789874+0000","last_unstale":"2023-07-06T01:10:06.793941+0000","last_undegraded":"2023-07-06T01:10:06.793941+0000","last_fullsized":"2023-07-06T01:10:06.793941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:09.370389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.780936+0000","last_change":"2023-07-06T01:10:05.780936+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.780936+0000","last_undegraded":"2023-07-06T01:10:05.780936+0000","last_fullsized":"2023-07-06T01:10:05.780936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.784180+0000","last_change":"2023-07-06T01:10:05.784180+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.784180+0000","last_undegraded":"2023-07-06T01:10:05.784180+0000","last_fullsized":"2023-07-06T01:10:05.784180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786860+0000","last_change":"2023-07-06T01:10:06.786860+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786860+0000","last_undegraded":"2023-07-06T01:10:06.786860+0000","last_fullsized":"2023-07-06T01:10:06.786860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813243+0000","last_change":"2023-07-06T01:10:06.809079+0000","last_active":"2023-07-06T01:10:06.813243+0000","last_peered":"2023-07-06T01:10:06.813243+0000","last_clean":"2023-07-06T01:10:06.813243+0000","last_became_active":"2023-07-06T01:10:06.808787+0000","last_became_peered":"2023-07-06T01:10:06.808787+0000","last_unstale":"2023-07-06T01:10:06.813243+0000","last_undegraded":"2023-07-06T01:10:06.813243+0000","last_fullsized":"2023-07-06T01:10:06.813243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:37.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.795000+0000","last_change":"2023-07-06T01:10:06.795000+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.795000+0000","last_undegraded":"2023-07-06T01:10:06.795000+0000","last_fullsized":"2023-07-06T01:10:06.795000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785802+0000","last_change":"2023-07-06T01:10:05.785802+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785802+0000","last_undegraded":"2023-07-06T01:10:05.785802+0000","last_fullsized":"2023-07-06T01:10:05.785802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.780945+0000","last_change":"2023-07-06T01:10:05.780945+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.780945+0000","last_undegraded":"2023-07-06T01:10:05.780945+0000","last_fullsized":"2023-07-06T01:10:05.780945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785533+0000","last_change":"2023-07-06T01:10:05.785533+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785533+0000","last_undegraded":"2023-07-06T01:10:05.785533+0000","last_fullsized":"2023-07-06T01:10:05.785533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788658+0000","last_change":"2023-07-06T01:10:05.788658+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788658+0000","last_undegraded":"2023-07-06T01:10:05.788658+0000","last_fullsized":"2023-07-06T01:10:05.788658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.816829+0000","last_change":"2023-07-06T01:10:06.813577+0000","last_active":"2023-07-06T01:10:06.816829+0000","last_peered":"2023-07-06T01:10:06.816829+0000","last_clean":"2023-07-06T01:10:06.816829+0000","last_became_active":"2023-07-06T01:10:06.813302+0000","last_became_peered":"2023-07-06T01:10:06.813302+0000","last_unstale":"2023-07-06T01:10:06.816829+0000","last_undegraded":"2023-07-06T01:10:06.816829+0000","last_fullsized":"2023-07-06T01:10:06.816829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:17.128137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786368+0000","last_change":"2023-07-06T01:10:06.786368+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786368+0000","last_undegraded":"2023-07-06T01:10:06.786368+0000","last_fullsized":"2023-07-06T01:10:06.786368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813224+0000","last_change":"2023-07-06T01:10:06.808682+0000","last_active":"2023-07-06T01:10:06.813224+0000","last_peered":"2023-07-06T01:10:06.813224+0000","last_clean":"2023-07-06T01:10:06.813224+0000","last_became_active":"2023-07-06T01:10:06.808373+0000","last_became_peered":"2023-07-06T01:10:06.808373+0000","last_unstale":"2023-07-06T01:10:06.813224+0000","last_undegraded":"2023-07-06T01:10:06.813224+0000","last_fullsized":"2023-07-06T01:10:06.813224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:19.000518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788735+0000","last_change":"2023-07-06T01:10:05.788735+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788735+0000","last_undegraded":"2023-07-06T01:10:05.788735+0000","last_fullsized":"2023-07-06T01:10:05.788735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786319+0000","last_change":"2023-07-06T01:10:06.786319+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786319+0000","last_undegraded":"2023-07-06T01:10:06.786319+0000","last_fullsized":"2023-07-06T01:10:06.786319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788699+0000","last_change":"2023-07-06T01:10:05.788699+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788699+0000","last_undegraded":"2023-07-06T01:10:05.788699+0000","last_fullsized":"2023-07-06T01:10:05.788699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.781213+0000","last_change":"2023-07-06T01:10:05.781213+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.781213+0000","last_undegraded":"2023-07-06T01:10:05.781213+0000","last_fullsized":"2023-07-06T01:10:05.781213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785272+0000","last_change":"2023-07-06T01:10:05.785272+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785272+0000","last_undegraded":"2023-07-06T01:10:05.785272+0000","last_fullsized":"2023-07-06T01:10:05.785272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.786896+0000","last_change":"2023-07-06T01:10:05.786896+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.786896+0000","last_undegraded":"2023-07-06T01:10:05.786896+0000","last_fullsized":"2023-07-06T01:10:05.786896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813215+0000","last_change":"2023-07-06T01:10:06.808881+0000","last_active":"2023-07-06T01:10:06.813215+0000","last_peered":"2023-07-06T01:10:06.813215+0000","last_clean":"2023-07-06T01:10:06.813215+0000","last_became_active":"2023-07-06T01:10:06.808508+0000","last_became_peered":"2023-07-06T01:10:06.808508+0000","last_unstale":"2023-07-06T01:10:06.813215+0000","last_undegraded":"2023-07-06T01:10:06.813215+0000","last_fullsized":"2023-07-06T01:10:06.813215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:44:54.508249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.799789+0000","last_change":"2023-07-06T01:10:06.799789+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.799789+0000","last_undegraded":"2023-07-06T01:10:06.799789+0000","last_fullsized":"2023-07-06T01:10:06.799789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.786038+0000","last_change":"2023-07-06T01:10:05.786038+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.786038+0000","last_undegraded":"2023-07-06T01:10:05.786038+0000","last_fullsized":"2023-07-06T01:10:05.786038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793233+0000","last_change":"2023-07-06T01:10:05.793233+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793233+0000","last_undegraded":"2023-07-06T01:10:05.793233+0000","last_fullsized":"2023-07-06T01:10:05.793233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.781012+0000","last_change":"2023-07-06T01:10:05.781012+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.781012+0000","last_undegraded":"2023-07-06T01:10:05.781012+0000","last_fullsized":"2023-07-06T01:10:05.781012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793287+0000","last_change":"2023-07-06T01:10:05.793287+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793287+0000","last_undegraded":"2023-07-06T01:10:05.793287+0000","last_fullsized":"2023-07-06T01:10:05.793287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.785948+0000","last_change":"2023-07-06T01:10:06.785948+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.785948+0000","last_undegraded":"2023-07-06T01:10:06.785948+0000","last_fullsized":"2023-07-06T01:10:06.785948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793233+0000","last_change":"2023-07-06T01:10:05.793233+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793233+0000","last_undegraded":"2023-07-06T01:10:05.793233+0000","last_fullsized":"2023-07-06T01:10:05.793233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.798205+0000","last_change":"2023-07-06T01:10:06.798205+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.798205+0000","last_undegraded":"2023-07-06T01:10:06.798205+0000","last_fullsized":"2023-07-06T01:10:06.798205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.786225+0000","last_change":"2023-07-06T01:10:05.786225+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.786225+0000","last_undegraded":"2023-07-06T01:10:05.786225+0000","last_fullsized":"2023-07-06T01:10:05.786225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793127+0000","last_change":"2023-07-06T01:10:05.793127+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793127+0000","last_undegraded":"2023-07-06T01:10:05.793127+0000","last_fullsized":"2023-07-06T01:10:05.793127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.785867+0000","last_change":"2023-07-06T01:10:06.785867+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.785867+0000","last_undegraded":"2023-07-06T01:10:06.785867+0000","last_fullsized":"2023-07-06T01:10:06.785867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.800868+0000","last_change":"2023-07-06T01:10:06.797438+0000","last_active":"2023-07-06T01:10:06.800868+0000","last_peered":"2023-07-06T01:10:06.800868+0000","last_clean":"2023-07-06T01:10:06.800868+0000","last_became_active":"2023-07-06T01:10:06.796874+0000","last_became_peered":"2023-07-06T01:10:06.796874+0000","last_unstale":"2023-07-06T01:10:06.800868+0000","last_undegraded":"2023-07-06T01:10:06.800868+0000","last_fullsized":"2023-07-06T01:10:06.800868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:21.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.781770+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:05.781770+0000","last_peered":"2023-07-06T01:10:05.781770+0000","last_clean":"2023-07-06T01:10:05.781770+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:05.781770+0000","last_undegraded":"2023-07-06T01:10:05.781770+0000","last_fullsized":"2023-07-06T01:10:05.781770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:51:37.762539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.796655+0000","last_change":"2023-07-06T01:10:06.794351+0000","last_active":"2023-07-06T01:10:06.796655+0000","last_peered":"2023-07-06T01:10:06.796655+0000","last_clean":"2023-07-06T01:10:06.796655+0000","last_became_active":"2023-07-06T01:10:06.794075+0000","last_became_peered":"2023-07-06T01:10:06.794075+0000","last_unstale":"2023-07-06T01:10:06.796655+0000","last_undegraded":"2023-07-06T01:10:06.796655+0000","last_fullsized":"2023-07-06T01:10:06.796655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:25:04.465898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.798546+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:06.798546+0000","last_peered":"2023-07-06T01:10:06.798546+0000","last_clean":"2023-07-06T01:10:06.798546+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:06.798546+0000","last_undegraded":"2023-07-06T01:10:06.798546+0000","last_fullsized":"2023-07-06T01:10:06.798546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:14.200439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793226+0000","last_change":"2023-07-06T01:10:05.793226+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793226+0000","last_undegraded":"2023-07-06T01:10:05.793226+0000","last_fullsized":"2023-07-06T01:10:05.793226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.793790+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:05.793790+0000","last_peered":"2023-07-06T01:10:05.793790+0000","last_clean":"2023-07-06T01:10:05.793790+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:05.793790+0000","last_undegraded":"2023-07-06T01:10:05.793790+0000","last_fullsized":"2023-07-06T01:10:05.793790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:38:06.886443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.803846+0000","last_change":"2023-07-06T01:10:06.803846+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.803846+0000","last_undegraded":"2023-07-06T01:10:06.803846+0000","last_fullsized":"2023-07-06T01:10:06.803846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785791+0000","last_change":"2023-07-06T01:10:05.785791+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785791+0000","last_undegraded":"2023-07-06T01:10:05.785791+0000","last_fullsized":"2023-07-06T01:10:05.785791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.803528+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:06.803528+0000","last_peered":"2023-07-06T01:10:06.803528+0000","last_clean":"2023-07-06T01:10:06.803528+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:06.803528+0000","last_undegraded":"2023-07-06T01:10:06.803528+0000","last_fullsized":"2023-07-06T01:10:06.803528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:19:27.819590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.787998+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:05.787998+0000","last_peered":"2023-07-06T01:10:05.787998+0000","last_clean":"2023-07-06T01:10:05.787998+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:05.787998+0000","last_undegraded":"2023-07-06T01:10:05.787998+0000","last_fullsized":"2023-07-06T01:10:05.787998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:07.156239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813237+0000","last_change":"2023-07-06T01:10:06.809002+0000","last_active":"2023-07-06T01:10:06.813237+0000","last_peered":"2023-07-06T01:10:06.813237+0000","last_clean":"2023-07-06T01:10:06.813237+0000","last_became_active":"2023-07-06T01:10:06.808542+0000","last_became_peered":"2023-07-06T01:10:06.808542+0000","last_unstale":"2023-07-06T01:10:06.813237+0000","last_undegraded":"2023-07-06T01:10:06.813237+0000","last_fullsized":"2023-07-06T01:10:06.813237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:23.099458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.788140+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:05.788140+0000","last_peered":"2023-07-06T01:10:05.788140+0000","last_clean":"2023-07-06T01:10:05.788140+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:05.788140+0000","last_undegraded":"2023-07-06T01:10:05.788140+0000","last_fullsized":"2023-07-06T01:10:05.788140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:28:57.389464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785934+0000","last_change":"2023-07-06T01:10:05.785934+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785934+0000","last_undegraded":"2023-07-06T01:10:05.785934+0000","last_fullsized":"2023-07-06T01:10:05.785934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.788390+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:05.788390+0000","last_peered":"2023-07-06T01:10:05.788390+0000","last_clean":"2023-07-06T01:10:05.788390+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:05.788390+0000","last_undegraded":"2023-07-06T01:10:05.788390+0000","last_fullsized":"2023-07-06T01:10:05.788390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:43:32.897194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.784013+0000","last_change":"2023-07-06T01:10:05.784013+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.784013+0000","last_undegraded":"2023-07-06T01:10:05.784013+0000","last_fullsized":"2023-07-06T01:10:05.784013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.781895+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:05.781895+0000","last_peered":"2023-07-06T01:10:05.781895+0000","last_clean":"2023-07-06T01:10:05.781895+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:05.781895+0000","last_undegraded":"2023-07-06T01:10:05.781895+0000","last_fullsized":"2023-07-06T01:10:05.781895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:10:30.910245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788558+0000","last_change":"2023-07-06T01:10:05.788558+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788558+0000","last_undegraded":"2023-07-06T01:10:05.788558+0000","last_fullsized":"2023-07-06T01:10:05.788558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.786825+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:05.786825+0000","last_peered":"2023-07-06T01:10:05.786825+0000","last_clean":"2023-07-06T01:10:05.786825+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:05.786825+0000","last_undegraded":"2023-07-06T01:10:05.786825+0000","last_fullsized":"2023-07-06T01:10:05.786825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:42:58.206526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":954368,"data_stored":733509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.746},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.441}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.377}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.748},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":739679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.498}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.435},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":149311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.432},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.62},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.88400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":149311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.63}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.84599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:12.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.447+0000 7f6e54dff700 1 Processor -- start 2023-07-06T01:10:12.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.447+0000 7f6e54dff700 1 -- start start 2023-07-06T01:10:12.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.448+0000 7f6e54dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6e500d1250 0x7f6e50160d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.448+0000 7f6e54dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5006cb60 con 0x7f6e5015d8b0 2023-07-06T01:10:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.448+0000 7f6e54dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e501613a0 con 0x7f6e5015dc80 2023-07-06T01:10:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.448+0000 7f6e54dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5006c230 con 0x7f6e500d1250 2023-07-06T01:10:12.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4e59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6e5015d8b0 0x7f6e500d0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48790/0 (socket says 172.21.15.71:48790) 2023-07-06T01:10:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4e59c700 1 -- 172.21.15.71:0/3661564888 learned_addr learned my addr 172.21.15.71:0/3661564888 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4ed9d700 1 --2- 172.21.15.71:0/3661564888 >> v2:172.21.15.71:3300/0 conn(0x7f6e500d1250 0x7f6e50160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4d59a700 1 -- 172.21.15.71:0/3661564888 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358462712 0 0) 0x7f6e5006cb60 con 0x7f6e5015d8b0 2023-07-06T01:10:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4d59a700 1 -- 172.21.15.71:0/3661564888 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e380035b0 con 0x7f6e5015d8b0 2023-07-06T01:10:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/3661564888 >> v1:172.21.15.194:6789/0 conn(0x7f6e5015dc80 legacy=0x7f6e50160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/3661564888 >> v1:172.21.15.71:6789/0 conn(0x7f6e5015d8b0 legacy=0x7f6e500d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/3661564888 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5006c510 con 0x7f6e500d1250 2023-07-06T01:10:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.449+0000 7f6e4ed9d700 1 --2- 172.21.15.71:0/3661564888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e500d1250 0x7f6e50160d50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009dc0 tx=0x7f6e4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2985aa4f6a530e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e4d59a700 1 -- 172.21.15.71:0/3661564888 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800e070 con 0x7f6e500d1250 2023-07-06T01:10:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e4d59a700 1 -- 172.21.15.71:0/3661564888 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800bae0 con 0x7f6e500d1250 2023-07-06T01:10:12.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e4d59a700 1 -- 172.21.15.71:0/3661564888 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4800be90 con 0x7f6e500d1250 2023-07-06T01:10:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 -- 172.21.15.71:0/3661564888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e500d1250 msgr2=0x7f6e50160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 --2- 172.21.15.71:0/3661564888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e500d1250 0x7f6e50160d50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009dc0 tx=0x7f6e4800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 -- 172.21.15.71:0/3661564888 shutdown_connections 2023-07-06T01:10:12.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 --2- 172.21.15.71:0/3661564888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e500d1250 0x7f6e50160d50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 -- 172.21.15.71:0/3661564888 >> 172.21.15.71:0/3661564888 conn(0x7f6e5006db20 msgr2=0x7f6e5006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:12.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 -- 172.21.15.71:0/3661564888 shutdown_connections 2023-07-06T01:10:12.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.450+0000 7f6e54dff700 1 -- 172.21.15.71:0/3661564888 wait complete. 2023-07-06T01:10:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.452+0000 7f6e54dff700 1 Processor -- start 2023-07-06T01:10:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.452+0000 7f6e54dff700 1 -- start start 2023-07-06T01:10:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.453+0000 7f6e54dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e500d1250 0x7f6e501f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.453+0000 7f6e54dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5015d8b0 0x7f6e50153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.453+0000 7f6e54dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 0x7f6e5015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.453+0000 7f6e54dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501f2a30 con 0x7f6e5015f6c0 2023-07-06T01:10:12.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.453+0000 7f6e54dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50160080 con 0x7f6e5015d8b0 2023-07-06T01:10:12.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.453+0000 7f6e54dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e501e6630 con 0x7f6e500d1250 2023-07-06T01:10:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 0x7f6e5015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 0x7f6e5015fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55298/0 (socket says 172.21.15.71:55298) 2023-07-06T01:10:12.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/1912158473 learned_addr learned my addr 172.21.15.71:0/1912158473 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4dd9b700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5015d8b0 0x7f6e50153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4e59c700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e500d1250 0x7f6e501f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e500d1250 msgr2=0x7f6e501f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e500d1250 0x7f6e501f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5015d8b0 msgr2=0x7f6e50153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5015d8b0 0x7f6e50153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 -- 172.21.15.71:0/1912158473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e48009a70 con 0x7f6e5015f6c0 2023-07-06T01:10:12.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4dd9b700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5015d8b0 0x7f6e50153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e4ed9d700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 0x7f6e5015fb40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e48014040 tx=0x7f6e48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.454+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48004700 con 0x7f6e5015f6c0 2023-07-06T01:10:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.455+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48020070 con 0x7f6e5015f6c0 2023-07-06T01:10:12.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.455+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e501f6430 con 0x7f6e5015f6c0 2023-07-06T01:10:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.455+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e48027480 con 0x7f6e5015f6c0 2023-07-06T01:10:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.455+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e501f2650 con 0x7f6e5015f6c0 2023-07-06T01:10:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.456+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e501f2b70 con 0x7f6e5015f6c0 2023-07-06T01:10:12.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.456+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e480275e0 con 0x7f6e5015f6c0 2023-07-06T01:10:12.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.457+0000 7f6e3effd700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e3006ace0 0x7f6e3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.457+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e48022070 con 0x7f6e5015f6c0 2023-07-06T01:10:12.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.458+0000 7f6e4e59c700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e3006ace0 0x7f6e3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.458+0000 7f6e4e59c700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e3006ace0 0x7f6e3006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e400011e0 tx=0x7f6e40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.462+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e501f2b70 con 0x7f6e5015f6c0 2023-07-06T01:10:12.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.650+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e5006cff0 con 0x7f6e3006ace0 2023-07-06T01:10:12.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.659+0000 7f6e3effd700 1 -- 172.21.15.71:0/1912158473 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300464 (secure 0 0 0) 0x7f6e40001470 con 0x7f6e3006ace0 2023-07-06T01:10:12.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e3006ace0 msgr2=0x7f6e3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e3006ace0 0x7f6e3006d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e400011e0 tx=0x7f6e40009040 comp rx=0 tx=0).stop 2023-07-06T01:10:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 msgr2=0x7f6e5015fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 0x7f6e5015fb40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6e48014040 tx=0x7f6e48004ad0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 shutdown_connections 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e3006ace0 0x7f6e3006d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e5015f6c0 0x7f6e5015fb40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e500d1250 0x7f6e501f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 --2- 172.21.15.71:0/1912158473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e5015d8b0 0x7f6e50153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 >> 172.21.15.71:0/1912158473 conn(0x7f6e5006db20 msgr2=0x7f6e500ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:12.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 shutdown_connections 2023-07-06T01:10:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.663+0000 7f6e54dff700 1 -- 172.21.15.71:0/1912158473 wait complete. 2023-07-06T01:10:12.672 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:12.684 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-07-06T01:10:10.850793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219628,"kb_used_data":4012,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755092,"statfs":{"total":773094113280,"available":772869214208,"internally_reserved":0,"allocated":4108288,"data_stored":2344374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071715"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.787096+0000","last_change":"2023-07-06T01:10:06.787096+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.787096+0000","last_undegraded":"2023-07-06T01:10:06.787096+0000","last_fullsized":"2023-07-06T01:10:06.787096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.796146+0000","last_change":"2023-07-06T01:10:06.796146+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.796146+0000","last_undegraded":"2023-07-06T01:10:06.796146+0000","last_fullsized":"2023-07-06T01:10:06.796146+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.787298+0000","last_change":"2023-07-06T01:10:06.787298+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.787298+0000","last_undegraded":"2023-07-06T01:10:06.787298+0000","last_fullsized":"2023-07-06T01:10:06.787298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.803333+0000","last_change":"2023-07-06T01:10:06.803333+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.803333+0000","last_undegraded":"2023-07-06T01:10:06.803333+0000","last_fullsized":"2023-07-06T01:10:06.803333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.799326+0000","last_change":"2023-07-06T01:10:06.799326+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.799326+0000","last_undegraded":"2023-07-06T01:10:06.799326+0000","last_fullsized":"2023-07-06T01:10:06.799326+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786883+0000","last_change":"2023-07-06T01:10:06.786883+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786883+0000","last_undegraded":"2023-07-06T01:10:06.786883+0000","last_fullsized":"2023-07-06T01:10:06.786883+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.803260+0000","last_change":"2023-07-06T01:10:06.803260+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.803260+0000","last_undegraded":"2023-07-06T01:10:06.803260+0000","last_fullsized":"2023-07-06T01:10:06.803260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.796623+0000","last_change":"2023-07-06T01:10:06.796623+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.796623+0000","last_undegraded":"2023-07-06T01:10:06.796623+0000","last_fullsized":"2023-07-06T01:10:06.796623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.802834+0000","last_change":"2023-07-06T01:10:06.802834+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.802834+0000","last_undegraded":"2023-07-06T01:10:06.802834+0000","last_fullsized":"2023-07-06T01:10:06.802834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.797735+0000","last_change":"2023-07-06T01:10:06.797735+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.797735+0000","last_undegraded":"2023-07-06T01:10:06.797735+0000","last_fullsized":"2023-07-06T01:10:06.797735+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785242+0000","last_change":"2023-07-06T01:10:05.785242+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785242+0000","last_undegraded":"2023-07-06T01:10:05.785242+0000","last_fullsized":"2023-07-06T01:10:05.785242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.793941+0000","last_change":"2023-07-06T01:10:06.790212+0000","last_active":"2023-07-06T01:10:06.793941+0000","last_peered":"2023-07-06T01:10:06.793941+0000","last_clean":"2023-07-06T01:10:06.793941+0000","last_became_active":"2023-07-06T01:10:06.789874+0000","last_became_peered":"2023-07-06T01:10:06.789874+0000","last_unstale":"2023-07-06T01:10:06.793941+0000","last_undegraded":"2023-07-06T01:10:06.793941+0000","last_fullsized":"2023-07-06T01:10:06.793941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:03:09.370389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.780936+0000","last_change":"2023-07-06T01:10:05.780936+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.780936+0000","last_undegraded":"2023-07-06T01:10:05.780936+0000","last_fullsized":"2023-07-06T01:10:05.780936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.784180+0000","last_change":"2023-07-06T01:10:05.784180+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.784180+0000","last_undegraded":"2023-07-06T01:10:05.784180+0000","last_fullsized":"2023-07-06T01:10:05.784180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786860+0000","last_change":"2023-07-06T01:10:06.786860+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786860+0000","last_undegraded":"2023-07-06T01:10:06.786860+0000","last_fullsized":"2023-07-06T01:10:06.786860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813243+0000","last_change":"2023-07-06T01:10:06.809079+0000","last_active":"2023-07-06T01:10:06.813243+0000","last_peered":"2023-07-06T01:10:06.813243+0000","last_clean":"2023-07-06T01:10:06.813243+0000","last_became_active":"2023-07-06T01:10:06.808787+0000","last_became_peered":"2023-07-06T01:10:06.808787+0000","last_unstale":"2023-07-06T01:10:06.813243+0000","last_undegraded":"2023-07-06T01:10:06.813243+0000","last_fullsized":"2023-07-06T01:10:06.813243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:37.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.795000+0000","last_change":"2023-07-06T01:10:06.795000+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.795000+0000","last_undegraded":"2023-07-06T01:10:06.795000+0000","last_fullsized":"2023-07-06T01:10:06.795000+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785802+0000","last_change":"2023-07-06T01:10:05.785802+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785802+0000","last_undegraded":"2023-07-06T01:10:05.785802+0000","last_fullsized":"2023-07-06T01:10:05.785802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.780945+0000","last_change":"2023-07-06T01:10:05.780945+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.780945+0000","last_undegraded":"2023-07-06T01:10:05.780945+0000","last_fullsized":"2023-07-06T01:10:05.780945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785533+0000","last_change":"2023-07-06T01:10:05.785533+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785533+0000","last_undegraded":"2023-07-06T01:10:05.785533+0000","last_fullsized":"2023-07-06T01:10:05.785533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788658+0000","last_change":"2023-07-06T01:10:05.788658+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788658+0000","last_undegraded":"2023-07-06T01:10:05.788658+0000","last_fullsized":"2023-07-06T01:10:05.788658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.816829+0000","last_change":"2023-07-06T01:10:06.813577+0000","last_active":"2023-07-06T01:10:06.816829+0000","last_peered":"2023-07-06T01:10:06.816829+0000","last_clean":"2023-07-06T01:10:06.816829+0000","last_became_active":"2023-07-06T01:10:06.813302+0000","last_became_peered":"2023-07-06T01:10:06.813302+0000","last_unstale":"2023-07-06T01:10:06.816829+0000","last_undegraded":"2023-07-06T01:10:06.816829+0000","last_fullsized":"2023-07-06T01:10:06.816829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:17.128137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786368+0000","last_change":"2023-07-06T01:10:06.786368+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786368+0000","last_undegraded":"2023-07-06T01:10:06.786368+0000","last_fullsized":"2023-07-06T01:10:06.786368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813224+0000","last_change":"2023-07-06T01:10:06.808682+0000","last_active":"2023-07-06T01:10:06.813224+0000","last_peered":"2023-07-06T01:10:06.813224+0000","last_clean":"2023-07-06T01:10:06.813224+0000","last_became_active":"2023-07-06T01:10:06.808373+0000","last_became_peered":"2023-07-06T01:10:06.808373+0000","last_unstale":"2023-07-06T01:10:06.813224+0000","last_undegraded":"2023-07-06T01:10:06.813224+0000","last_fullsized":"2023-07-06T01:10:06.813224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:19.000518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788735+0000","last_change":"2023-07-06T01:10:05.788735+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788735+0000","last_undegraded":"2023-07-06T01:10:05.788735+0000","last_fullsized":"2023-07-06T01:10:05.788735+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.786319+0000","last_change":"2023-07-06T01:10:06.786319+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.786319+0000","last_undegraded":"2023-07-06T01:10:06.786319+0000","last_fullsized":"2023-07-06T01:10:06.786319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788699+0000","last_change":"2023-07-06T01:10:05.788699+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788699+0000","last_undegraded":"2023-07-06T01:10:05.788699+0000","last_fullsized":"2023-07-06T01:10:05.788699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.781213+0000","last_change":"2023-07-06T01:10:05.781213+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.781213+0000","last_undegraded":"2023-07-06T01:10:05.781213+0000","last_fullsized":"2023-07-06T01:10:05.781213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785272+0000","last_change":"2023-07-06T01:10:05.785272+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785272+0000","last_undegraded":"2023-07-06T01:10:05.785272+0000","last_fullsized":"2023-07-06T01:10:05.785272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.786896+0000","last_change":"2023-07-06T01:10:05.786896+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.786896+0000","last_undegraded":"2023-07-06T01:10:05.786896+0000","last_fullsized":"2023-07-06T01:10:05.786896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813215+0000","last_change":"2023-07-06T01:10:06.808881+0000","last_active":"2023-07-06T01:10:06.813215+0000","last_peered":"2023-07-06T01:10:06.813215+0000","last_clean":"2023-07-06T01:10:06.813215+0000","last_became_active":"2023-07-06T01:10:06.808508+0000","last_became_peered":"2023-07-06T01:10:06.808508+0000","last_unstale":"2023-07-06T01:10:06.813215+0000","last_undegraded":"2023-07-06T01:10:06.813215+0000","last_fullsized":"2023-07-06T01:10:06.813215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:44:54.508249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.799789+0000","last_change":"2023-07-06T01:10:06.799789+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.799789+0000","last_undegraded":"2023-07-06T01:10:06.799789+0000","last_fullsized":"2023-07-06T01:10:06.799789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.786038+0000","last_change":"2023-07-06T01:10:05.786038+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.786038+0000","last_undegraded":"2023-07-06T01:10:05.786038+0000","last_fullsized":"2023-07-06T01:10:05.786038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793233+0000","last_change":"2023-07-06T01:10:05.793233+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793233+0000","last_undegraded":"2023-07-06T01:10:05.793233+0000","last_fullsized":"2023-07-06T01:10:05.793233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.781012+0000","last_change":"2023-07-06T01:10:05.781012+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.781012+0000","last_undegraded":"2023-07-06T01:10:05.781012+0000","last_fullsized":"2023-07-06T01:10:05.781012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793287+0000","last_change":"2023-07-06T01:10:05.793287+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793287+0000","last_undegraded":"2023-07-06T01:10:05.793287+0000","last_fullsized":"2023-07-06T01:10:05.793287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.785948+0000","last_change":"2023-07-06T01:10:06.785948+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.785948+0000","last_undegraded":"2023-07-06T01:10:06.785948+0000","last_fullsized":"2023-07-06T01:10:06.785948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793233+0000","last_change":"2023-07-06T01:10:05.793233+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793233+0000","last_undegraded":"2023-07-06T01:10:05.793233+0000","last_fullsized":"2023-07-06T01:10:05.793233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.798205+0000","last_change":"2023-07-06T01:10:06.798205+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.798205+0000","last_undegraded":"2023-07-06T01:10:06.798205+0000","last_fullsized":"2023-07-06T01:10:06.798205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.786225+0000","last_change":"2023-07-06T01:10:05.786225+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.786225+0000","last_undegraded":"2023-07-06T01:10:05.786225+0000","last_fullsized":"2023-07-06T01:10:05.786225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793127+0000","last_change":"2023-07-06T01:10:05.793127+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793127+0000","last_undegraded":"2023-07-06T01:10:05.793127+0000","last_fullsized":"2023-07-06T01:10:05.793127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.785867+0000","last_change":"2023-07-06T01:10:06.785867+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.785867+0000","last_undegraded":"2023-07-06T01:10:06.785867+0000","last_fullsized":"2023-07-06T01:10:06.785867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.800868+0000","last_change":"2023-07-06T01:10:06.797438+0000","last_active":"2023-07-06T01:10:06.800868+0000","last_peered":"2023-07-06T01:10:06.800868+0000","last_clean":"2023-07-06T01:10:06.800868+0000","last_became_active":"2023-07-06T01:10:06.796874+0000","last_became_peered":"2023-07-06T01:10:06.796874+0000","last_unstale":"2023-07-06T01:10:06.800868+0000","last_undegraded":"2023-07-06T01:10:06.800868+0000","last_fullsized":"2023-07-06T01:10:06.800868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:37:21.492613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.781770+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:05.781770+0000","last_peered":"2023-07-06T01:10:05.781770+0000","last_clean":"2023-07-06T01:10:05.781770+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:05.781770+0000","last_undegraded":"2023-07-06T01:10:05.781770+0000","last_fullsized":"2023-07-06T01:10:05.781770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:51:37.762539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.796655+0000","last_change":"2023-07-06T01:10:06.794351+0000","last_active":"2023-07-06T01:10:06.796655+0000","last_peered":"2023-07-06T01:10:06.796655+0000","last_clean":"2023-07-06T01:10:06.796655+0000","last_became_active":"2023-07-06T01:10:06.794075+0000","last_became_peered":"2023-07-06T01:10:06.794075+0000","last_unstale":"2023-07-06T01:10:06.796655+0000","last_undegraded":"2023-07-06T01:10:06.796655+0000","last_fullsized":"2023-07-06T01:10:06.796655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:25:04.465898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.798546+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:06.798546+0000","last_peered":"2023-07-06T01:10:06.798546+0000","last_clean":"2023-07-06T01:10:06.798546+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:06.798546+0000","last_undegraded":"2023-07-06T01:10:06.798546+0000","last_fullsized":"2023-07-06T01:10:06.798546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:14.200439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.793226+0000","last_change":"2023-07-06T01:10:05.793226+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.793226+0000","last_undegraded":"2023-07-06T01:10:05.793226+0000","last_fullsized":"2023-07-06T01:10:05.793226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.793790+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:05.793790+0000","last_peered":"2023-07-06T01:10:05.793790+0000","last_clean":"2023-07-06T01:10:05.793790+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:05.793790+0000","last_undegraded":"2023-07-06T01:10:05.793790+0000","last_fullsized":"2023-07-06T01:10:05.793790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:38:06.886443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2023-07-06T01:10:06.803846+0000","last_change":"2023-07-06T01:10:06.803846+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.803846+0000","last_undegraded":"2023-07-06T01:10:06.803846+0000","last_fullsized":"2023-07-06T01:10:06.803846+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785791+0000","last_change":"2023-07-06T01:10:05.785791+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785791+0000","last_undegraded":"2023-07-06T01:10:05.785791+0000","last_fullsized":"2023-07-06T01:10:05.785791+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.803528+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:06.803528+0000","last_peered":"2023-07-06T01:10:06.803528+0000","last_clean":"2023-07-06T01:10:06.803528+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:06.803528+0000","last_undegraded":"2023-07-06T01:10:06.803528+0000","last_fullsized":"2023-07-06T01:10:06.803528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:19:27.819590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.787998+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:05.787998+0000","last_peered":"2023-07-06T01:10:05.787998+0000","last_clean":"2023-07-06T01:10:05.787998+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:05.787998+0000","last_undegraded":"2023-07-06T01:10:05.787998+0000","last_fullsized":"2023-07-06T01:10:05.787998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:07.156239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-07-06T01:10:06.813237+0000","last_change":"2023-07-06T01:10:06.809002+0000","last_active":"2023-07-06T01:10:06.813237+0000","last_peered":"2023-07-06T01:10:06.813237+0000","last_clean":"2023-07-06T01:10:06.813237+0000","last_became_active":"2023-07-06T01:10:06.808542+0000","last_became_peered":"2023-07-06T01:10:06.808542+0000","last_unstale":"2023-07-06T01:10:06.813237+0000","last_undegraded":"2023-07-06T01:10:06.813237+0000","last_fullsized":"2023-07-06T01:10:06.813237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:23.099458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.788140+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:05.788140+0000","last_peered":"2023-07-06T01:10:05.788140+0000","last_clean":"2023-07-06T01:10:05.788140+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:05.788140+0000","last_undegraded":"2023-07-06T01:10:05.788140+0000","last_fullsized":"2023-07-06T01:10:05.788140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:28:57.389464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.785934+0000","last_change":"2023-07-06T01:10:05.785934+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.785934+0000","last_undegraded":"2023-07-06T01:10:05.785934+0000","last_fullsized":"2023-07-06T01:10:05.785934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.788390+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:05.788390+0000","last_peered":"2023-07-06T01:10:05.788390+0000","last_clean":"2023-07-06T01:10:05.788390+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:05.788390+0000","last_undegraded":"2023-07-06T01:10:05.788390+0000","last_fullsized":"2023-07-06T01:10:05.788390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:43:32.897194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.784013+0000","last_change":"2023-07-06T01:10:05.784013+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.784013+0000","last_undegraded":"2023-07-06T01:10:05.784013+0000","last_fullsized":"2023-07-06T01:10:05.784013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.781895+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:05.781895+0000","last_peered":"2023-07-06T01:10:05.781895+0000","last_clean":"2023-07-06T01:10:05.781895+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:05.781895+0000","last_undegraded":"2023-07-06T01:10:05.781895+0000","last_fullsized":"2023-07-06T01:10:05.781895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:10:30.910245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-06T01:10:06.777833+0000","last_change":"2023-07-06T01:10:06.777833+0000","last_active":"2023-07-06T01:10:06.777833+0000","last_peered":"2023-07-06T01:10:06.777833+0000","last_clean":"2023-07-06T01:10:06.777833+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:06.777833+0000","last_undegraded":"2023-07-06T01:10:06.777833+0000","last_fullsized":"2023-07-06T01:10:06.777833+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2023-07-06T01:10:05.788558+0000","last_change":"2023-07-06T01:10:05.788558+0000","last_active":"2023-07-06T01:10:05.771710+0000","last_peered":"2023-07-06T01:10:05.771710+0000","last_clean":"2023-07-06T01:10:05.771710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T01:10:05.788558+0000","last_undegraded":"2023-07-06T01:10:05.788558+0000","last_fullsized":"2023-07-06T01:10:05.788558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-07-06T01:10:05.786825+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:05.786825+0000","last_peered":"2023-07-06T01:10:05.786825+0000","last_clean":"2023-07-06T01:10:05.786825+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:05.786825+0000","last_undegraded":"2023-07-06T01:10:05.786825+0000","last_fullsized":"2023-07-06T01:10:05.786825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:42:58.206526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":954368,"data_stored":733509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.746},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.441}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.377}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.748},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":966656,"data_stored":739679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.498}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.435},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.64700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.45900000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.626}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":149311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.432},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":143141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.62},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.88400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":372736,"data_stored":149311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.63}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.58299999999999996}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.84599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:12.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.917+0000 7f42e0dff700 1 Processor -- start 2023-07-06T01:10:12.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.918+0000 7f42e0dff700 1 -- start start 2023-07-06T01:10:12.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42e0dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f42dc0b5c90 0x7f42dc0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42e0dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b6110 0x7f42dc0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42e0dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc0cf780 con 0x7f42dc15fca0 2023-07-06T01:10:12.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42e0dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0cd490 con 0x7f42dc0b5c90 2023-07-06T01:10:12.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42e0dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0cd770 con 0x7f42dc0b6110 2023-07-06T01:10:12.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42d3fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f42dc0b5c90 0x7f42dc0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42dad9d700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b6110 0x7f42dc0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42da59c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f42dc15fca0 0x7f42dc0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:42258/0 (socket says 172.21.15.71:42258) 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.919+0000 7f42da59c700 1 -- 172.21.15.71:0/1042486179 learned_addr learned my addr 172.21.15.71:0/1042486179 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42d9d9b700 1 -- 172.21.15.71:0/1042486179 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052961104 0 0) 0x7f42dc0cf780 con 0x7f42dc15fca0 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42d9d9b700 1 -- 172.21.15.71:0/1042486179 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c80035b0 con 0x7f42dc15fca0 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42dad9d700 1 -- 172.21.15.71:0/1042486179 >> v2:172.21.15.194:3300/0 conn(0x7f42dc0b5c90 msgr2=0x7f42dc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42dad9d700 1 --2- 172.21.15.71:0/1042486179 >> v2:172.21.15.194:3300/0 conn(0x7f42dc0b5c90 0x7f42dc0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42dad9d700 1 -- 172.21.15.71:0/1042486179 >> v1:172.21.15.194:6789/0 conn(0x7f42dc15fca0 legacy=0x7f42dc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42dad9d700 1 -- 172.21.15.71:0/1042486179 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc0cda50 con 0x7f42dc0b6110 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42d3fff700 1 --2- 172.21.15.71:0/1042486179 >> v2:172.21.15.194:3300/0 conn(0x7f42dc0b5c90 0x7f42dc0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42dad9d700 1 --2- 172.21.15.71:0/1042486179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b6110 0x7f42dc0d3280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009d90 tx=0x7f42d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e00153e36e68696 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42d9d9b700 1 -- 172.21.15.71:0/1042486179 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d400e070 con 0x7f42dc0b6110 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42d9d9b700 1 -- 172.21.15.71:0/1042486179 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d400bb20 con 0x7f42dc0b6110 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.920+0000 7f42d9d9b700 1 -- 172.21.15.71:0/1042486179 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4012430 con 0x7f42dc0b6110 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 -- 172.21.15.71:0/1042486179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b6110 msgr2=0x7f42dc0d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1042486179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b6110 0x7f42dc0d3280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009d90 tx=0x7f42d400b330 comp rx=0 tx=0).stop 2023-07-06T01:10:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 -- 172.21.15.71:0/1042486179 shutdown_connections 2023-07-06T01:10:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1042486179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b6110 0x7f42dc0d3280 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1042486179 >> v2:172.21.15.194:3300/0 conn(0x7f42dc0b5c90 0x7f42dc0d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 -- 172.21.15.71:0/1042486179 >> 172.21.15.71:0/1042486179 conn(0x7f42dc06c150 msgr2=0x7f42dc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 -- 172.21.15.71:0/1042486179 shutdown_connections 2023-07-06T01:10:12.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.921+0000 7f42e0dff700 1 -- 172.21.15.71:0/1042486179 wait complete. 2023-07-06T01:10:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.923+0000 7f42e0dff700 1 Processor -- start 2023-07-06T01:10:12.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.924+0000 7f42e0dff700 1 -- start start 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42e0dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b5c90 0x7f42dc155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42e0dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 0x7f42dc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42e0dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc15fca0 0x7f42dc0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42e0dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc154ed0 con 0x7f42dc0b6110 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42e0dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0c94f0 con 0x7f42dc15fca0 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42e0dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc155120 con 0x7f42dc0b5c90 2023-07-06T01:10:12.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 0x7f42dc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 0x7f42dc158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55314/0 (socket says 172.21.15.71:55314) 2023-07-06T01:10:12.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 -- 172.21.15.71:0/1360499931 learned_addr learned my addr 172.21.15.71:0/1360499931 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:12.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42da59c700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b5c90 0x7f42dc155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42dad9d700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc15fca0 0x7f42dc0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 -- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b5c90 msgr2=0x7f42dc155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b5c90 0x7f42dc155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 -- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc15fca0 msgr2=0x7f42dc0c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:12.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.925+0000 7f42d3fff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc15fca0 0x7f42dc0c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42d3fff700 1 -- 172.21.15.71:0/1360499931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40094a0 con 0x7f42dc0b6110 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42d3fff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 0x7f42dc158e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f42c400ebe0 tx=0x7f42c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400c850 con 0x7f42dc0b6110 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c400c9b0 con 0x7f42dc0b6110 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400cd40 con 0x7f42dc0b6110 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d4009a70 con 0x7f42dc0b6110 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.926+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc1556e0 con 0x7f42dc0b6110 2023-07-06T01:10:12.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.927+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc1558d0 con 0x7f42dc0b6110 2023-07-06T01:10:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.928+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42c4013470 con 0x7f42dc0b6110 2023-07-06T01:10:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.929+0000 7f42d2ffd700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42bc06ace0 0x7f42bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:12.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.929+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42c4089530 con 0x7f42dc0b6110 2023-07-06T01:10:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.930+0000 7f42da59c700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42bc06ace0 0x7f42bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:12.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.930+0000 7f42da59c700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42bc06ace0 0x7f42bc06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f42cc007fd0 tx=0x7f42cc007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:12.933+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42c40545e0 con 0x7f42dc0b6110 2023-07-06T01:10:13.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:13.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:13.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.132+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42dc06ae40 con 0x7f42bc06ace0 2023-07-06T01:10:13.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.142+0000 7f42d2ffd700 1 -- 172.21.15.71:0/1360499931 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310642 (secure 0 0 0) 0x7f42cc0058e0 con 0x7f42bc06ace0 2023-07-06T01:10:13.148 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:13.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42bc06ace0 msgr2=0x7f42bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42bc06ace0 0x7f42bc06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f42cc007fd0 tx=0x7f42cc007dc0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 msgr2=0x7f42dc158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 0x7f42dc158e20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f42c400ebe0 tx=0x7f42c400eef0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 shutdown_connections 2023-07-06T01:10:13.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42bc06ace0 0x7f42bc06d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc15fca0 0x7f42dc0c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42dc0b5c90 0x7f42dc155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 --2- 172.21.15.71:0/1360499931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f42dc0b6110 0x7f42dc158e20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.146+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 >> 172.21.15.71:0/1360499931 conn(0x7f42dc06c150 msgr2=0x7f42dc0cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.147+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 shutdown_connections 2023-07-06T01:10:13.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.147+0000 7f42e0dff700 1 -- 172.21.15.71:0/1360499931 wait complete. 2023-07-06T01:10:13.152 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:13.167 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-07-06T01:10:12.851169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":4424,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":4530176,"data_stored":2543220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.068136"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293083+0000","last_change":"2023-07-06T01:10:07.822535+0000","last_active":"2023-07-06T01:10:10.293083+0000","last_peered":"2023-07-06T01:10:10.293083+0000","last_clean":"2023-07-06T01:10:10.293083+0000","last_became_active":"2023-07-06T01:10:07.822279+0000","last_became_peered":"2023-07-06T01:10:07.822279+0000","last_unstale":"2023-07-06T01:10:10.293083+0000","last_undegraded":"2023-07-06T01:10:10.293083+0000","last_fullsized":"2023-07-06T01:10:10.293083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:35.134211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292681+0000","last_change":"2023-07-06T01:10:07.812868+0000","last_active":"2023-07-06T01:10:10.292681+0000","last_peered":"2023-07-06T01:10:10.292681+0000","last_clean":"2023-07-06T01:10:10.292681+0000","last_became_active":"2023-07-06T01:10:07.812592+0000","last_became_peered":"2023-07-06T01:10:07.812592+0000","last_unstale":"2023-07-06T01:10:10.292681+0000","last_undegraded":"2023-07-06T01:10:10.292681+0000","last_fullsized":"2023-07-06T01:10:10.292681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:00:10.561369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807349+0000","last_change":"2023-07-06T01:10:07.809507+0000","last_active":"2023-07-06T01:10:08.807349+0000","last_peered":"2023-07-06T01:10:08.807349+0000","last_clean":"2023-07-06T01:10:08.807349+0000","last_became_active":"2023-07-06T01:10:07.809254+0000","last_became_peered":"2023-07-06T01:10:07.809254+0000","last_unstale":"2023-07-06T01:10:08.807349+0000","last_undegraded":"2023-07-06T01:10:08.807349+0000","last_fullsized":"2023-07-06T01:10:08.807349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:18.134260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925490+0000","last_change":"2023-07-06T01:10:07.819304+0000","last_active":"2023-07-06T01:10:08.925490+0000","last_peered":"2023-07-06T01:10:08.925490+0000","last_clean":"2023-07-06T01:10:08.925490+0000","last_became_active":"2023-07-06T01:10:07.818818+0000","last_became_peered":"2023-07-06T01:10:07.818818+0000","last_unstale":"2023-07-06T01:10:08.925490+0000","last_undegraded":"2023-07-06T01:10:08.925490+0000","last_fullsized":"2023-07-06T01:10:08.925490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:20:12.375361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925429+0000","last_change":"2023-07-06T01:10:07.810967+0000","last_active":"2023-07-06T01:10:08.925429+0000","last_peered":"2023-07-06T01:10:08.925429+0000","last_clean":"2023-07-06T01:10:08.925429+0000","last_became_active":"2023-07-06T01:10:07.810687+0000","last_became_peered":"2023-07-06T01:10:07.810687+0000","last_unstale":"2023-07-06T01:10:08.925429+0000","last_undegraded":"2023-07-06T01:10:08.925429+0000","last_fullsized":"2023-07-06T01:10:08.925429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:49.575328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292456+0000","last_change":"2023-07-06T01:10:07.817746+0000","last_active":"2023-07-06T01:10:10.292456+0000","last_peered":"2023-07-06T01:10:10.292456+0000","last_clean":"2023-07-06T01:10:10.292456+0000","last_became_active":"2023-07-06T01:10:07.817454+0000","last_became_peered":"2023-07-06T01:10:07.817454+0000","last_unstale":"2023-07-06T01:10:10.292456+0000","last_undegraded":"2023-07-06T01:10:10.292456+0000","last_fullsized":"2023-07-06T01:10:10.292456+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:22:13.208835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928717+0000","last_change":"2023-07-06T01:10:07.823801+0000","last_active":"2023-07-06T01:10:08.928717+0000","last_peered":"2023-07-06T01:10:08.928717+0000","last_clean":"2023-07-06T01:10:08.928717+0000","last_became_active":"2023-07-06T01:10:07.823516+0000","last_became_peered":"2023-07-06T01:10:07.823516+0000","last_unstale":"2023-07-06T01:10:08.928717+0000","last_undegraded":"2023-07-06T01:10:08.928717+0000","last_fullsized":"2023-07-06T01:10:08.928717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:01:43.715571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292327+0000","last_change":"2023-07-06T01:10:07.810858+0000","last_active":"2023-07-06T01:10:10.292327+0000","last_peered":"2023-07-06T01:10:10.292327+0000","last_clean":"2023-07-06T01:10:10.292327+0000","last_became_active":"2023-07-06T01:10:07.810632+0000","last_became_peered":"2023-07-06T01:10:07.810632+0000","last_unstale":"2023-07-06T01:10:10.292327+0000","last_undegraded":"2023-07-06T01:10:10.292327+0000","last_fullsized":"2023-07-06T01:10:10.292327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:23.811778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807590+0000","last_change":"2023-07-06T01:10:07.809187+0000","last_active":"2023-07-06T01:10:08.807590+0000","last_peered":"2023-07-06T01:10:08.807590+0000","last_clean":"2023-07-06T01:10:08.807590+0000","last_became_active":"2023-07-06T01:10:07.808049+0000","last_became_peered":"2023-07-06T01:10:07.808049+0000","last_unstale":"2023-07-06T01:10:08.807590+0000","last_undegraded":"2023-07-06T01:10:08.807590+0000","last_fullsized":"2023-07-06T01:10:08.807590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:01.835630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928929+0000","last_change":"2023-07-06T01:10:07.812604+0000","last_active":"2023-07-06T01:10:08.928929+0000","last_peered":"2023-07-06T01:10:08.928929+0000","last_clean":"2023-07-06T01:10:08.928929+0000","last_became_active":"2023-07-06T01:10:07.812173+0000","last_became_peered":"2023-07-06T01:10:07.812173+0000","last_unstale":"2023-07-06T01:10:08.928929+0000","last_undegraded":"2023-07-06T01:10:08.928929+0000","last_fullsized":"2023-07-06T01:10:08.928929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929391+0000","last_change":"2023-07-06T01:10:07.814043+0000","last_active":"2023-07-06T01:10:08.929391+0000","last_peered":"2023-07-06T01:10:08.929391+0000","last_clean":"2023-07-06T01:10:08.929391+0000","last_became_active":"2023-07-06T01:10:07.813789+0000","last_became_peered":"2023-07-06T01:10:07.813789+0000","last_unstale":"2023-07-06T01:10:08.929391+0000","last_undegraded":"2023-07-06T01:10:08.929391+0000","last_fullsized":"2023-07-06T01:10:08.929391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807355+0000","last_change":"2023-07-06T01:10:07.807508+0000","last_active":"2023-07-06T01:10:08.807355+0000","last_peered":"2023-07-06T01:10:08.807355+0000","last_clean":"2023-07-06T01:10:08.807355+0000","last_became_active":"2023-07-06T01:10:07.807242+0000","last_became_peered":"2023-07-06T01:10:07.807242+0000","last_unstale":"2023-07-06T01:10:08.807355+0000","last_undegraded":"2023-07-06T01:10:08.807355+0000","last_fullsized":"2023-07-06T01:10:08.807355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:38.073944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928889+0000","last_change":"2023-07-06T01:10:07.825131+0000","last_active":"2023-07-06T01:10:08.928889+0000","last_peered":"2023-07-06T01:10:08.928889+0000","last_clean":"2023-07-06T01:10:08.928889+0000","last_became_active":"2023-07-06T01:10:07.824874+0000","last_became_peered":"2023-07-06T01:10:07.824874+0000","last_unstale":"2023-07-06T01:10:08.928889+0000","last_undegraded":"2023-07-06T01:10:08.928889+0000","last_fullsized":"2023-07-06T01:10:08.928889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:05.173975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526966+0000","last_change":"2023-07-06T01:10:07.820491+0000","last_active":"2023-07-06T01:10:09.526966+0000","last_peered":"2023-07-06T01:10:09.526966+0000","last_clean":"2023-07-06T01:10:09.526966+0000","last_became_active":"2023-07-06T01:10:07.820151+0000","last_became_peered":"2023-07-06T01:10:07.820151+0000","last_unstale":"2023-07-06T01:10:09.526966+0000","last_undegraded":"2023-07-06T01:10:09.526966+0000","last_fullsized":"2023-07-06T01:10:09.526966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:19.364827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928685+0000","last_change":"2023-07-06T01:10:07.807665+0000","last_active":"2023-07-06T01:10:08.928685+0000","last_peered":"2023-07-06T01:10:08.928685+0000","last_clean":"2023-07-06T01:10:08.928685+0000","last_became_active":"2023-07-06T01:10:07.807438+0000","last_became_peered":"2023-07-06T01:10:07.807438+0000","last_unstale":"2023-07-06T01:10:08.928685+0000","last_undegraded":"2023-07-06T01:10:08.928685+0000","last_fullsized":"2023-07-06T01:10:08.928685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:35.134211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.175959+0000","last_change":"2023-07-06T01:10:07.822037+0000","last_active":"2023-07-06T01:10:10.175959+0000","last_peered":"2023-07-06T01:10:10.175959+0000","last_clean":"2023-07-06T01:10:10.175959+0000","last_became_active":"2023-07-06T01:10:07.821738+0000","last_became_peered":"2023-07-06T01:10:07.821738+0000","last_unstale":"2023-07-06T01:10:10.175959+0000","last_undegraded":"2023-07-06T01:10:10.175959+0000","last_fullsized":"2023-07-06T01:10:10.175959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176564+0000","last_change":"2023-07-06T01:10:07.824369+0000","last_active":"2023-07-06T01:10:10.176564+0000","last_peered":"2023-07-06T01:10:10.176564+0000","last_clean":"2023-07-06T01:10:10.176564+0000","last_became_active":"2023-07-06T01:10:07.824090+0000","last_became_peered":"2023-07-06T01:10:07.824090+0000","last_unstale":"2023-07-06T01:10:10.176564+0000","last_undegraded":"2023-07-06T01:10:10.176564+0000","last_fullsized":"2023-07-06T01:10:10.176564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:45:43.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808353+0000","last_change":"2023-07-06T01:10:07.825684+0000","last_active":"2023-07-06T01:10:08.808353+0000","last_peered":"2023-07-06T01:10:08.808353+0000","last_clean":"2023-07-06T01:10:08.808353+0000","last_became_active":"2023-07-06T01:10:07.825358+0000","last_became_peered":"2023-07-06T01:10:07.825358+0000","last_unstale":"2023-07-06T01:10:08.808353+0000","last_undegraded":"2023-07-06T01:10:08.808353+0000","last_fullsized":"2023-07-06T01:10:08.808353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:24.845135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925719+0000","last_change":"2023-07-06T01:10:07.820349+0000","last_active":"2023-07-06T01:10:08.925719+0000","last_peered":"2023-07-06T01:10:08.925719+0000","last_clean":"2023-07-06T01:10:08.925719+0000","last_became_active":"2023-07-06T01:10:07.819865+0000","last_became_peered":"2023-07-06T01:10:07.819865+0000","last_unstale":"2023-07-06T01:10:08.925719+0000","last_undegraded":"2023-07-06T01:10:08.925719+0000","last_fullsized":"2023-07-06T01:10:08.925719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:14:35.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808306+0000","last_change":"2023-07-06T01:10:07.813969+0000","last_active":"2023-07-06T01:10:08.808306+0000","last_peered":"2023-07-06T01:10:08.808306+0000","last_clean":"2023-07-06T01:10:08.808306+0000","last_became_active":"2023-07-06T01:10:07.813644+0000","last_became_peered":"2023-07-06T01:10:07.813644+0000","last_unstale":"2023-07-06T01:10:08.808306+0000","last_undegraded":"2023-07-06T01:10:08.808306+0000","last_fullsized":"2023-07-06T01:10:08.808306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:48.094496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929082+0000","last_change":"2023-07-06T01:10:07.815698+0000","last_active":"2023-07-06T01:10:08.929082+0000","last_peered":"2023-07-06T01:10:08.929082+0000","last_clean":"2023-07-06T01:10:08.929082+0000","last_became_active":"2023-07-06T01:10:07.815342+0000","last_became_peered":"2023-07-06T01:10:07.815342+0000","last_unstale":"2023-07-06T01:10:08.929082+0000","last_undegraded":"2023-07-06T01:10:08.929082+0000","last_fullsized":"2023-07-06T01:10:08.929082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:28.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526600+0000","last_change":"2023-07-06T01:10:07.816519+0000","last_active":"2023-07-06T01:10:09.526600+0000","last_peered":"2023-07-06T01:10:09.526600+0000","last_clean":"2023-07-06T01:10:09.526600+0000","last_became_active":"2023-07-06T01:10:07.816179+0000","last_became_peered":"2023-07-06T01:10:07.816179+0000","last_unstale":"2023-07-06T01:10:09.526600+0000","last_undegraded":"2023-07-06T01:10:09.526600+0000","last_fullsized":"2023-07-06T01:10:09.526600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176450+0000","last_change":"2023-07-06T01:10:07.814621+0000","last_active":"2023-07-06T01:10:10.176450+0000","last_peered":"2023-07-06T01:10:10.176450+0000","last_clean":"2023-07-06T01:10:10.176450+0000","last_became_active":"2023-07-06T01:10:07.814369+0000","last_became_peered":"2023-07-06T01:10:07.814369+0000","last_unstale":"2023-07-06T01:10:10.176450+0000","last_undegraded":"2023-07-06T01:10:10.176450+0000","last_fullsized":"2023-07-06T01:10:10.176450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925336+0000","last_change":"2023-07-06T01:10:07.823764+0000","last_active":"2023-07-06T01:10:08.925336+0000","last_peered":"2023-07-06T01:10:08.925336+0000","last_clean":"2023-07-06T01:10:08.925336+0000","last_became_active":"2023-07-06T01:10:07.823358+0000","last_became_peered":"2023-07-06T01:10:07.823358+0000","last_unstale":"2023-07-06T01:10:08.925336+0000","last_undegraded":"2023-07-06T01:10:08.925336+0000","last_fullsized":"2023-07-06T01:10:08.925336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:08:58.658280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808563+0000","last_change":"2023-07-06T01:10:07.813041+0000","last_active":"2023-07-06T01:10:08.808563+0000","last_peered":"2023-07-06T01:10:08.808563+0000","last_clean":"2023-07-06T01:10:08.808563+0000","last_became_active":"2023-07-06T01:10:07.812344+0000","last_became_peered":"2023-07-06T01:10:07.812344+0000","last_unstale":"2023-07-06T01:10:08.808563+0000","last_undegraded":"2023-07-06T01:10:08.808563+0000","last_fullsized":"2023-07-06T01:10:08.808563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:40:42.603811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292842+0000","last_change":"2023-07-06T01:10:07.825442+0000","last_active":"2023-07-06T01:10:10.292842+0000","last_peered":"2023-07-06T01:10:10.292842+0000","last_clean":"2023-07-06T01:10:10.292842+0000","last_became_active":"2023-07-06T01:10:07.825204+0000","last_became_peered":"2023-07-06T01:10:07.825204+0000","last_unstale":"2023-07-06T01:10:10.292842+0000","last_undegraded":"2023-07-06T01:10:10.292842+0000","last_fullsized":"2023-07-06T01:10:10.292842+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:26:01.953305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808622+0000","last_change":"2023-07-06T01:10:07.818509+0000","last_active":"2023-07-06T01:10:08.808622+0000","last_peered":"2023-07-06T01:10:08.808622+0000","last_clean":"2023-07-06T01:10:08.808622+0000","last_became_active":"2023-07-06T01:10:07.818176+0000","last_became_peered":"2023-07-06T01:10:07.818176+0000","last_unstale":"2023-07-06T01:10:08.808622+0000","last_undegraded":"2023-07-06T01:10:08.808622+0000","last_fullsized":"2023-07-06T01:10:08.808622+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:11.718054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929043+0000","last_change":"2023-07-06T01:10:07.824249+0000","last_active":"2023-07-06T01:10:08.929043+0000","last_peered":"2023-07-06T01:10:08.929043+0000","last_clean":"2023-07-06T01:10:08.929043+0000","last_became_active":"2023-07-06T01:10:07.823772+0000","last_became_peered":"2023-07-06T01:10:07.823772+0000","last_unstale":"2023-07-06T01:10:08.929043+0000","last_undegraded":"2023-07-06T01:10:08.929043+0000","last_fullsized":"2023-07-06T01:10:08.929043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:16.530402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808558+0000","last_change":"2023-07-06T01:10:07.817726+0000","last_active":"2023-07-06T01:10:08.808558+0000","last_peered":"2023-07-06T01:10:08.808558+0000","last_clean":"2023-07-06T01:10:08.808558+0000","last_became_active":"2023-07-06T01:10:07.817443+0000","last_became_peered":"2023-07-06T01:10:07.817443+0000","last_unstale":"2023-07-06T01:10:08.808558+0000","last_undegraded":"2023-07-06T01:10:08.808558+0000","last_fullsized":"2023-07-06T01:10:08.808558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:30.539519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808496+0000","last_change":"2023-07-06T01:10:07.813165+0000","last_active":"2023-07-06T01:10:08.808496+0000","last_peered":"2023-07-06T01:10:08.808496+0000","last_clean":"2023-07-06T01:10:08.808496+0000","last_became_active":"2023-07-06T01:10:07.812878+0000","last_became_peered":"2023-07-06T01:10:07.812878+0000","last_unstale":"2023-07-06T01:10:08.808496+0000","last_undegraded":"2023-07-06T01:10:08.808496+0000","last_fullsized":"2023-07-06T01:10:08.808496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:14:35.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176180+0000","last_change":"2023-07-06T01:10:07.813083+0000","last_active":"2023-07-06T01:10:10.176180+0000","last_peered":"2023-07-06T01:10:10.176180+0000","last_clean":"2023-07-06T01:10:10.176180+0000","last_became_active":"2023-07-06T01:10:07.812663+0000","last_became_peered":"2023-07-06T01:10:07.812663+0000","last_unstale":"2023-07-06T01:10:10.176180+0000","last_undegraded":"2023-07-06T01:10:10.176180+0000","last_fullsized":"2023-07-06T01:10:10.176180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:28.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292267+0000","last_change":"2023-07-06T01:10:07.812437+0000","last_active":"2023-07-06T01:10:10.292267+0000","last_peered":"2023-07-06T01:10:10.292267+0000","last_clean":"2023-07-06T01:10:10.292267+0000","last_became_active":"2023-07-06T01:10:07.811942+0000","last_became_peered":"2023-07-06T01:10:07.811942+0000","last_unstale":"2023-07-06T01:10:10.292267+0000","last_undegraded":"2023-07-06T01:10:10.292267+0000","last_fullsized":"2023-07-06T01:10:10.292267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:52:08.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176390+0000","last_change":"2023-07-06T01:10:07.819217+0000","last_active":"2023-07-06T01:10:10.176390+0000","last_peered":"2023-07-06T01:10:10.176390+0000","last_clean":"2023-07-06T01:10:10.176390+0000","last_became_active":"2023-07-06T01:10:07.818951+0000","last_became_peered":"2023-07-06T01:10:07.818951+0000","last_unstale":"2023-07-06T01:10:10.176390+0000","last_undegraded":"2023-07-06T01:10:10.176390+0000","last_fullsized":"2023-07-06T01:10:10.176390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:16:23.298268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808562+0000","last_change":"2023-07-06T01:10:06.805034+0000","last_active":"2023-07-06T01:10:08.808562+0000","last_peered":"2023-07-06T01:10:08.808562+0000","last_clean":"2023-07-06T01:10:08.808562+0000","last_became_active":"2023-07-06T01:10:06.804721+0000","last_became_peered":"2023-07-06T01:10:06.804721+0000","last_unstale":"2023-07-06T01:10:08.808562+0000","last_undegraded":"2023-07-06T01:10:08.808562+0000","last_fullsized":"2023-07-06T01:10:08.808562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:09:00.821344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292666+0000","last_change":"2023-07-06T01:10:07.826432+0000","last_active":"2023-07-06T01:10:10.292666+0000","last_peered":"2023-07-06T01:10:10.292666+0000","last_clean":"2023-07-06T01:10:10.292666+0000","last_became_active":"2023-07-06T01:10:07.825736+0000","last_became_peered":"2023-07-06T01:10:07.825736+0000","last_unstale":"2023-07-06T01:10:10.292666+0000","last_undegraded":"2023-07-06T01:10:10.292666+0000","last_fullsized":"2023-07-06T01:10:10.292666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:23.811778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807525+0000","last_change":"2023-07-06T01:10:06.790212+0000","last_active":"2023-07-06T01:10:08.807525+0000","last_peered":"2023-07-06T01:10:08.807525+0000","last_clean":"2023-07-06T01:10:08.807525+0000","last_became_active":"2023-07-06T01:10:06.789874+0000","last_became_peered":"2023-07-06T01:10:06.789874+0000","last_unstale":"2023-07-06T01:10:08.807525+0000","last_undegraded":"2023-07-06T01:10:08.807525+0000","last_fullsized":"2023-07-06T01:10:08.807525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:49.430644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527024+0000","last_change":"2023-07-06T01:10:07.823077+0000","last_active":"2023-07-06T01:10:09.527024+0000","last_peered":"2023-07-06T01:10:09.527024+0000","last_clean":"2023-07-06T01:10:09.527024+0000","last_became_active":"2023-07-06T01:10:07.822443+0000","last_became_peered":"2023-07-06T01:10:07.822443+0000","last_unstale":"2023-07-06T01:10:09.527024+0000","last_undegraded":"2023-07-06T01:10:09.527024+0000","last_fullsized":"2023-07-06T01:10:09.527024+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:45:43.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292758+0000","last_change":"2023-07-06T01:10:06.805776+0000","last_active":"2023-07-06T01:10:10.292758+0000","last_peered":"2023-07-06T01:10:10.292758+0000","last_clean":"2023-07-06T01:10:10.292758+0000","last_became_active":"2023-07-06T01:10:06.805509+0000","last_became_peered":"2023-07-06T01:10:06.805509+0000","last_unstale":"2023-07-06T01:10:10.292758+0000","last_undegraded":"2023-07-06T01:10:10.292758+0000","last_fullsized":"2023-07-06T01:10:10.292758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:37.976734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293254+0000","last_change":"2023-07-06T01:10:07.811399+0000","last_active":"2023-07-06T01:10:10.293254+0000","last_peered":"2023-07-06T01:10:10.293254+0000","last_clean":"2023-07-06T01:10:10.293254+0000","last_became_active":"2023-07-06T01:10:07.811147+0000","last_became_peered":"2023-07-06T01:10:07.811147+0000","last_unstale":"2023-07-06T01:10:10.293254+0000","last_undegraded":"2023-07-06T01:10:10.293254+0000","last_fullsized":"2023-07-06T01:10:10.293254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526957+0000","last_change":"2023-07-06T01:10:06.806716+0000","last_active":"2023-07-06T01:10:09.526957+0000","last_peered":"2023-07-06T01:10:09.526957+0000","last_clean":"2023-07-06T01:10:09.526957+0000","last_became_active":"2023-07-06T01:10:06.806445+0000","last_became_peered":"2023-07-06T01:10:06.806445+0000","last_unstale":"2023-07-06T01:10:09.526957+0000","last_undegraded":"2023-07-06T01:10:09.526957+0000","last_fullsized":"2023-07-06T01:10:09.526957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:19.431286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807145+0000","last_change":"2023-07-06T01:10:07.816200+0000","last_active":"2023-07-06T01:10:08.807145+0000","last_peered":"2023-07-06T01:10:08.807145+0000","last_clean":"2023-07-06T01:10:08.807145+0000","last_became_active":"2023-07-06T01:10:07.815935+0000","last_became_peered":"2023-07-06T01:10:07.815935+0000","last_unstale":"2023-07-06T01:10:08.807145+0000","last_undegraded":"2023-07-06T01:10:08.807145+0000","last_fullsized":"2023-07-06T01:10:08.807145+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:36.817617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929253+0000","last_change":"2023-07-06T01:10:06.809079+0000","last_active":"2023-07-06T01:10:08.929253+0000","last_peered":"2023-07-06T01:10:08.929253+0000","last_clean":"2023-07-06T01:10:08.929253+0000","last_became_active":"2023-07-06T01:10:06.808787+0000","last_became_peered":"2023-07-06T01:10:06.808787+0000","last_unstale":"2023-07-06T01:10:08.929253+0000","last_undegraded":"2023-07-06T01:10:08.929253+0000","last_fullsized":"2023-07-06T01:10:08.929253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:16:22.292145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929017+0000","last_change":"2023-07-06T01:10:07.815750+0000","last_active":"2023-07-06T01:10:08.929017+0000","last_peered":"2023-07-06T01:10:08.929017+0000","last_clean":"2023-07-06T01:10:08.929017+0000","last_became_active":"2023-07-06T01:10:07.815473+0000","last_became_peered":"2023-07-06T01:10:07.815473+0000","last_unstale":"2023-07-06T01:10:08.929017+0000","last_undegraded":"2023-07-06T01:10:08.929017+0000","last_fullsized":"2023-07-06T01:10:08.929017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:44:39.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176064+0000","last_change":"2023-07-06T01:10:06.800324+0000","last_active":"2023-07-06T01:10:10.176064+0000","last_peered":"2023-07-06T01:10:10.176064+0000","last_clean":"2023-07-06T01:10:10.176064+0000","last_became_active":"2023-07-06T01:10:06.800018+0000","last_became_peered":"2023-07-06T01:10:06.800018+0000","last_unstale":"2023-07-06T01:10:10.176064+0000","last_undegraded":"2023-07-06T01:10:10.176064+0000","last_fullsized":"2023-07-06T01:10:10.176064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:44:38.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526616+0000","last_change":"2023-07-06T01:10:07.820329+0000","last_active":"2023-07-06T01:10:09.526616+0000","last_peered":"2023-07-06T01:10:09.526616+0000","last_clean":"2023-07-06T01:10:09.526616+0000","last_became_active":"2023-07-06T01:10:07.820032+0000","last_became_peered":"2023-07-06T01:10:07.820032+0000","last_unstale":"2023-07-06T01:10:09.526616+0000","last_undegraded":"2023-07-06T01:10:09.526616+0000","last_fullsized":"2023-07-06T01:10:09.526616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:41.722974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292764+0000","last_change":"2023-07-06T01:10:06.806348+0000","last_active":"2023-07-06T01:10:10.292764+0000","last_peered":"2023-07-06T01:10:10.292764+0000","last_clean":"2023-07-06T01:10:10.292764+0000","last_became_active":"2023-07-06T01:10:06.806025+0000","last_became_peered":"2023-07-06T01:10:06.806025+0000","last_unstale":"2023-07-06T01:10:10.292764+0000","last_undegraded":"2023-07-06T01:10:10.292764+0000","last_fullsized":"2023-07-06T01:10:10.292764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:18:26.224110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293080+0000","last_change":"2023-07-06T01:10:07.823248+0000","last_active":"2023-07-06T01:10:10.293080+0000","last_peered":"2023-07-06T01:10:10.293080+0000","last_clean":"2023-07-06T01:10:10.293080+0000","last_became_active":"2023-07-06T01:10:07.823019+0000","last_became_peered":"2023-07-06T01:10:07.823019+0000","last_unstale":"2023-07-06T01:10:10.293080+0000","last_undegraded":"2023-07-06T01:10:10.293080+0000","last_fullsized":"2023-07-06T01:10:10.293080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:10:08.264065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526501+0000","last_change":"2023-07-06T01:10:06.804303+0000","last_active":"2023-07-06T01:10:09.526501+0000","last_peered":"2023-07-06T01:10:09.526501+0000","last_clean":"2023-07-06T01:10:09.526501+0000","last_became_active":"2023-07-06T01:10:06.803992+0000","last_became_peered":"2023-07-06T01:10:06.803992+0000","last_unstale":"2023-07-06T01:10:09.526501+0000","last_undegraded":"2023-07-06T01:10:09.526501+0000","last_fullsized":"2023-07-06T01:10:09.526501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:36:37.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925625+0000","last_change":"2023-07-06T01:10:07.819091+0000","last_active":"2023-07-06T01:10:08.925625+0000","last_peered":"2023-07-06T01:10:08.925625+0000","last_clean":"2023-07-06T01:10:08.925625+0000","last_became_active":"2023-07-06T01:10:07.818453+0000","last_became_peered":"2023-07-06T01:10:07.818453+0000","last_unstale":"2023-07-06T01:10:08.925625+0000","last_undegraded":"2023-07-06T01:10:08.925625+0000","last_fullsized":"2023-07-06T01:10:08.925625+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:45:12.643274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293201+0000","last_change":"2023-07-06T01:10:06.804011+0000","last_active":"2023-07-06T01:10:10.293201+0000","last_peered":"2023-07-06T01:10:10.293201+0000","last_clean":"2023-07-06T01:10:10.293201+0000","last_became_active":"2023-07-06T01:10:06.803727+0000","last_became_peered":"2023-07-06T01:10:06.803727+0000","last_unstale":"2023-07-06T01:10:10.293201+0000","last_undegraded":"2023-07-06T01:10:10.293201+0000","last_fullsized":"2023-07-06T01:10:10.293201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:04.167852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176394+0000","last_change":"2023-07-06T01:10:07.814158+0000","last_active":"2023-07-06T01:10:10.176394+0000","last_peered":"2023-07-06T01:10:10.176394+0000","last_clean":"2023-07-06T01:10:10.176394+0000","last_became_active":"2023-07-06T01:10:07.813855+0000","last_became_peered":"2023-07-06T01:10:07.813855+0000","last_unstale":"2023-07-06T01:10:10.176394+0000","last_undegraded":"2023-07-06T01:10:10.176394+0000","last_fullsized":"2023-07-06T01:10:10.176394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:36:38.897886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929223+0000","last_change":"2023-07-06T01:10:06.813577+0000","last_active":"2023-07-06T01:10:08.929223+0000","last_peered":"2023-07-06T01:10:08.929223+0000","last_clean":"2023-07-06T01:10:08.929223+0000","last_became_active":"2023-07-06T01:10:06.813302+0000","last_became_peered":"2023-07-06T01:10:06.813302+0000","last_unstale":"2023-07-06T01:10:08.929223+0000","last_undegraded":"2023-07-06T01:10:08.929223+0000","last_fullsized":"2023-07-06T01:10:08.929223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:26:59.183194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807811+0000","last_change":"2023-07-06T01:10:07.815561+0000","last_active":"2023-07-06T01:10:08.807811+0000","last_peered":"2023-07-06T01:10:08.807811+0000","last_clean":"2023-07-06T01:10:08.807811+0000","last_became_active":"2023-07-06T01:10:07.815275+0000","last_became_peered":"2023-07-06T01:10:07.815275+0000","last_unstale":"2023-07-06T01:10:08.807811+0000","last_undegraded":"2023-07-06T01:10:08.807811+0000","last_fullsized":"2023-07-06T01:10:08.807811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:06.775851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929492+0000","last_change":"2023-07-06T01:10:06.808682+0000","last_active":"2023-07-06T01:10:08.929492+0000","last_peered":"2023-07-06T01:10:08.929492+0000","last_clean":"2023-07-06T01:10:08.929492+0000","last_became_active":"2023-07-06T01:10:06.808373+0000","last_became_peered":"2023-07-06T01:10:06.808373+0000","last_unstale":"2023-07-06T01:10:08.929492+0000","last_undegraded":"2023-07-06T01:10:08.929492+0000","last_fullsized":"2023-07-06T01:10:08.929492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:18.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527088+0000","last_change":"2023-07-06T01:10:07.818843+0000","last_active":"2023-07-06T01:10:09.527088+0000","last_peered":"2023-07-06T01:10:09.527088+0000","last_clean":"2023-07-06T01:10:09.527088+0000","last_became_active":"2023-07-06T01:10:07.818505+0000","last_became_peered":"2023-07-06T01:10:07.818505+0000","last_unstale":"2023-07-06T01:10:09.527088+0000","last_undegraded":"2023-07-06T01:10:09.527088+0000","last_fullsized":"2023-07-06T01:10:09.527088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:57:56.564105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292884+0000","last_change":"2023-07-06T01:10:06.807149+0000","last_active":"2023-07-06T01:10:10.292884+0000","last_peered":"2023-07-06T01:10:10.292884+0000","last_clean":"2023-07-06T01:10:10.292884+0000","last_became_active":"2023-07-06T01:10:06.806742+0000","last_became_peered":"2023-07-06T01:10:06.806742+0000","last_unstale":"2023-07-06T01:10:10.292884+0000","last_undegraded":"2023-07-06T01:10:10.292884+0000","last_fullsized":"2023-07-06T01:10:10.292884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:18:26.224110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807318+0000","last_change":"2023-07-06T01:10:07.802573+0000","last_active":"2023-07-06T01:10:08.807318+0000","last_peered":"2023-07-06T01:10:08.807318+0000","last_clean":"2023-07-06T01:10:08.807318+0000","last_became_active":"2023-07-06T01:10:07.802323+0000","last_became_peered":"2023-07-06T01:10:07.802323+0000","last_unstale":"2023-07-06T01:10:08.807318+0000","last_undegraded":"2023-07-06T01:10:08.807318+0000","last_fullsized":"2023-07-06T01:10:08.807318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:44:55.514372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293119+0000","last_change":"2023-07-06T01:10:06.804534+0000","last_active":"2023-07-06T01:10:10.293119+0000","last_peered":"2023-07-06T01:10:10.293119+0000","last_clean":"2023-07-06T01:10:10.293119+0000","last_became_active":"2023-07-06T01:10:06.804209+0000","last_became_peered":"2023-07-06T01:10:06.804209+0000","last_unstale":"2023-07-06T01:10:10.293119+0000","last_undegraded":"2023-07-06T01:10:10.293119+0000","last_fullsized":"2023-07-06T01:10:10.293119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:01:42.709448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292450+0000","last_change":"2023-07-06T01:10:07.808814+0000","last_active":"2023-07-06T01:10:10.292450+0000","last_peered":"2023-07-06T01:10:10.292450+0000","last_clean":"2023-07-06T01:10:10.292450+0000","last_became_active":"2023-07-06T01:10:07.808540+0000","last_became_peered":"2023-07-06T01:10:07.808540+0000","last_unstale":"2023-07-06T01:10:10.292450+0000","last_undegraded":"2023-07-06T01:10:10.292450+0000","last_fullsized":"2023-07-06T01:10:10.292450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:26:37.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292833+0000","last_change":"2023-07-06T01:10:06.807418+0000","last_active":"2023-07-06T01:10:10.292833+0000","last_peered":"2023-07-06T01:10:10.292833+0000","last_clean":"2023-07-06T01:10:10.292833+0000","last_became_active":"2023-07-06T01:10:06.807147+0000","last_became_peered":"2023-07-06T01:10:06.807147+0000","last_unstale":"2023-07-06T01:10:10.292833+0000","last_undegraded":"2023-07-06T01:10:10.292833+0000","last_fullsized":"2023-07-06T01:10:10.292833+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:01:18.944343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176511+0000","last_change":"2023-07-06T01:10:07.812345+0000","last_active":"2023-07-06T01:10:10.176511+0000","last_peered":"2023-07-06T01:10:10.176511+0000","last_clean":"2023-07-06T01:10:10.176511+0000","last_became_active":"2023-07-06T01:10:07.812003+0000","last_became_peered":"2023-07-06T01:10:07.812003+0000","last_unstale":"2023-07-06T01:10:10.176511+0000","last_undegraded":"2023-07-06T01:10:10.176511+0000","last_fullsized":"2023-07-06T01:10:10.176511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:19.364827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808029+0000","last_change":"2023-07-06T01:10:06.799586+0000","last_active":"2023-07-06T01:10:08.808029+0000","last_peered":"2023-07-06T01:10:08.808029+0000","last_clean":"2023-07-06T01:10:08.808029+0000","last_became_active":"2023-07-06T01:10:06.798927+0000","last_became_peered":"2023-07-06T01:10:06.798927+0000","last_unstale":"2023-07-06T01:10:08.808029+0000","last_undegraded":"2023-07-06T01:10:08.808029+0000","last_fullsized":"2023-07-06T01:10:08.808029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:45:11.637151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292983+0000","last_change":"2023-07-06T01:10:07.813586+0000","last_active":"2023-07-06T01:10:10.292983+0000","last_peered":"2023-07-06T01:10:10.292983+0000","last_clean":"2023-07-06T01:10:10.292983+0000","last_became_active":"2023-07-06T01:10:07.813309+0000","last_became_peered":"2023-07-06T01:10:07.813309+0000","last_unstale":"2023-07-06T01:10:10.292983+0000","last_undegraded":"2023-07-06T01:10:10.292983+0000","last_fullsized":"2023-07-06T01:10:10.292983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:07:10.691976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176151+0000","last_change":"2023-07-06T01:10:06.800447+0000","last_active":"2023-07-06T01:10:10.176151+0000","last_peered":"2023-07-06T01:10:10.176151+0000","last_clean":"2023-07-06T01:10:10.176151+0000","last_became_active":"2023-07-06T01:10:06.800066+0000","last_became_peered":"2023-07-06T01:10:06.800066+0000","last_unstale":"2023-07-06T01:10:10.176151+0000","last_undegraded":"2023-07-06T01:10:10.176151+0000","last_fullsized":"2023-07-06T01:10:10.176151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:23:56.193327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292877+0000","last_change":"2023-07-06T01:10:07.813658+0000","last_active":"2023-07-06T01:10:10.292877+0000","last_peered":"2023-07-06T01:10:10.292877+0000","last_clean":"2023-07-06T01:10:10.292877+0000","last_became_active":"2023-07-06T01:10:07.813362+0000","last_became_peered":"2023-07-06T01:10:07.813362+0000","last_unstale":"2023-07-06T01:10:10.292877+0000","last_undegraded":"2023-07-06T01:10:10.292877+0000","last_fullsized":"2023-07-06T01:10:10.292877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:38.982857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929466+0000","last_change":"2023-07-06T01:10:06.808881+0000","last_active":"2023-07-06T01:10:08.929466+0000","last_peered":"2023-07-06T01:10:08.929466+0000","last_clean":"2023-07-06T01:10:08.929466+0000","last_became_active":"2023-07-06T01:10:06.808508+0000","last_became_peered":"2023-07-06T01:10:06.808508+0000","last_unstale":"2023-07-06T01:10:08.929466+0000","last_undegraded":"2023-07-06T01:10:08.929466+0000","last_fullsized":"2023-07-06T01:10:08.929466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:13.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929373+0000","last_change":"2023-07-06T01:10:07.824962+0000","last_active":"2023-07-06T01:10:08.929373+0000","last_peered":"2023-07-06T01:10:08.929373+0000","last_clean":"2023-07-06T01:10:08.929373+0000","last_became_active":"2023-07-06T01:10:07.824692+0000","last_became_peered":"2023-07-06T01:10:07.824692+0000","last_unstale":"2023-07-06T01:10:08.929373+0000","last_undegraded":"2023-07-06T01:10:08.929373+0000","last_fullsized":"2023-07-06T01:10:08.929373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:51:23.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527106+0000","last_change":"2023-07-06T01:10:06.809959+0000","last_active":"2023-07-06T01:10:09.527106+0000","last_peered":"2023-07-06T01:10:09.527106+0000","last_clean":"2023-07-06T01:10:09.527106+0000","last_became_active":"2023-07-06T01:10:06.809678+0000","last_became_peered":"2023-07-06T01:10:06.809678+0000","last_unstale":"2023-07-06T01:10:09.527106+0000","last_undegraded":"2023-07-06T01:10:09.527106+0000","last_fullsized":"2023-07-06T01:10:09.527106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:04:14.606778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527110+0000","last_change":"2023-07-06T01:10:07.823316+0000","last_active":"2023-07-06T01:10:09.527110+0000","last_peered":"2023-07-06T01:10:09.527110+0000","last_clean":"2023-07-06T01:10:09.527110+0000","last_became_active":"2023-07-06T01:10:07.822822+0000","last_became_peered":"2023-07-06T01:10:07.822822+0000","last_unstale":"2023-07-06T01:10:09.527110+0000","last_undegraded":"2023-07-06T01:10:09.527110+0000","last_fullsized":"2023-07-06T01:10:09.527110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:00.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925653+0000","last_change":"2023-07-06T01:10:06.795677+0000","last_active":"2023-07-06T01:10:08.925653+0000","last_peered":"2023-07-06T01:10:08.925653+0000","last_clean":"2023-07-06T01:10:08.925653+0000","last_became_active":"2023-07-06T01:10:06.795397+0000","last_became_peered":"2023-07-06T01:10:06.795397+0000","last_unstale":"2023-07-06T01:10:08.925653+0000","last_undegraded":"2023-07-06T01:10:08.925653+0000","last_fullsized":"2023-07-06T01:10:08.925653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:23.839012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925774+0000","last_change":"2023-07-06T01:10:07.822940+0000","last_active":"2023-07-06T01:10:08.925774+0000","last_peered":"2023-07-06T01:10:08.925774+0000","last_clean":"2023-07-06T01:10:08.925774+0000","last_became_active":"2023-07-06T01:10:07.822643+0000","last_became_peered":"2023-07-06T01:10:07.822643+0000","last_unstale":"2023-07-06T01:10:08.925774+0000","last_undegraded":"2023-07-06T01:10:08.925774+0000","last_fullsized":"2023-07-06T01:10:08.925774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:52:39.080340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292725+0000","last_change":"2023-07-06T01:10:06.805082+0000","last_active":"2023-07-06T01:10:10.292725+0000","last_peered":"2023-07-06T01:10:10.292725+0000","last_clean":"2023-07-06T01:10:10.292725+0000","last_became_active":"2023-07-06T01:10:06.804838+0000","last_became_peered":"2023-07-06T01:10:06.804838+0000","last_unstale":"2023-07-06T01:10:10.292725+0000","last_undegraded":"2023-07-06T01:10:10.292725+0000","last_fullsized":"2023-07-06T01:10:10.292725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:50:37.124045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176156+0000","last_change":"2023-07-06T01:10:07.822018+0000","last_active":"2023-07-06T01:10:10.176156+0000","last_peered":"2023-07-06T01:10:10.176156+0000","last_clean":"2023-07-06T01:10:10.176156+0000","last_became_active":"2023-07-06T01:10:07.821703+0000","last_became_peered":"2023-07-06T01:10:07.821703+0000","last_unstale":"2023-07-06T01:10:10.176156+0000","last_undegraded":"2023-07-06T01:10:10.176156+0000","last_fullsized":"2023-07-06T01:10:10.176156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:16.530402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925465+0000","last_change":"2023-07-06T01:10:06.799356+0000","last_active":"2023-07-06T01:10:08.925465+0000","last_peered":"2023-07-06T01:10:08.925465+0000","last_clean":"2023-07-06T01:10:08.925465+0000","last_became_active":"2023-07-06T01:10:06.799048+0000","last_became_peered":"2023-07-06T01:10:06.799048+0000","last_unstale":"2023-07-06T01:10:08.925465+0000","last_undegraded":"2023-07-06T01:10:08.925465+0000","last_fullsized":"2023-07-06T01:10:08.925465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:29:55.235414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807225+0000","last_change":"2023-07-06T01:10:07.816019+0000","last_active":"2023-07-06T01:10:08.807225+0000","last_peered":"2023-07-06T01:10:08.807225+0000","last_clean":"2023-07-06T01:10:08.807225+0000","last_became_active":"2023-07-06T01:10:07.815683+0000","last_became_peered":"2023-07-06T01:10:07.815683+0000","last_unstale":"2023-07-06T01:10:08.807225+0000","last_undegraded":"2023-07-06T01:10:08.807225+0000","last_fullsized":"2023-07-06T01:10:08.807225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:24.105581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925606+0000","last_change":"2023-07-06T01:10:06.800220+0000","last_active":"2023-07-06T01:10:08.925606+0000","last_peered":"2023-07-06T01:10:08.925606+0000","last_clean":"2023-07-06T01:10:08.925606+0000","last_became_active":"2023-07-06T01:10:06.799927+0000","last_became_peered":"2023-07-06T01:10:06.799927+0000","last_unstale":"2023-07-06T01:10:08.925606+0000","last_undegraded":"2023-07-06T01:10:08.925606+0000","last_fullsized":"2023-07-06T01:10:08.925606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:47.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928837+0000","last_change":"2023-07-06T01:10:07.809747+0000","last_active":"2023-07-06T01:10:08.928837+0000","last_peered":"2023-07-06T01:10:08.928837+0000","last_clean":"2023-07-06T01:10:08.928837+0000","last_became_active":"2023-07-06T01:10:07.809478+0000","last_became_peered":"2023-07-06T01:10:07.809478+0000","last_unstale":"2023-07-06T01:10:08.928837+0000","last_undegraded":"2023-07-06T01:10:08.928837+0000","last_fullsized":"2023-07-06T01:10:08.928837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:51.135163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176342+0000","last_change":"2023-07-06T01:10:06.795373+0000","last_active":"2023-07-06T01:10:10.176342+0000","last_peered":"2023-07-06T01:10:10.176342+0000","last_clean":"2023-07-06T01:10:10.176342+0000","last_became_active":"2023-07-06T01:10:06.795083+0000","last_became_peered":"2023-07-06T01:10:06.795083+0000","last_unstale":"2023-07-06T01:10:10.176342+0000","last_undegraded":"2023-07-06T01:10:10.176342+0000","last_fullsized":"2023-07-06T01:10:10.176342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:40.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293037+0000","last_change":"2023-07-06T01:10:07.823627+0000","last_active":"2023-07-06T01:10:10.293037+0000","last_peered":"2023-07-06T01:10:10.293037+0000","last_clean":"2023-07-06T01:10:10.293037+0000","last_became_active":"2023-07-06T01:10:07.823404+0000","last_became_peered":"2023-07-06T01:10:07.823404+0000","last_unstale":"2023-07-06T01:10:10.293037+0000","last_undegraded":"2023-07-06T01:10:10.293037+0000","last_fullsized":"2023-07-06T01:10:10.293037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:01:19.950466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925271+0000","last_change":"2023-07-06T01:10:06.796576+0000","last_active":"2023-07-06T01:10:08.925271+0000","last_peered":"2023-07-06T01:10:08.925271+0000","last_clean":"2023-07-06T01:10:08.925271+0000","last_became_active":"2023-07-06T01:10:06.796099+0000","last_became_peered":"2023-07-06T01:10:06.796099+0000","last_unstale":"2023-07-06T01:10:08.925271+0000","last_undegraded":"2023-07-06T01:10:08.925271+0000","last_fullsized":"2023-07-06T01:10:08.925271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:30.136697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807226+0000","last_change":"2023-07-06T01:10:07.814294+0000","last_active":"2023-07-06T01:10:08.807226+0000","last_peered":"2023-07-06T01:10:08.807226+0000","last_clean":"2023-07-06T01:10:08.807226+0000","last_became_active":"2023-07-06T01:10:07.814055+0000","last_became_peered":"2023-07-06T01:10:07.814055+0000","last_unstale":"2023-07-06T01:10:08.807226+0000","last_undegraded":"2023-07-06T01:10:08.807226+0000","last_fullsized":"2023-07-06T01:10:08.807226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:20.006641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807716+0000","last_change":"2023-07-06T01:10:06.797438+0000","last_active":"2023-07-06T01:10:08.807716+0000","last_peered":"2023-07-06T01:10:08.807716+0000","last_clean":"2023-07-06T01:10:08.807716+0000","last_became_active":"2023-07-06T01:10:06.796874+0000","last_became_peered":"2023-07-06T01:10:06.796874+0000","last_unstale":"2023-07-06T01:10:08.807716+0000","last_undegraded":"2023-07-06T01:10:08.807716+0000","last_fullsized":"2023-07-06T01:10:08.807716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:19:58.925416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292773+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:10.292773+0000","last_peered":"2023-07-06T01:10:10.292773+0000","last_clean":"2023-07-06T01:10:10.292773+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:10.292773+0000","last_undegraded":"2023-07-06T01:10:10.292773+0000","last_fullsized":"2023-07-06T01:10:10.292773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:48.074798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292812+0000","last_change":"2023-07-06T01:10:07.826361+0000","last_active":"2023-07-06T01:10:10.292812+0000","last_peered":"2023-07-06T01:10:10.292812+0000","last_clean":"2023-07-06T01:10:10.292812+0000","last_became_active":"2023-07-06T01:10:07.826078+0000","last_became_peered":"2023-07-06T01:10:07.826078+0000","last_unstale":"2023-07-06T01:10:10.292812+0000","last_undegraded":"2023-07-06T01:10:10.292812+0000","last_fullsized":"2023-07-06T01:10:10.292812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:50:38.130168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807728+0000","last_change":"2023-07-06T01:10:06.794351+0000","last_active":"2023-07-06T01:10:08.807728+0000","last_peered":"2023-07-06T01:10:08.807728+0000","last_clean":"2023-07-06T01:10:08.807728+0000","last_became_active":"2023-07-06T01:10:06.794075+0000","last_became_peered":"2023-07-06T01:10:06.794075+0000","last_unstale":"2023-07-06T01:10:08.807728+0000","last_undegraded":"2023-07-06T01:10:08.807728+0000","last_fullsized":"2023-07-06T01:10:08.807728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:44.480259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929252+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:08.929252+0000","last_peered":"2023-07-06T01:10:08.929252+0000","last_clean":"2023-07-06T01:10:08.929252+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:08.929252+0000","last_undegraded":"2023-07-06T01:10:08.929252+0000","last_fullsized":"2023-07-06T01:10:08.929252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:32:27.735979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176632+0000","last_change":"2023-07-06T01:10:07.823399+0000","last_active":"2023-07-06T01:10:10.176632+0000","last_peered":"2023-07-06T01:10:10.176632+0000","last_clean":"2023-07-06T01:10:10.176632+0000","last_became_active":"2023-07-06T01:10:07.823114+0000","last_became_peered":"2023-07-06T01:10:07.823114+0000","last_unstale":"2023-07-06T01:10:10.176632+0000","last_undegraded":"2023-07-06T01:10:10.176632+0000","last_fullsized":"2023-07-06T01:10:10.176632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:20.437409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925774+0000","last_change":"2023-07-06T01:10:06.809864+0000","last_active":"2023-07-06T01:10:08.925774+0000","last_peered":"2023-07-06T01:10:08.925774+0000","last_clean":"2023-07-06T01:10:08.925774+0000","last_became_active":"2023-07-06T01:10:06.809495+0000","last_became_peered":"2023-07-06T01:10:06.809495+0000","last_unstale":"2023-07-06T01:10:08.925774+0000","last_undegraded":"2023-07-06T01:10:08.925774+0000","last_fullsized":"2023-07-06T01:10:08.925774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:29.533396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925406+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:08.925406+0000","last_peered":"2023-07-06T01:10:08.925406+0000","last_clean":"2023-07-06T01:10:08.925406+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:08.925406+0000","last_undegraded":"2023-07-06T01:10:08.925406+0000","last_fullsized":"2023-07-06T01:10:08.925406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:45.997901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929245+0000","last_change":"2023-07-06T01:10:07.826965+0000","last_active":"2023-07-06T01:10:08.929245+0000","last_peered":"2023-07-06T01:10:08.929245+0000","last_clean":"2023-07-06T01:10:08.929245+0000","last_became_active":"2023-07-06T01:10:07.826589+0000","last_became_peered":"2023-07-06T01:10:07.826589+0000","last_unstale":"2023-07-06T01:10:08.929245+0000","last_undegraded":"2023-07-06T01:10:08.929245+0000","last_fullsized":"2023-07-06T01:10:08.929245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:23:57.199450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176423+0000","last_change":"2023-07-06T01:10:06.798475+0000","last_active":"2023-07-06T01:10:10.176423+0000","last_peered":"2023-07-06T01:10:10.176423+0000","last_clean":"2023-07-06T01:10:10.176423+0000","last_became_active":"2023-07-06T01:10:06.798167+0000","last_became_peered":"2023-07-06T01:10:06.798167+0000","last_unstale":"2023-07-06T01:10:10.176423+0000","last_undegraded":"2023-07-06T01:10:10.176423+0000","last_fullsized":"2023-07-06T01:10:10.176423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:13.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929339+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:08.929339+0000","last_peered":"2023-07-06T01:10:08.929339+0000","last_clean":"2023-07-06T01:10:08.929339+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:08.929339+0000","last_undegraded":"2023-07-06T01:10:08.929339+0000","last_fullsized":"2023-07-06T01:10:08.929339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:35:16.280708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176298+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:10.176298+0000","last_peered":"2023-07-06T01:10:10.176298+0000","last_clean":"2023-07-06T01:10:10.176298+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:10.176298+0000","last_undegraded":"2023-07-06T01:10:10.176298+0000","last_fullsized":"2023-07-06T01:10:10.176298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:25:30.527939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292693+0000","last_change":"2023-07-06T01:10:07.825229+0000","last_active":"2023-07-06T01:10:10.292693+0000","last_peered":"2023-07-06T01:10:10.292693+0000","last_clean":"2023-07-06T01:10:10.292693+0000","last_became_active":"2023-07-06T01:10:07.824954+0000","last_became_peered":"2023-07-06T01:10:07.824954+0000","last_unstale":"2023-07-06T01:10:10.292693+0000","last_undegraded":"2023-07-06T01:10:10.292693+0000","last_fullsized":"2023-07-06T01:10:10.292693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:26:37.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929419+0000","last_change":"2023-07-06T01:10:06.809002+0000","last_active":"2023-07-06T01:10:08.929419+0000","last_peered":"2023-07-06T01:10:08.929419+0000","last_clean":"2023-07-06T01:10:08.929419+0000","last_became_active":"2023-07-06T01:10:06.808542+0000","last_became_peered":"2023-07-06T01:10:06.808542+0000","last_unstale":"2023-07-06T01:10:08.929419+0000","last_undegraded":"2023-07-06T01:10:08.929419+0000","last_fullsized":"2023-07-06T01:10:08.929419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:40.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176378+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:10.176378+0000","last_peered":"2023-07-06T01:10:10.176378+0000","last_clean":"2023-07-06T01:10:10.176378+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:10.176378+0000","last_undegraded":"2023-07-06T01:10:10.176378+0000","last_fullsized":"2023-07-06T01:10:10.176378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:50:00.679088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292686+0000","last_change":"2023-07-06T01:10:07.820497+0000","last_active":"2023-07-06T01:10:10.292686+0000","last_peered":"2023-07-06T01:10:10.292686+0000","last_clean":"2023-07-06T01:10:10.292686+0000","last_became_active":"2023-07-06T01:10:07.820225+0000","last_became_peered":"2023-07-06T01:10:07.820225+0000","last_unstale":"2023-07-06T01:10:10.292686+0000","last_undegraded":"2023-07-06T01:10:10.292686+0000","last_fullsized":"2023-07-06T01:10:10.292686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:43:43.977091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808426+0000","last_change":"2023-07-06T01:10:06.801680+0000","last_active":"2023-07-06T01:10:08.808426+0000","last_peered":"2023-07-06T01:10:08.808426+0000","last_clean":"2023-07-06T01:10:08.808426+0000","last_became_active":"2023-07-06T01:10:06.801250+0000","last_became_peered":"2023-07-06T01:10:06.801250+0000","last_unstale":"2023-07-06T01:10:08.808426+0000","last_undegraded":"2023-07-06T01:10:08.808426+0000","last_fullsized":"2023-07-06T01:10:08.808426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:52:38.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176628+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:10.176628+0000","last_peered":"2023-07-06T01:10:10.176628+0000","last_clean":"2023-07-06T01:10:10.176628+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:10.176628+0000","last_undegraded":"2023-07-06T01:10:10.176628+0000","last_fullsized":"2023-07-06T01:10:10.176628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:56:33.946928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526811+0000","last_change":"2023-07-06T01:10:07.818021+0000","last_active":"2023-07-06T01:10:09.526811+0000","last_peered":"2023-07-06T01:10:09.526811+0000","last_clean":"2023-07-06T01:10:09.526811+0000","last_became_active":"2023-07-06T01:10:07.817686+0000","last_became_peered":"2023-07-06T01:10:07.817686+0000","last_unstale":"2023-07-06T01:10:09.526811+0000","last_undegraded":"2023-07-06T01:10:09.526811+0000","last_fullsized":"2023-07-06T01:10:09.526811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:14.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526497+0000","last_change":"2023-07-06T01:10:06.807223+0000","last_active":"2023-07-06T01:10:09.526497+0000","last_peered":"2023-07-06T01:10:09.526497+0000","last_clean":"2023-07-06T01:10:09.526497+0000","last_became_active":"2023-07-06T01:10:06.806960+0000","last_became_peered":"2023-07-06T01:10:06.806960+0000","last_unstale":"2023-07-06T01:10:09.526497+0000","last_undegraded":"2023-07-06T01:10:09.526497+0000","last_fullsized":"2023-07-06T01:10:09.526497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:51:22.290143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292705+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:10.292705+0000","last_peered":"2023-07-06T01:10:10.292705+0000","last_clean":"2023-07-06T01:10:10.292705+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:10.292705+0000","last_undegraded":"2023-07-06T01:10:10.292705+0000","last_fullsized":"2023-07-06T01:10:10.292705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:47.944191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176395+0000","last_change":"2023-07-06T01:10:07.825033+0000","last_active":"2023-07-06T01:10:10.176395+0000","last_peered":"2023-07-06T01:10:10.176395+0000","last_clean":"2023-07-06T01:10:10.176395+0000","last_became_active":"2023-07-06T01:10:07.824350+0000","last_became_peered":"2023-07-06T01:10:07.824350+0000","last_unstale":"2023-07-06T01:10:10.176395+0000","last_undegraded":"2023-07-06T01:10:10.176395+0000","last_fullsized":"2023-07-06T01:10:10.176395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:33:50.353157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292370+0000","last_change":"2023-07-06T01:10:06.804068+0000","last_active":"2023-07-06T01:10:10.292370+0000","last_peered":"2023-07-06T01:10:10.292370+0000","last_clean":"2023-07-06T01:10:10.292370+0000","last_became_active":"2023-07-06T01:10:06.803802+0000","last_became_peered":"2023-07-06T01:10:06.803802+0000","last_unstale":"2023-07-06T01:10:10.292370+0000","last_undegraded":"2023-07-06T01:10:10.292370+0000","last_fullsized":"2023-07-06T01:10:10.292370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:26:00.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808654+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:08.808654+0000","last_peered":"2023-07-06T01:10:08.808654+0000","last_clean":"2023-07-06T01:10:08.808654+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:08.808654+0000","last_undegraded":"2023-07-06T01:10:08.808654+0000","last_fullsized":"2023-07-06T01:10:08.808654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:27:33.713444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":761722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":170302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":760122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.998}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":171318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.433},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.871}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":170324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.747}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0680000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":169832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.753}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.626}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:13.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T01:10:13.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.397+0000 7eff9d7ff700 1 Processor -- start 2023-07-06T01:10:13.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.397+0000 7eff9d7ff700 1 -- start start 2023-07-06T01:10:13.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff9d7ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff980b0440 0x7eff98143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff9d7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff9815b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff9d7ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff981441f0 con 0x7eff9815df60 2023-07-06T01:10:13.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff9d7ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9815e3e0 con 0x7eff980b0440 2023-07-06T01:10:13.401 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff9d7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9815a930 con 0x7eff9815b0e0 2023-07-06T01:10:13.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff96ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff980b0440 0x7eff98143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff967fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7eff9815df60 0x7eff980b0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58006/0 (socket says 172.21.15.71:58006) 2023-07-06T01:10:13.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.398+0000 7eff967fc700 1 -- 172.21.15.71:0/3146581929 learned_addr learned my addr 172.21.15.71:0/3146581929 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:13.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff977fe700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff9815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff96ffd700 1 -- 172.21.15.71:0/3146581929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 msgr2=0x7eff9815b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:13.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff96ffd700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff9815b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff96ffd700 1 -- 172.21.15.71:0/3146581929 >> v1:172.21.15.71:6789/0 conn(0x7eff9815df60 legacy=0x7eff980b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff96ffd700 1 -- 172.21.15.71:0/3146581929 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9815e660 con 0x7eff980b0440 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff977fe700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff9815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff96ffd700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98143900 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7eff88009840 tx=0x7eff88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e466bd1b987b78de server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff95ffb700 1 -- 172.21.15.71:0/3146581929 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011830 con 0x7eff980b0440 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff95ffb700 1 -- 172.21.15.71:0/3146581929 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88011990 con 0x7eff980b0440 2023-07-06T01:10:13.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.399+0000 7eff95ffb700 1 -- 172.21.15.71:0/3146581929 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88011d20 con 0x7eff980b0440 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 -- 172.21.15.71:0/3146581929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 msgr2=0x7eff98143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98143900 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7eff88009840 tx=0x7eff88009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 -- 172.21.15.71:0/3146581929 shutdown_connections 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff9815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/3146581929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98143900 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 -- 172.21.15.71:0/3146581929 >> 172.21.15.71:0/3146581929 conn(0x7eff980cb440 msgr2=0x7eff980cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:13.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 -- 172.21.15.71:0/3146581929 shutdown_connections 2023-07-06T01:10:13.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.400+0000 7eff9d7ff700 1 -- 172.21.15.71:0/3146581929 wait complete. 2023-07-06T01:10:13.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.402+0000 7eff9d7ff700 1 Processor -- start 2023-07-06T01:10:13.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.402+0000 7eff9d7ff700 1 -- start start 2023-07-06T01:10:13.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff9d7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff9d7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff981e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff9d7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff9815df60 0x7eff981e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff9d7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980af000 con 0x7eff980b0440 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff9d7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980af2e0 con 0x7eff9815df60 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff9d7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff980af5c0 con 0x7eff9815b0e0 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57522/0 (socket says 172.21.15.71:57522) 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 -- 172.21.15.71:0/4216488852 learned_addr learned my addr 172.21.15.71:0/4216488852 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff967fc700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff981e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff977fe700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff9815df60 0x7eff981e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 -- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 msgr2=0x7eff981e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff981e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 -- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff9815df60 msgr2=0x7eff981e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff9815df60 0x7eff981e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff96ffd700 1 -- 172.21.15.71:0/4216488852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff880094a0 con 0x7eff980b0440 2023-07-06T01:10:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.403+0000 7eff977fe700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff9815df60 0x7eff981e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.404+0000 7eff96ffd700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98159000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff88000c00 tx=0x7eff88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.404+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff880038a0 con 0x7eff980b0440 2023-07-06T01:10:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.404+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8801e070 con 0x7eff980b0440 2023-07-06T01:10:13.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.404+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff980af8a0 con 0x7eff980b0440 2023-07-06T01:10:13.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.404+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88003c60 con 0x7eff980b0440 2023-07-06T01:10:13.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.404+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff98159f20 con 0x7eff980b0440 2023-07-06T01:10:13.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.405+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9806fa50 con 0x7eff980b0440 2023-07-06T01:10:13.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.406+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff8802d450 con 0x7eff980b0440 2023-07-06T01:10:13.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.407+0000 7eff7f7fe700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7eff8406ace0 0x7eff8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.407+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff8808a5e0 con 0x7eff980b0440 2023-07-06T01:10:13.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.408+0000 7eff967fc700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7eff8406ace0 0x7eff8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.408+0000 7eff967fc700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7eff8406ace0 0x7eff8406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff9815a300 tx=0x7eff8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:13.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.411+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff88055680 con 0x7eff980b0440 2023-07-06T01:10:13.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.685+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7eff980008d0 con 0x7eff980b0440 2023-07-06T01:10:13.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.686+0000 7eff7f7fe700 1 -- 172.21.15.71:0/4216488852 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1270 (secure 0 0 0) 0x7eff8802c3b0 con 0x7eff980b0440 2023-07-06T01:10:13.689 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:13.690 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":110,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1688605715,"num_in_osds":8,"osd_in_since":1688605707,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":45},{"state_name":"creating+peering","count":43},{"state_name":"active+clean","count":17}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":224899072,"bytes_avail":772869214208,"bytes_total":773094113280,"unknown_pgs_ratio":0.4285714328289032,"inactive_pgs_ratio":0.40952381491661072},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5145}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-06T01:09:46.844707+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-06T01:10:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7eff8406ace0 msgr2=0x7eff8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7eff8406ace0 0x7eff8406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff9815a300 tx=0x7eff8c009040 comp rx=0 tx=0).stop 2023-07-06T01:10:13.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 msgr2=0x7eff98159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98159000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff88000c00 tx=0x7eff88004750 comp rx=0 tx=0).stop 2023-07-06T01:10:13.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 shutdown_connections 2023-07-06T01:10:13.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7eff8406ace0 0x7eff8406d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff9815df60 0x7eff981e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff980b0440 0x7eff98159000 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 --2- 172.21.15.71:0/4216488852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7eff9815b0e0 0x7eff981e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 >> 172.21.15.71:0/4216488852 conn(0x7eff980cb440 msgr2=0x7eff980ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:13.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 shutdown_connections 2023-07-06T01:10:13.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.688+0000 7eff9d7ff700 1 -- 172.21.15.71:0/4216488852 wait complete. 2023-07-06T01:10:13.708 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T01:10:13.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.901+0000 7f6ea79ff700 1 Processor -- start 2023-07-06T01:10:13.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.902+0000 7f6ea79ff700 1 -- start start 2023-07-06T01:10:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea79ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6ea00b6110 0x7f6ea00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea79ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00cf780 con 0x7f6ea00b5c90 2023-07-06T01:10:13.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea79ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00cd490 con 0x7f6ea015fca0 2023-07-06T01:10:13.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea79ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00cd770 con 0x7f6ea00b6110 2023-07-06T01:10:13.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea4f9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6ea00b5c90 0x7f6ea00d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58008/0 (socket says 172.21.15.71:58008) 2023-07-06T01:10:13.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea4f9a700 1 -- 172.21.15.71:0/825788523 learned_addr learned my addr 172.21.15.71:0/825788523 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:13.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.903+0000 7f6ea5f9c700 1 --2- 172.21.15.71:0/825788523 >> v2:172.21.15.194:3300/0 conn(0x7f6ea00b6110 0x7f6ea00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541716407 0 0) 0x7f6ea00cf780 con 0x7f6ea00b5c90 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e8c0035b0 con 0x7f6ea00b5c90 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391646305 0 0) 0x7f6ea00cd490 con 0x7f6ea015fca0 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea00cf780 con 0x7f6ea015fca0 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6ea5f9c700 1 -- 172.21.15.71:0/825788523 >> v1:172.21.15.194:6789/0 conn(0x7f6ea015fca0 legacy=0x7f6ea00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6ea5f9c700 1 -- 172.21.15.71:0/825788523 >> v1:172.21.15.71:6789/0 conn(0x7f6ea00b5c90 legacy=0x7f6ea00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6ea5f9c700 1 -- 172.21.15.71:0/825788523 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00cda50 con 0x7f6ea00b6110 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6ea5f9c700 1 --2- 172.21.15.71:0/825788523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea00cfc10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009d90 tx=0x7f6e9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49e4572134c1f00 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800e070 con 0x7f6ea00b6110 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9800bb20 con 0x7f6ea00b6110 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.904+0000 7f6e97fff700 1 -- 172.21.15.71:0/825788523 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e98012430 con 0x7f6ea00b6110 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 -- 172.21.15.71:0/825788523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 msgr2=0x7f6ea00cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/825788523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea00cfc10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009d90 tx=0x7f6e9800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:13.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 -- 172.21.15.71:0/825788523 shutdown_connections 2023-07-06T01:10:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/825788523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea00cfc10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 -- 172.21.15.71:0/825788523 >> 172.21.15.71:0/825788523 conn(0x7f6ea006c150 msgr2=0x7f6ea006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 -- 172.21.15.71:0/825788523 shutdown_connections 2023-07-06T01:10:13.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.905+0000 7f6ea79ff700 1 -- 172.21.15.71:0/825788523 wait complete. 2023-07-06T01:10:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.907+0000 7f6ea79ff700 1 Processor -- start 2023-07-06T01:10:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.907+0000 7f6ea79ff700 1 -- start start 2023-07-06T01:10:13.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea79ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 0x7f6ea014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea79ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea79ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea015fca0 0x7f6ea015d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea79ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea014fca0 con 0x7f6ea00b5c90 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea79ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea015e230 con 0x7f6ea00b6110 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea79ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0150170 con 0x7f6ea015fca0 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 0x7f6ea014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 0x7f6ea014f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57528/0 (socket says 172.21.15.71:57528) 2023-07-06T01:10:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 -- 172.21.15.71:0/2594909722 learned_addr learned my addr 172.21.15.71:0/2594909722 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea4f9a700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea5f9c700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea015fca0 0x7f6ea015d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 -- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea015fca0 msgr2=0x7f6ea015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea015fca0 0x7f6ea015d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 -- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 msgr2=0x7f6ea015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:13.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea015c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:13.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea579b700 1 -- 172.21.15.71:0/2594909722 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e98009a70 con 0x7f6ea00b5c90 2023-07-06T01:10:13.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.908+0000 7f6ea4f9a700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea015c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:13.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.909+0000 7f6ea579b700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 0x7f6ea014f760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00c500 tx=0x7f6e9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.909+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0052d0 con 0x7f6ea00b5c90 2023-07-06T01:10:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.909+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c005450 con 0x7f6ea00b5c90 2023-07-06T01:10:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.909+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea015b940 con 0x7f6ea00b5c90 2023-07-06T01:10:13.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.909+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0038c0 con 0x7f6ea00b5c90 2023-07-06T01:10:13.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.909+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea015bf00 con 0x7f6ea00b5c90 2023-07-06T01:10:13.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.910+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea0067000 con 0x7f6ea00b5c90 2023-07-06T01:10:13.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.911+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e9c003a20 con 0x7f6ea00b5c90 2023-07-06T01:10:13.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.912+0000 7f6e95ffb700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e8406ace0 0x7f6e8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:13.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.912+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e9c088a90 con 0x7f6ea00b5c90 2023-07-06T01:10:13.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.912+0000 7f6ea4f9a700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e8406ace0 0x7f6e8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:13.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.913+0000 7f6ea4f9a700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e8406ace0 0x7f6e8406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ea015b4c0 tx=0x7f6e90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:13.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:13.916+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e9c053a10 con 0x7f6ea00b5c90 2023-07-06T01:10:14.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.107+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ea006ae40 con 0x7f6e8406ace0 2023-07-06T01:10:14.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.116+0000 7f6e95ffb700 1 -- 172.21.15.71:0/2594909722 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310642 (secure 0 0 0) 0x7f6e900014f0 con 0x7f6e8406ace0 2023-07-06T01:10:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e8406ace0 msgr2=0x7f6e8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e8406ace0 0x7f6e8406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ea015b4c0 tx=0x7f6e90009040 comp rx=0 tx=0).stop 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 msgr2=0x7f6ea014f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 0x7f6ea014f760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00c500 tx=0x7f6e9c00c8c0 comp rx=0 tx=0).stop 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 shutdown_connections 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e8406ace0 0x7f6e8406d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ea015fca0 0x7f6ea015d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ea00b5c90 0x7f6ea014f760 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 --2- 172.21.15.71:0/2594909722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ea00b6110 0x7f6ea015c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 >> 172.21.15.71:0/2594909722 conn(0x7f6ea006c150 msgr2=0x7f6ea00d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 shutdown_connections 2023-07-06T01:10:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:14.121+0000 7f6ea79ff700 1 -- 172.21.15.71:0/2594909722 wait complete. 2023-07-06T01:10:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:14.141 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-07-06T01:10:12.851169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":4424,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":4530176,"data_stored":2543220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.068136"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293083+0000","last_change":"2023-07-06T01:10:07.822535+0000","last_active":"2023-07-06T01:10:10.293083+0000","last_peered":"2023-07-06T01:10:10.293083+0000","last_clean":"2023-07-06T01:10:10.293083+0000","last_became_active":"2023-07-06T01:10:07.822279+0000","last_became_peered":"2023-07-06T01:10:07.822279+0000","last_unstale":"2023-07-06T01:10:10.293083+0000","last_undegraded":"2023-07-06T01:10:10.293083+0000","last_fullsized":"2023-07-06T01:10:10.293083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:35.134211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292681+0000","last_change":"2023-07-06T01:10:07.812868+0000","last_active":"2023-07-06T01:10:10.292681+0000","last_peered":"2023-07-06T01:10:10.292681+0000","last_clean":"2023-07-06T01:10:10.292681+0000","last_became_active":"2023-07-06T01:10:07.812592+0000","last_became_peered":"2023-07-06T01:10:07.812592+0000","last_unstale":"2023-07-06T01:10:10.292681+0000","last_undegraded":"2023-07-06T01:10:10.292681+0000","last_fullsized":"2023-07-06T01:10:10.292681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:00:10.561369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807349+0000","last_change":"2023-07-06T01:10:07.809507+0000","last_active":"2023-07-06T01:10:08.807349+0000","last_peered":"2023-07-06T01:10:08.807349+0000","last_clean":"2023-07-06T01:10:08.807349+0000","last_became_active":"2023-07-06T01:10:07.809254+0000","last_became_peered":"2023-07-06T01:10:07.809254+0000","last_unstale":"2023-07-06T01:10:08.807349+0000","last_undegraded":"2023-07-06T01:10:08.807349+0000","last_fullsized":"2023-07-06T01:10:08.807349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:18.134260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925490+0000","last_change":"2023-07-06T01:10:07.819304+0000","last_active":"2023-07-06T01:10:08.925490+0000","last_peered":"2023-07-06T01:10:08.925490+0000","last_clean":"2023-07-06T01:10:08.925490+0000","last_became_active":"2023-07-06T01:10:07.818818+0000","last_became_peered":"2023-07-06T01:10:07.818818+0000","last_unstale":"2023-07-06T01:10:08.925490+0000","last_undegraded":"2023-07-06T01:10:08.925490+0000","last_fullsized":"2023-07-06T01:10:08.925490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:20:12.375361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925429+0000","last_change":"2023-07-06T01:10:07.810967+0000","last_active":"2023-07-06T01:10:08.925429+0000","last_peered":"2023-07-06T01:10:08.925429+0000","last_clean":"2023-07-06T01:10:08.925429+0000","last_became_active":"2023-07-06T01:10:07.810687+0000","last_became_peered":"2023-07-06T01:10:07.810687+0000","last_unstale":"2023-07-06T01:10:08.925429+0000","last_undegraded":"2023-07-06T01:10:08.925429+0000","last_fullsized":"2023-07-06T01:10:08.925429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:49.575328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292456+0000","last_change":"2023-07-06T01:10:07.817746+0000","last_active":"2023-07-06T01:10:10.292456+0000","last_peered":"2023-07-06T01:10:10.292456+0000","last_clean":"2023-07-06T01:10:10.292456+0000","last_became_active":"2023-07-06T01:10:07.817454+0000","last_became_peered":"2023-07-06T01:10:07.817454+0000","last_unstale":"2023-07-06T01:10:10.292456+0000","last_undegraded":"2023-07-06T01:10:10.292456+0000","last_fullsized":"2023-07-06T01:10:10.292456+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:22:13.208835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928717+0000","last_change":"2023-07-06T01:10:07.823801+0000","last_active":"2023-07-06T01:10:08.928717+0000","last_peered":"2023-07-06T01:10:08.928717+0000","last_clean":"2023-07-06T01:10:08.928717+0000","last_became_active":"2023-07-06T01:10:07.823516+0000","last_became_peered":"2023-07-06T01:10:07.823516+0000","last_unstale":"2023-07-06T01:10:08.928717+0000","last_undegraded":"2023-07-06T01:10:08.928717+0000","last_fullsized":"2023-07-06T01:10:08.928717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:01:43.715571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292327+0000","last_change":"2023-07-06T01:10:07.810858+0000","last_active":"2023-07-06T01:10:10.292327+0000","last_peered":"2023-07-06T01:10:10.292327+0000","last_clean":"2023-07-06T01:10:10.292327+0000","last_became_active":"2023-07-06T01:10:07.810632+0000","last_became_peered":"2023-07-06T01:10:07.810632+0000","last_unstale":"2023-07-06T01:10:10.292327+0000","last_undegraded":"2023-07-06T01:10:10.292327+0000","last_fullsized":"2023-07-06T01:10:10.292327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:23.811778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807590+0000","last_change":"2023-07-06T01:10:07.809187+0000","last_active":"2023-07-06T01:10:08.807590+0000","last_peered":"2023-07-06T01:10:08.807590+0000","last_clean":"2023-07-06T01:10:08.807590+0000","last_became_active":"2023-07-06T01:10:07.808049+0000","last_became_peered":"2023-07-06T01:10:07.808049+0000","last_unstale":"2023-07-06T01:10:08.807590+0000","last_undegraded":"2023-07-06T01:10:08.807590+0000","last_fullsized":"2023-07-06T01:10:08.807590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:01.835630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928929+0000","last_change":"2023-07-06T01:10:07.812604+0000","last_active":"2023-07-06T01:10:08.928929+0000","last_peered":"2023-07-06T01:10:08.928929+0000","last_clean":"2023-07-06T01:10:08.928929+0000","last_became_active":"2023-07-06T01:10:07.812173+0000","last_became_peered":"2023-07-06T01:10:07.812173+0000","last_unstale":"2023-07-06T01:10:08.928929+0000","last_undegraded":"2023-07-06T01:10:08.928929+0000","last_fullsized":"2023-07-06T01:10:08.928929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929391+0000","last_change":"2023-07-06T01:10:07.814043+0000","last_active":"2023-07-06T01:10:08.929391+0000","last_peered":"2023-07-06T01:10:08.929391+0000","last_clean":"2023-07-06T01:10:08.929391+0000","last_became_active":"2023-07-06T01:10:07.813789+0000","last_became_peered":"2023-07-06T01:10:07.813789+0000","last_unstale":"2023-07-06T01:10:08.929391+0000","last_undegraded":"2023-07-06T01:10:08.929391+0000","last_fullsized":"2023-07-06T01:10:08.929391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807355+0000","last_change":"2023-07-06T01:10:07.807508+0000","last_active":"2023-07-06T01:10:08.807355+0000","last_peered":"2023-07-06T01:10:08.807355+0000","last_clean":"2023-07-06T01:10:08.807355+0000","last_became_active":"2023-07-06T01:10:07.807242+0000","last_became_peered":"2023-07-06T01:10:07.807242+0000","last_unstale":"2023-07-06T01:10:08.807355+0000","last_undegraded":"2023-07-06T01:10:08.807355+0000","last_fullsized":"2023-07-06T01:10:08.807355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:38.073944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928889+0000","last_change":"2023-07-06T01:10:07.825131+0000","last_active":"2023-07-06T01:10:08.928889+0000","last_peered":"2023-07-06T01:10:08.928889+0000","last_clean":"2023-07-06T01:10:08.928889+0000","last_became_active":"2023-07-06T01:10:07.824874+0000","last_became_peered":"2023-07-06T01:10:07.824874+0000","last_unstale":"2023-07-06T01:10:08.928889+0000","last_undegraded":"2023-07-06T01:10:08.928889+0000","last_fullsized":"2023-07-06T01:10:08.928889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:05.173975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526966+0000","last_change":"2023-07-06T01:10:07.820491+0000","last_active":"2023-07-06T01:10:09.526966+0000","last_peered":"2023-07-06T01:10:09.526966+0000","last_clean":"2023-07-06T01:10:09.526966+0000","last_became_active":"2023-07-06T01:10:07.820151+0000","last_became_peered":"2023-07-06T01:10:07.820151+0000","last_unstale":"2023-07-06T01:10:09.526966+0000","last_undegraded":"2023-07-06T01:10:09.526966+0000","last_fullsized":"2023-07-06T01:10:09.526966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:19.364827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928685+0000","last_change":"2023-07-06T01:10:07.807665+0000","last_active":"2023-07-06T01:10:08.928685+0000","last_peered":"2023-07-06T01:10:08.928685+0000","last_clean":"2023-07-06T01:10:08.928685+0000","last_became_active":"2023-07-06T01:10:07.807438+0000","last_became_peered":"2023-07-06T01:10:07.807438+0000","last_unstale":"2023-07-06T01:10:08.928685+0000","last_undegraded":"2023-07-06T01:10:08.928685+0000","last_fullsized":"2023-07-06T01:10:08.928685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:35.134211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.175959+0000","last_change":"2023-07-06T01:10:07.822037+0000","last_active":"2023-07-06T01:10:10.175959+0000","last_peered":"2023-07-06T01:10:10.175959+0000","last_clean":"2023-07-06T01:10:10.175959+0000","last_became_active":"2023-07-06T01:10:07.821738+0000","last_became_peered":"2023-07-06T01:10:07.821738+0000","last_unstale":"2023-07-06T01:10:10.175959+0000","last_undegraded":"2023-07-06T01:10:10.175959+0000","last_fullsized":"2023-07-06T01:10:10.175959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176564+0000","last_change":"2023-07-06T01:10:07.824369+0000","last_active":"2023-07-06T01:10:10.176564+0000","last_peered":"2023-07-06T01:10:10.176564+0000","last_clean":"2023-07-06T01:10:10.176564+0000","last_became_active":"2023-07-06T01:10:07.824090+0000","last_became_peered":"2023-07-06T01:10:07.824090+0000","last_unstale":"2023-07-06T01:10:10.176564+0000","last_undegraded":"2023-07-06T01:10:10.176564+0000","last_fullsized":"2023-07-06T01:10:10.176564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:45:43.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808353+0000","last_change":"2023-07-06T01:10:07.825684+0000","last_active":"2023-07-06T01:10:08.808353+0000","last_peered":"2023-07-06T01:10:08.808353+0000","last_clean":"2023-07-06T01:10:08.808353+0000","last_became_active":"2023-07-06T01:10:07.825358+0000","last_became_peered":"2023-07-06T01:10:07.825358+0000","last_unstale":"2023-07-06T01:10:08.808353+0000","last_undegraded":"2023-07-06T01:10:08.808353+0000","last_fullsized":"2023-07-06T01:10:08.808353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:24.845135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925719+0000","last_change":"2023-07-06T01:10:07.820349+0000","last_active":"2023-07-06T01:10:08.925719+0000","last_peered":"2023-07-06T01:10:08.925719+0000","last_clean":"2023-07-06T01:10:08.925719+0000","last_became_active":"2023-07-06T01:10:07.819865+0000","last_became_peered":"2023-07-06T01:10:07.819865+0000","last_unstale":"2023-07-06T01:10:08.925719+0000","last_undegraded":"2023-07-06T01:10:08.925719+0000","last_fullsized":"2023-07-06T01:10:08.925719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:14:35.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808306+0000","last_change":"2023-07-06T01:10:07.813969+0000","last_active":"2023-07-06T01:10:08.808306+0000","last_peered":"2023-07-06T01:10:08.808306+0000","last_clean":"2023-07-06T01:10:08.808306+0000","last_became_active":"2023-07-06T01:10:07.813644+0000","last_became_peered":"2023-07-06T01:10:07.813644+0000","last_unstale":"2023-07-06T01:10:08.808306+0000","last_undegraded":"2023-07-06T01:10:08.808306+0000","last_fullsized":"2023-07-06T01:10:08.808306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:48.094496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929082+0000","last_change":"2023-07-06T01:10:07.815698+0000","last_active":"2023-07-06T01:10:08.929082+0000","last_peered":"2023-07-06T01:10:08.929082+0000","last_clean":"2023-07-06T01:10:08.929082+0000","last_became_active":"2023-07-06T01:10:07.815342+0000","last_became_peered":"2023-07-06T01:10:07.815342+0000","last_unstale":"2023-07-06T01:10:08.929082+0000","last_undegraded":"2023-07-06T01:10:08.929082+0000","last_fullsized":"2023-07-06T01:10:08.929082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:28.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526600+0000","last_change":"2023-07-06T01:10:07.816519+0000","last_active":"2023-07-06T01:10:09.526600+0000","last_peered":"2023-07-06T01:10:09.526600+0000","last_clean":"2023-07-06T01:10:09.526600+0000","last_became_active":"2023-07-06T01:10:07.816179+0000","last_became_peered":"2023-07-06T01:10:07.816179+0000","last_unstale":"2023-07-06T01:10:09.526600+0000","last_undegraded":"2023-07-06T01:10:09.526600+0000","last_fullsized":"2023-07-06T01:10:09.526600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176450+0000","last_change":"2023-07-06T01:10:07.814621+0000","last_active":"2023-07-06T01:10:10.176450+0000","last_peered":"2023-07-06T01:10:10.176450+0000","last_clean":"2023-07-06T01:10:10.176450+0000","last_became_active":"2023-07-06T01:10:07.814369+0000","last_became_peered":"2023-07-06T01:10:07.814369+0000","last_unstale":"2023-07-06T01:10:10.176450+0000","last_undegraded":"2023-07-06T01:10:10.176450+0000","last_fullsized":"2023-07-06T01:10:10.176450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925336+0000","last_change":"2023-07-06T01:10:07.823764+0000","last_active":"2023-07-06T01:10:08.925336+0000","last_peered":"2023-07-06T01:10:08.925336+0000","last_clean":"2023-07-06T01:10:08.925336+0000","last_became_active":"2023-07-06T01:10:07.823358+0000","last_became_peered":"2023-07-06T01:10:07.823358+0000","last_unstale":"2023-07-06T01:10:08.925336+0000","last_undegraded":"2023-07-06T01:10:08.925336+0000","last_fullsized":"2023-07-06T01:10:08.925336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:08:58.658280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808563+0000","last_change":"2023-07-06T01:10:07.813041+0000","last_active":"2023-07-06T01:10:08.808563+0000","last_peered":"2023-07-06T01:10:08.808563+0000","last_clean":"2023-07-06T01:10:08.808563+0000","last_became_active":"2023-07-06T01:10:07.812344+0000","last_became_peered":"2023-07-06T01:10:07.812344+0000","last_unstale":"2023-07-06T01:10:08.808563+0000","last_undegraded":"2023-07-06T01:10:08.808563+0000","last_fullsized":"2023-07-06T01:10:08.808563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:40:42.603811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292842+0000","last_change":"2023-07-06T01:10:07.825442+0000","last_active":"2023-07-06T01:10:10.292842+0000","last_peered":"2023-07-06T01:10:10.292842+0000","last_clean":"2023-07-06T01:10:10.292842+0000","last_became_active":"2023-07-06T01:10:07.825204+0000","last_became_peered":"2023-07-06T01:10:07.825204+0000","last_unstale":"2023-07-06T01:10:10.292842+0000","last_undegraded":"2023-07-06T01:10:10.292842+0000","last_fullsized":"2023-07-06T01:10:10.292842+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:26:01.953305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808622+0000","last_change":"2023-07-06T01:10:07.818509+0000","last_active":"2023-07-06T01:10:08.808622+0000","last_peered":"2023-07-06T01:10:08.808622+0000","last_clean":"2023-07-06T01:10:08.808622+0000","last_became_active":"2023-07-06T01:10:07.818176+0000","last_became_peered":"2023-07-06T01:10:07.818176+0000","last_unstale":"2023-07-06T01:10:08.808622+0000","last_undegraded":"2023-07-06T01:10:08.808622+0000","last_fullsized":"2023-07-06T01:10:08.808622+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:11.718054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929043+0000","last_change":"2023-07-06T01:10:07.824249+0000","last_active":"2023-07-06T01:10:08.929043+0000","last_peered":"2023-07-06T01:10:08.929043+0000","last_clean":"2023-07-06T01:10:08.929043+0000","last_became_active":"2023-07-06T01:10:07.823772+0000","last_became_peered":"2023-07-06T01:10:07.823772+0000","last_unstale":"2023-07-06T01:10:08.929043+0000","last_undegraded":"2023-07-06T01:10:08.929043+0000","last_fullsized":"2023-07-06T01:10:08.929043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:16.530402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808558+0000","last_change":"2023-07-06T01:10:07.817726+0000","last_active":"2023-07-06T01:10:08.808558+0000","last_peered":"2023-07-06T01:10:08.808558+0000","last_clean":"2023-07-06T01:10:08.808558+0000","last_became_active":"2023-07-06T01:10:07.817443+0000","last_became_peered":"2023-07-06T01:10:07.817443+0000","last_unstale":"2023-07-06T01:10:08.808558+0000","last_undegraded":"2023-07-06T01:10:08.808558+0000","last_fullsized":"2023-07-06T01:10:08.808558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:30.539519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808496+0000","last_change":"2023-07-06T01:10:07.813165+0000","last_active":"2023-07-06T01:10:08.808496+0000","last_peered":"2023-07-06T01:10:08.808496+0000","last_clean":"2023-07-06T01:10:08.808496+0000","last_became_active":"2023-07-06T01:10:07.812878+0000","last_became_peered":"2023-07-06T01:10:07.812878+0000","last_unstale":"2023-07-06T01:10:08.808496+0000","last_undegraded":"2023-07-06T01:10:08.808496+0000","last_fullsized":"2023-07-06T01:10:08.808496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:14:35.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176180+0000","last_change":"2023-07-06T01:10:07.813083+0000","last_active":"2023-07-06T01:10:10.176180+0000","last_peered":"2023-07-06T01:10:10.176180+0000","last_clean":"2023-07-06T01:10:10.176180+0000","last_became_active":"2023-07-06T01:10:07.812663+0000","last_became_peered":"2023-07-06T01:10:07.812663+0000","last_unstale":"2023-07-06T01:10:10.176180+0000","last_undegraded":"2023-07-06T01:10:10.176180+0000","last_fullsized":"2023-07-06T01:10:10.176180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:28.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292267+0000","last_change":"2023-07-06T01:10:07.812437+0000","last_active":"2023-07-06T01:10:10.292267+0000","last_peered":"2023-07-06T01:10:10.292267+0000","last_clean":"2023-07-06T01:10:10.292267+0000","last_became_active":"2023-07-06T01:10:07.811942+0000","last_became_peered":"2023-07-06T01:10:07.811942+0000","last_unstale":"2023-07-06T01:10:10.292267+0000","last_undegraded":"2023-07-06T01:10:10.292267+0000","last_fullsized":"2023-07-06T01:10:10.292267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:52:08.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176390+0000","last_change":"2023-07-06T01:10:07.819217+0000","last_active":"2023-07-06T01:10:10.176390+0000","last_peered":"2023-07-06T01:10:10.176390+0000","last_clean":"2023-07-06T01:10:10.176390+0000","last_became_active":"2023-07-06T01:10:07.818951+0000","last_became_peered":"2023-07-06T01:10:07.818951+0000","last_unstale":"2023-07-06T01:10:10.176390+0000","last_undegraded":"2023-07-06T01:10:10.176390+0000","last_fullsized":"2023-07-06T01:10:10.176390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:16:23.298268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808562+0000","last_change":"2023-07-06T01:10:06.805034+0000","last_active":"2023-07-06T01:10:08.808562+0000","last_peered":"2023-07-06T01:10:08.808562+0000","last_clean":"2023-07-06T01:10:08.808562+0000","last_became_active":"2023-07-06T01:10:06.804721+0000","last_became_peered":"2023-07-06T01:10:06.804721+0000","last_unstale":"2023-07-06T01:10:08.808562+0000","last_undegraded":"2023-07-06T01:10:08.808562+0000","last_fullsized":"2023-07-06T01:10:08.808562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:09:00.821344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292666+0000","last_change":"2023-07-06T01:10:07.826432+0000","last_active":"2023-07-06T01:10:10.292666+0000","last_peered":"2023-07-06T01:10:10.292666+0000","last_clean":"2023-07-06T01:10:10.292666+0000","last_became_active":"2023-07-06T01:10:07.825736+0000","last_became_peered":"2023-07-06T01:10:07.825736+0000","last_unstale":"2023-07-06T01:10:10.292666+0000","last_undegraded":"2023-07-06T01:10:10.292666+0000","last_fullsized":"2023-07-06T01:10:10.292666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:23.811778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807525+0000","last_change":"2023-07-06T01:10:06.790212+0000","last_active":"2023-07-06T01:10:08.807525+0000","last_peered":"2023-07-06T01:10:08.807525+0000","last_clean":"2023-07-06T01:10:08.807525+0000","last_became_active":"2023-07-06T01:10:06.789874+0000","last_became_peered":"2023-07-06T01:10:06.789874+0000","last_unstale":"2023-07-06T01:10:08.807525+0000","last_undegraded":"2023-07-06T01:10:08.807525+0000","last_fullsized":"2023-07-06T01:10:08.807525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:49.430644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527024+0000","last_change":"2023-07-06T01:10:07.823077+0000","last_active":"2023-07-06T01:10:09.527024+0000","last_peered":"2023-07-06T01:10:09.527024+0000","last_clean":"2023-07-06T01:10:09.527024+0000","last_became_active":"2023-07-06T01:10:07.822443+0000","last_became_peered":"2023-07-06T01:10:07.822443+0000","last_unstale":"2023-07-06T01:10:09.527024+0000","last_undegraded":"2023-07-06T01:10:09.527024+0000","last_fullsized":"2023-07-06T01:10:09.527024+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:45:43.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292758+0000","last_change":"2023-07-06T01:10:06.805776+0000","last_active":"2023-07-06T01:10:10.292758+0000","last_peered":"2023-07-06T01:10:10.292758+0000","last_clean":"2023-07-06T01:10:10.292758+0000","last_became_active":"2023-07-06T01:10:06.805509+0000","last_became_peered":"2023-07-06T01:10:06.805509+0000","last_unstale":"2023-07-06T01:10:10.292758+0000","last_undegraded":"2023-07-06T01:10:10.292758+0000","last_fullsized":"2023-07-06T01:10:10.292758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:37.976734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293254+0000","last_change":"2023-07-06T01:10:07.811399+0000","last_active":"2023-07-06T01:10:10.293254+0000","last_peered":"2023-07-06T01:10:10.293254+0000","last_clean":"2023-07-06T01:10:10.293254+0000","last_became_active":"2023-07-06T01:10:07.811147+0000","last_became_peered":"2023-07-06T01:10:07.811147+0000","last_unstale":"2023-07-06T01:10:10.293254+0000","last_undegraded":"2023-07-06T01:10:10.293254+0000","last_fullsized":"2023-07-06T01:10:10.293254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526957+0000","last_change":"2023-07-06T01:10:06.806716+0000","last_active":"2023-07-06T01:10:09.526957+0000","last_peered":"2023-07-06T01:10:09.526957+0000","last_clean":"2023-07-06T01:10:09.526957+0000","last_became_active":"2023-07-06T01:10:06.806445+0000","last_became_peered":"2023-07-06T01:10:06.806445+0000","last_unstale":"2023-07-06T01:10:09.526957+0000","last_undegraded":"2023-07-06T01:10:09.526957+0000","last_fullsized":"2023-07-06T01:10:09.526957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:19.431286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807145+0000","last_change":"2023-07-06T01:10:07.816200+0000","last_active":"2023-07-06T01:10:08.807145+0000","last_peered":"2023-07-06T01:10:08.807145+0000","last_clean":"2023-07-06T01:10:08.807145+0000","last_became_active":"2023-07-06T01:10:07.815935+0000","last_became_peered":"2023-07-06T01:10:07.815935+0000","last_unstale":"2023-07-06T01:10:08.807145+0000","last_undegraded":"2023-07-06T01:10:08.807145+0000","last_fullsized":"2023-07-06T01:10:08.807145+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:36.817617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929253+0000","last_change":"2023-07-06T01:10:06.809079+0000","last_active":"2023-07-06T01:10:08.929253+0000","last_peered":"2023-07-06T01:10:08.929253+0000","last_clean":"2023-07-06T01:10:08.929253+0000","last_became_active":"2023-07-06T01:10:06.808787+0000","last_became_peered":"2023-07-06T01:10:06.808787+0000","last_unstale":"2023-07-06T01:10:08.929253+0000","last_undegraded":"2023-07-06T01:10:08.929253+0000","last_fullsized":"2023-07-06T01:10:08.929253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:16:22.292145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929017+0000","last_change":"2023-07-06T01:10:07.815750+0000","last_active":"2023-07-06T01:10:08.929017+0000","last_peered":"2023-07-06T01:10:08.929017+0000","last_clean":"2023-07-06T01:10:08.929017+0000","last_became_active":"2023-07-06T01:10:07.815473+0000","last_became_peered":"2023-07-06T01:10:07.815473+0000","last_unstale":"2023-07-06T01:10:08.929017+0000","last_undegraded":"2023-07-06T01:10:08.929017+0000","last_fullsized":"2023-07-06T01:10:08.929017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:44:39.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176064+0000","last_change":"2023-07-06T01:10:06.800324+0000","last_active":"2023-07-06T01:10:10.176064+0000","last_peered":"2023-07-06T01:10:10.176064+0000","last_clean":"2023-07-06T01:10:10.176064+0000","last_became_active":"2023-07-06T01:10:06.800018+0000","last_became_peered":"2023-07-06T01:10:06.800018+0000","last_unstale":"2023-07-06T01:10:10.176064+0000","last_undegraded":"2023-07-06T01:10:10.176064+0000","last_fullsized":"2023-07-06T01:10:10.176064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:44:38.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526616+0000","last_change":"2023-07-06T01:10:07.820329+0000","last_active":"2023-07-06T01:10:09.526616+0000","last_peered":"2023-07-06T01:10:09.526616+0000","last_clean":"2023-07-06T01:10:09.526616+0000","last_became_active":"2023-07-06T01:10:07.820032+0000","last_became_peered":"2023-07-06T01:10:07.820032+0000","last_unstale":"2023-07-06T01:10:09.526616+0000","last_undegraded":"2023-07-06T01:10:09.526616+0000","last_fullsized":"2023-07-06T01:10:09.526616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:41.722974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292764+0000","last_change":"2023-07-06T01:10:06.806348+0000","last_active":"2023-07-06T01:10:10.292764+0000","last_peered":"2023-07-06T01:10:10.292764+0000","last_clean":"2023-07-06T01:10:10.292764+0000","last_became_active":"2023-07-06T01:10:06.806025+0000","last_became_peered":"2023-07-06T01:10:06.806025+0000","last_unstale":"2023-07-06T01:10:10.292764+0000","last_undegraded":"2023-07-06T01:10:10.292764+0000","last_fullsized":"2023-07-06T01:10:10.292764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:18:26.224110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293080+0000","last_change":"2023-07-06T01:10:07.823248+0000","last_active":"2023-07-06T01:10:10.293080+0000","last_peered":"2023-07-06T01:10:10.293080+0000","last_clean":"2023-07-06T01:10:10.293080+0000","last_became_active":"2023-07-06T01:10:07.823019+0000","last_became_peered":"2023-07-06T01:10:07.823019+0000","last_unstale":"2023-07-06T01:10:10.293080+0000","last_undegraded":"2023-07-06T01:10:10.293080+0000","last_fullsized":"2023-07-06T01:10:10.293080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:10:08.264065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526501+0000","last_change":"2023-07-06T01:10:06.804303+0000","last_active":"2023-07-06T01:10:09.526501+0000","last_peered":"2023-07-06T01:10:09.526501+0000","last_clean":"2023-07-06T01:10:09.526501+0000","last_became_active":"2023-07-06T01:10:06.803992+0000","last_became_peered":"2023-07-06T01:10:06.803992+0000","last_unstale":"2023-07-06T01:10:09.526501+0000","last_undegraded":"2023-07-06T01:10:09.526501+0000","last_fullsized":"2023-07-06T01:10:09.526501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:36:37.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925625+0000","last_change":"2023-07-06T01:10:07.819091+0000","last_active":"2023-07-06T01:10:08.925625+0000","last_peered":"2023-07-06T01:10:08.925625+0000","last_clean":"2023-07-06T01:10:08.925625+0000","last_became_active":"2023-07-06T01:10:07.818453+0000","last_became_peered":"2023-07-06T01:10:07.818453+0000","last_unstale":"2023-07-06T01:10:08.925625+0000","last_undegraded":"2023-07-06T01:10:08.925625+0000","last_fullsized":"2023-07-06T01:10:08.925625+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:45:12.643274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293201+0000","last_change":"2023-07-06T01:10:06.804011+0000","last_active":"2023-07-06T01:10:10.293201+0000","last_peered":"2023-07-06T01:10:10.293201+0000","last_clean":"2023-07-06T01:10:10.293201+0000","last_became_active":"2023-07-06T01:10:06.803727+0000","last_became_peered":"2023-07-06T01:10:06.803727+0000","last_unstale":"2023-07-06T01:10:10.293201+0000","last_undegraded":"2023-07-06T01:10:10.293201+0000","last_fullsized":"2023-07-06T01:10:10.293201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:04.167852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176394+0000","last_change":"2023-07-06T01:10:07.814158+0000","last_active":"2023-07-06T01:10:10.176394+0000","last_peered":"2023-07-06T01:10:10.176394+0000","last_clean":"2023-07-06T01:10:10.176394+0000","last_became_active":"2023-07-06T01:10:07.813855+0000","last_became_peered":"2023-07-06T01:10:07.813855+0000","last_unstale":"2023-07-06T01:10:10.176394+0000","last_undegraded":"2023-07-06T01:10:10.176394+0000","last_fullsized":"2023-07-06T01:10:10.176394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:36:38.897886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929223+0000","last_change":"2023-07-06T01:10:06.813577+0000","last_active":"2023-07-06T01:10:08.929223+0000","last_peered":"2023-07-06T01:10:08.929223+0000","last_clean":"2023-07-06T01:10:08.929223+0000","last_became_active":"2023-07-06T01:10:06.813302+0000","last_became_peered":"2023-07-06T01:10:06.813302+0000","last_unstale":"2023-07-06T01:10:08.929223+0000","last_undegraded":"2023-07-06T01:10:08.929223+0000","last_fullsized":"2023-07-06T01:10:08.929223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:26:59.183194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807811+0000","last_change":"2023-07-06T01:10:07.815561+0000","last_active":"2023-07-06T01:10:08.807811+0000","last_peered":"2023-07-06T01:10:08.807811+0000","last_clean":"2023-07-06T01:10:08.807811+0000","last_became_active":"2023-07-06T01:10:07.815275+0000","last_became_peered":"2023-07-06T01:10:07.815275+0000","last_unstale":"2023-07-06T01:10:08.807811+0000","last_undegraded":"2023-07-06T01:10:08.807811+0000","last_fullsized":"2023-07-06T01:10:08.807811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:06.775851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929492+0000","last_change":"2023-07-06T01:10:06.808682+0000","last_active":"2023-07-06T01:10:08.929492+0000","last_peered":"2023-07-06T01:10:08.929492+0000","last_clean":"2023-07-06T01:10:08.929492+0000","last_became_active":"2023-07-06T01:10:06.808373+0000","last_became_peered":"2023-07-06T01:10:06.808373+0000","last_unstale":"2023-07-06T01:10:08.929492+0000","last_undegraded":"2023-07-06T01:10:08.929492+0000","last_fullsized":"2023-07-06T01:10:08.929492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:18.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527088+0000","last_change":"2023-07-06T01:10:07.818843+0000","last_active":"2023-07-06T01:10:09.527088+0000","last_peered":"2023-07-06T01:10:09.527088+0000","last_clean":"2023-07-06T01:10:09.527088+0000","last_became_active":"2023-07-06T01:10:07.818505+0000","last_became_peered":"2023-07-06T01:10:07.818505+0000","last_unstale":"2023-07-06T01:10:09.527088+0000","last_undegraded":"2023-07-06T01:10:09.527088+0000","last_fullsized":"2023-07-06T01:10:09.527088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:57:56.564105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292884+0000","last_change":"2023-07-06T01:10:06.807149+0000","last_active":"2023-07-06T01:10:10.292884+0000","last_peered":"2023-07-06T01:10:10.292884+0000","last_clean":"2023-07-06T01:10:10.292884+0000","last_became_active":"2023-07-06T01:10:06.806742+0000","last_became_peered":"2023-07-06T01:10:06.806742+0000","last_unstale":"2023-07-06T01:10:10.292884+0000","last_undegraded":"2023-07-06T01:10:10.292884+0000","last_fullsized":"2023-07-06T01:10:10.292884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:18:26.224110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807318+0000","last_change":"2023-07-06T01:10:07.802573+0000","last_active":"2023-07-06T01:10:08.807318+0000","last_peered":"2023-07-06T01:10:08.807318+0000","last_clean":"2023-07-06T01:10:08.807318+0000","last_became_active":"2023-07-06T01:10:07.802323+0000","last_became_peered":"2023-07-06T01:10:07.802323+0000","last_unstale":"2023-07-06T01:10:08.807318+0000","last_undegraded":"2023-07-06T01:10:08.807318+0000","last_fullsized":"2023-07-06T01:10:08.807318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:44:55.514372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293119+0000","last_change":"2023-07-06T01:10:06.804534+0000","last_active":"2023-07-06T01:10:10.293119+0000","last_peered":"2023-07-06T01:10:10.293119+0000","last_clean":"2023-07-06T01:10:10.293119+0000","last_became_active":"2023-07-06T01:10:06.804209+0000","last_became_peered":"2023-07-06T01:10:06.804209+0000","last_unstale":"2023-07-06T01:10:10.293119+0000","last_undegraded":"2023-07-06T01:10:10.293119+0000","last_fullsized":"2023-07-06T01:10:10.293119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:01:42.709448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292450+0000","last_change":"2023-07-06T01:10:07.808814+0000","last_active":"2023-07-06T01:10:10.292450+0000","last_peered":"2023-07-06T01:10:10.292450+0000","last_clean":"2023-07-06T01:10:10.292450+0000","last_became_active":"2023-07-06T01:10:07.808540+0000","last_became_peered":"2023-07-06T01:10:07.808540+0000","last_unstale":"2023-07-06T01:10:10.292450+0000","last_undegraded":"2023-07-06T01:10:10.292450+0000","last_fullsized":"2023-07-06T01:10:10.292450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:26:37.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292833+0000","last_change":"2023-07-06T01:10:06.807418+0000","last_active":"2023-07-06T01:10:10.292833+0000","last_peered":"2023-07-06T01:10:10.292833+0000","last_clean":"2023-07-06T01:10:10.292833+0000","last_became_active":"2023-07-06T01:10:06.807147+0000","last_became_peered":"2023-07-06T01:10:06.807147+0000","last_unstale":"2023-07-06T01:10:10.292833+0000","last_undegraded":"2023-07-06T01:10:10.292833+0000","last_fullsized":"2023-07-06T01:10:10.292833+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:01:18.944343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176511+0000","last_change":"2023-07-06T01:10:07.812345+0000","last_active":"2023-07-06T01:10:10.176511+0000","last_peered":"2023-07-06T01:10:10.176511+0000","last_clean":"2023-07-06T01:10:10.176511+0000","last_became_active":"2023-07-06T01:10:07.812003+0000","last_became_peered":"2023-07-06T01:10:07.812003+0000","last_unstale":"2023-07-06T01:10:10.176511+0000","last_undegraded":"2023-07-06T01:10:10.176511+0000","last_fullsized":"2023-07-06T01:10:10.176511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:19.364827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808029+0000","last_change":"2023-07-06T01:10:06.799586+0000","last_active":"2023-07-06T01:10:08.808029+0000","last_peered":"2023-07-06T01:10:08.808029+0000","last_clean":"2023-07-06T01:10:08.808029+0000","last_became_active":"2023-07-06T01:10:06.798927+0000","last_became_peered":"2023-07-06T01:10:06.798927+0000","last_unstale":"2023-07-06T01:10:08.808029+0000","last_undegraded":"2023-07-06T01:10:08.808029+0000","last_fullsized":"2023-07-06T01:10:08.808029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:45:11.637151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292983+0000","last_change":"2023-07-06T01:10:07.813586+0000","last_active":"2023-07-06T01:10:10.292983+0000","last_peered":"2023-07-06T01:10:10.292983+0000","last_clean":"2023-07-06T01:10:10.292983+0000","last_became_active":"2023-07-06T01:10:07.813309+0000","last_became_peered":"2023-07-06T01:10:07.813309+0000","last_unstale":"2023-07-06T01:10:10.292983+0000","last_undegraded":"2023-07-06T01:10:10.292983+0000","last_fullsized":"2023-07-06T01:10:10.292983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:07:10.691976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176151+0000","last_change":"2023-07-06T01:10:06.800447+0000","last_active":"2023-07-06T01:10:10.176151+0000","last_peered":"2023-07-06T01:10:10.176151+0000","last_clean":"2023-07-06T01:10:10.176151+0000","last_became_active":"2023-07-06T01:10:06.800066+0000","last_became_peered":"2023-07-06T01:10:06.800066+0000","last_unstale":"2023-07-06T01:10:10.176151+0000","last_undegraded":"2023-07-06T01:10:10.176151+0000","last_fullsized":"2023-07-06T01:10:10.176151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:23:56.193327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292877+0000","last_change":"2023-07-06T01:10:07.813658+0000","last_active":"2023-07-06T01:10:10.292877+0000","last_peered":"2023-07-06T01:10:10.292877+0000","last_clean":"2023-07-06T01:10:10.292877+0000","last_became_active":"2023-07-06T01:10:07.813362+0000","last_became_peered":"2023-07-06T01:10:07.813362+0000","last_unstale":"2023-07-06T01:10:10.292877+0000","last_undegraded":"2023-07-06T01:10:10.292877+0000","last_fullsized":"2023-07-06T01:10:10.292877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:38.982857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929466+0000","last_change":"2023-07-06T01:10:06.808881+0000","last_active":"2023-07-06T01:10:08.929466+0000","last_peered":"2023-07-06T01:10:08.929466+0000","last_clean":"2023-07-06T01:10:08.929466+0000","last_became_active":"2023-07-06T01:10:06.808508+0000","last_became_peered":"2023-07-06T01:10:06.808508+0000","last_unstale":"2023-07-06T01:10:08.929466+0000","last_undegraded":"2023-07-06T01:10:08.929466+0000","last_fullsized":"2023-07-06T01:10:08.929466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:13.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929373+0000","last_change":"2023-07-06T01:10:07.824962+0000","last_active":"2023-07-06T01:10:08.929373+0000","last_peered":"2023-07-06T01:10:08.929373+0000","last_clean":"2023-07-06T01:10:08.929373+0000","last_became_active":"2023-07-06T01:10:07.824692+0000","last_became_peered":"2023-07-06T01:10:07.824692+0000","last_unstale":"2023-07-06T01:10:08.929373+0000","last_undegraded":"2023-07-06T01:10:08.929373+0000","last_fullsized":"2023-07-06T01:10:08.929373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:51:23.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527106+0000","last_change":"2023-07-06T01:10:06.809959+0000","last_active":"2023-07-06T01:10:09.527106+0000","last_peered":"2023-07-06T01:10:09.527106+0000","last_clean":"2023-07-06T01:10:09.527106+0000","last_became_active":"2023-07-06T01:10:06.809678+0000","last_became_peered":"2023-07-06T01:10:06.809678+0000","last_unstale":"2023-07-06T01:10:09.527106+0000","last_undegraded":"2023-07-06T01:10:09.527106+0000","last_fullsized":"2023-07-06T01:10:09.527106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:04:14.606778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527110+0000","last_change":"2023-07-06T01:10:07.823316+0000","last_active":"2023-07-06T01:10:09.527110+0000","last_peered":"2023-07-06T01:10:09.527110+0000","last_clean":"2023-07-06T01:10:09.527110+0000","last_became_active":"2023-07-06T01:10:07.822822+0000","last_became_peered":"2023-07-06T01:10:07.822822+0000","last_unstale":"2023-07-06T01:10:09.527110+0000","last_undegraded":"2023-07-06T01:10:09.527110+0000","last_fullsized":"2023-07-06T01:10:09.527110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:00.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925653+0000","last_change":"2023-07-06T01:10:06.795677+0000","last_active":"2023-07-06T01:10:08.925653+0000","last_peered":"2023-07-06T01:10:08.925653+0000","last_clean":"2023-07-06T01:10:08.925653+0000","last_became_active":"2023-07-06T01:10:06.795397+0000","last_became_peered":"2023-07-06T01:10:06.795397+0000","last_unstale":"2023-07-06T01:10:08.925653+0000","last_undegraded":"2023-07-06T01:10:08.925653+0000","last_fullsized":"2023-07-06T01:10:08.925653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:23.839012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925774+0000","last_change":"2023-07-06T01:10:07.822940+0000","last_active":"2023-07-06T01:10:08.925774+0000","last_peered":"2023-07-06T01:10:08.925774+0000","last_clean":"2023-07-06T01:10:08.925774+0000","last_became_active":"2023-07-06T01:10:07.822643+0000","last_became_peered":"2023-07-06T01:10:07.822643+0000","last_unstale":"2023-07-06T01:10:08.925774+0000","last_undegraded":"2023-07-06T01:10:08.925774+0000","last_fullsized":"2023-07-06T01:10:08.925774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:52:39.080340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292725+0000","last_change":"2023-07-06T01:10:06.805082+0000","last_active":"2023-07-06T01:10:10.292725+0000","last_peered":"2023-07-06T01:10:10.292725+0000","last_clean":"2023-07-06T01:10:10.292725+0000","last_became_active":"2023-07-06T01:10:06.804838+0000","last_became_peered":"2023-07-06T01:10:06.804838+0000","last_unstale":"2023-07-06T01:10:10.292725+0000","last_undegraded":"2023-07-06T01:10:10.292725+0000","last_fullsized":"2023-07-06T01:10:10.292725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:50:37.124045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176156+0000","last_change":"2023-07-06T01:10:07.822018+0000","last_active":"2023-07-06T01:10:10.176156+0000","last_peered":"2023-07-06T01:10:10.176156+0000","last_clean":"2023-07-06T01:10:10.176156+0000","last_became_active":"2023-07-06T01:10:07.821703+0000","last_became_peered":"2023-07-06T01:10:07.821703+0000","last_unstale":"2023-07-06T01:10:10.176156+0000","last_undegraded":"2023-07-06T01:10:10.176156+0000","last_fullsized":"2023-07-06T01:10:10.176156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:16.530402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925465+0000","last_change":"2023-07-06T01:10:06.799356+0000","last_active":"2023-07-06T01:10:08.925465+0000","last_peered":"2023-07-06T01:10:08.925465+0000","last_clean":"2023-07-06T01:10:08.925465+0000","last_became_active":"2023-07-06T01:10:06.799048+0000","last_became_peered":"2023-07-06T01:10:06.799048+0000","last_unstale":"2023-07-06T01:10:08.925465+0000","last_undegraded":"2023-07-06T01:10:08.925465+0000","last_fullsized":"2023-07-06T01:10:08.925465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:29:55.235414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807225+0000","last_change":"2023-07-06T01:10:07.816019+0000","last_active":"2023-07-06T01:10:08.807225+0000","last_peered":"2023-07-06T01:10:08.807225+0000","last_clean":"2023-07-06T01:10:08.807225+0000","last_became_active":"2023-07-06T01:10:07.815683+0000","last_became_peered":"2023-07-06T01:10:07.815683+0000","last_unstale":"2023-07-06T01:10:08.807225+0000","last_undegraded":"2023-07-06T01:10:08.807225+0000","last_fullsized":"2023-07-06T01:10:08.807225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:24.105581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925606+0000","last_change":"2023-07-06T01:10:06.800220+0000","last_active":"2023-07-06T01:10:08.925606+0000","last_peered":"2023-07-06T01:10:08.925606+0000","last_clean":"2023-07-06T01:10:08.925606+0000","last_became_active":"2023-07-06T01:10:06.799927+0000","last_became_peered":"2023-07-06T01:10:06.799927+0000","last_unstale":"2023-07-06T01:10:08.925606+0000","last_undegraded":"2023-07-06T01:10:08.925606+0000","last_fullsized":"2023-07-06T01:10:08.925606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:47.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928837+0000","last_change":"2023-07-06T01:10:07.809747+0000","last_active":"2023-07-06T01:10:08.928837+0000","last_peered":"2023-07-06T01:10:08.928837+0000","last_clean":"2023-07-06T01:10:08.928837+0000","last_became_active":"2023-07-06T01:10:07.809478+0000","last_became_peered":"2023-07-06T01:10:07.809478+0000","last_unstale":"2023-07-06T01:10:08.928837+0000","last_undegraded":"2023-07-06T01:10:08.928837+0000","last_fullsized":"2023-07-06T01:10:08.928837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:51.135163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176342+0000","last_change":"2023-07-06T01:10:06.795373+0000","last_active":"2023-07-06T01:10:10.176342+0000","last_peered":"2023-07-06T01:10:10.176342+0000","last_clean":"2023-07-06T01:10:10.176342+0000","last_became_active":"2023-07-06T01:10:06.795083+0000","last_became_peered":"2023-07-06T01:10:06.795083+0000","last_unstale":"2023-07-06T01:10:10.176342+0000","last_undegraded":"2023-07-06T01:10:10.176342+0000","last_fullsized":"2023-07-06T01:10:10.176342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:40.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293037+0000","last_change":"2023-07-06T01:10:07.823627+0000","last_active":"2023-07-06T01:10:10.293037+0000","last_peered":"2023-07-06T01:10:10.293037+0000","last_clean":"2023-07-06T01:10:10.293037+0000","last_became_active":"2023-07-06T01:10:07.823404+0000","last_became_peered":"2023-07-06T01:10:07.823404+0000","last_unstale":"2023-07-06T01:10:10.293037+0000","last_undegraded":"2023-07-06T01:10:10.293037+0000","last_fullsized":"2023-07-06T01:10:10.293037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:01:19.950466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925271+0000","last_change":"2023-07-06T01:10:06.796576+0000","last_active":"2023-07-06T01:10:08.925271+0000","last_peered":"2023-07-06T01:10:08.925271+0000","last_clean":"2023-07-06T01:10:08.925271+0000","last_became_active":"2023-07-06T01:10:06.796099+0000","last_became_peered":"2023-07-06T01:10:06.796099+0000","last_unstale":"2023-07-06T01:10:08.925271+0000","last_undegraded":"2023-07-06T01:10:08.925271+0000","last_fullsized":"2023-07-06T01:10:08.925271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:30.136697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807226+0000","last_change":"2023-07-06T01:10:07.814294+0000","last_active":"2023-07-06T01:10:08.807226+0000","last_peered":"2023-07-06T01:10:08.807226+0000","last_clean":"2023-07-06T01:10:08.807226+0000","last_became_active":"2023-07-06T01:10:07.814055+0000","last_became_peered":"2023-07-06T01:10:07.814055+0000","last_unstale":"2023-07-06T01:10:08.807226+0000","last_undegraded":"2023-07-06T01:10:08.807226+0000","last_fullsized":"2023-07-06T01:10:08.807226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:20.006641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807716+0000","last_change":"2023-07-06T01:10:06.797438+0000","last_active":"2023-07-06T01:10:08.807716+0000","last_peered":"2023-07-06T01:10:08.807716+0000","last_clean":"2023-07-06T01:10:08.807716+0000","last_became_active":"2023-07-06T01:10:06.796874+0000","last_became_peered":"2023-07-06T01:10:06.796874+0000","last_unstale":"2023-07-06T01:10:08.807716+0000","last_undegraded":"2023-07-06T01:10:08.807716+0000","last_fullsized":"2023-07-06T01:10:08.807716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:19:58.925416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292773+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:10.292773+0000","last_peered":"2023-07-06T01:10:10.292773+0000","last_clean":"2023-07-06T01:10:10.292773+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:10.292773+0000","last_undegraded":"2023-07-06T01:10:10.292773+0000","last_fullsized":"2023-07-06T01:10:10.292773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:48.074798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292812+0000","last_change":"2023-07-06T01:10:07.826361+0000","last_active":"2023-07-06T01:10:10.292812+0000","last_peered":"2023-07-06T01:10:10.292812+0000","last_clean":"2023-07-06T01:10:10.292812+0000","last_became_active":"2023-07-06T01:10:07.826078+0000","last_became_peered":"2023-07-06T01:10:07.826078+0000","last_unstale":"2023-07-06T01:10:10.292812+0000","last_undegraded":"2023-07-06T01:10:10.292812+0000","last_fullsized":"2023-07-06T01:10:10.292812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:50:38.130168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807728+0000","last_change":"2023-07-06T01:10:06.794351+0000","last_active":"2023-07-06T01:10:08.807728+0000","last_peered":"2023-07-06T01:10:08.807728+0000","last_clean":"2023-07-06T01:10:08.807728+0000","last_became_active":"2023-07-06T01:10:06.794075+0000","last_became_peered":"2023-07-06T01:10:06.794075+0000","last_unstale":"2023-07-06T01:10:08.807728+0000","last_undegraded":"2023-07-06T01:10:08.807728+0000","last_fullsized":"2023-07-06T01:10:08.807728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:44.480259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929252+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:08.929252+0000","last_peered":"2023-07-06T01:10:08.929252+0000","last_clean":"2023-07-06T01:10:08.929252+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:08.929252+0000","last_undegraded":"2023-07-06T01:10:08.929252+0000","last_fullsized":"2023-07-06T01:10:08.929252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:32:27.735979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176632+0000","last_change":"2023-07-06T01:10:07.823399+0000","last_active":"2023-07-06T01:10:10.176632+0000","last_peered":"2023-07-06T01:10:10.176632+0000","last_clean":"2023-07-06T01:10:10.176632+0000","last_became_active":"2023-07-06T01:10:07.823114+0000","last_became_peered":"2023-07-06T01:10:07.823114+0000","last_unstale":"2023-07-06T01:10:10.176632+0000","last_undegraded":"2023-07-06T01:10:10.176632+0000","last_fullsized":"2023-07-06T01:10:10.176632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:20.437409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925774+0000","last_change":"2023-07-06T01:10:06.809864+0000","last_active":"2023-07-06T01:10:08.925774+0000","last_peered":"2023-07-06T01:10:08.925774+0000","last_clean":"2023-07-06T01:10:08.925774+0000","last_became_active":"2023-07-06T01:10:06.809495+0000","last_became_peered":"2023-07-06T01:10:06.809495+0000","last_unstale":"2023-07-06T01:10:08.925774+0000","last_undegraded":"2023-07-06T01:10:08.925774+0000","last_fullsized":"2023-07-06T01:10:08.925774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:29.533396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925406+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:08.925406+0000","last_peered":"2023-07-06T01:10:08.925406+0000","last_clean":"2023-07-06T01:10:08.925406+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:08.925406+0000","last_undegraded":"2023-07-06T01:10:08.925406+0000","last_fullsized":"2023-07-06T01:10:08.925406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:45.997901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929245+0000","last_change":"2023-07-06T01:10:07.826965+0000","last_active":"2023-07-06T01:10:08.929245+0000","last_peered":"2023-07-06T01:10:08.929245+0000","last_clean":"2023-07-06T01:10:08.929245+0000","last_became_active":"2023-07-06T01:10:07.826589+0000","last_became_peered":"2023-07-06T01:10:07.826589+0000","last_unstale":"2023-07-06T01:10:08.929245+0000","last_undegraded":"2023-07-06T01:10:08.929245+0000","last_fullsized":"2023-07-06T01:10:08.929245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:23:57.199450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176423+0000","last_change":"2023-07-06T01:10:06.798475+0000","last_active":"2023-07-06T01:10:10.176423+0000","last_peered":"2023-07-06T01:10:10.176423+0000","last_clean":"2023-07-06T01:10:10.176423+0000","last_became_active":"2023-07-06T01:10:06.798167+0000","last_became_peered":"2023-07-06T01:10:06.798167+0000","last_unstale":"2023-07-06T01:10:10.176423+0000","last_undegraded":"2023-07-06T01:10:10.176423+0000","last_fullsized":"2023-07-06T01:10:10.176423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:13.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929339+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:08.929339+0000","last_peered":"2023-07-06T01:10:08.929339+0000","last_clean":"2023-07-06T01:10:08.929339+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:08.929339+0000","last_undegraded":"2023-07-06T01:10:08.929339+0000","last_fullsized":"2023-07-06T01:10:08.929339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:35:16.280708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176298+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:10.176298+0000","last_peered":"2023-07-06T01:10:10.176298+0000","last_clean":"2023-07-06T01:10:10.176298+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:10.176298+0000","last_undegraded":"2023-07-06T01:10:10.176298+0000","last_fullsized":"2023-07-06T01:10:10.176298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:25:30.527939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292693+0000","last_change":"2023-07-06T01:10:07.825229+0000","last_active":"2023-07-06T01:10:10.292693+0000","last_peered":"2023-07-06T01:10:10.292693+0000","last_clean":"2023-07-06T01:10:10.292693+0000","last_became_active":"2023-07-06T01:10:07.824954+0000","last_became_peered":"2023-07-06T01:10:07.824954+0000","last_unstale":"2023-07-06T01:10:10.292693+0000","last_undegraded":"2023-07-06T01:10:10.292693+0000","last_fullsized":"2023-07-06T01:10:10.292693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:26:37.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929419+0000","last_change":"2023-07-06T01:10:06.809002+0000","last_active":"2023-07-06T01:10:08.929419+0000","last_peered":"2023-07-06T01:10:08.929419+0000","last_clean":"2023-07-06T01:10:08.929419+0000","last_became_active":"2023-07-06T01:10:06.808542+0000","last_became_peered":"2023-07-06T01:10:06.808542+0000","last_unstale":"2023-07-06T01:10:08.929419+0000","last_undegraded":"2023-07-06T01:10:08.929419+0000","last_fullsized":"2023-07-06T01:10:08.929419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:40.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176378+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:10.176378+0000","last_peered":"2023-07-06T01:10:10.176378+0000","last_clean":"2023-07-06T01:10:10.176378+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:10.176378+0000","last_undegraded":"2023-07-06T01:10:10.176378+0000","last_fullsized":"2023-07-06T01:10:10.176378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:50:00.679088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292686+0000","last_change":"2023-07-06T01:10:07.820497+0000","last_active":"2023-07-06T01:10:10.292686+0000","last_peered":"2023-07-06T01:10:10.292686+0000","last_clean":"2023-07-06T01:10:10.292686+0000","last_became_active":"2023-07-06T01:10:07.820225+0000","last_became_peered":"2023-07-06T01:10:07.820225+0000","last_unstale":"2023-07-06T01:10:10.292686+0000","last_undegraded":"2023-07-06T01:10:10.292686+0000","last_fullsized":"2023-07-06T01:10:10.292686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:43:43.977091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808426+0000","last_change":"2023-07-06T01:10:06.801680+0000","last_active":"2023-07-06T01:10:08.808426+0000","last_peered":"2023-07-06T01:10:08.808426+0000","last_clean":"2023-07-06T01:10:08.808426+0000","last_became_active":"2023-07-06T01:10:06.801250+0000","last_became_peered":"2023-07-06T01:10:06.801250+0000","last_unstale":"2023-07-06T01:10:08.808426+0000","last_undegraded":"2023-07-06T01:10:08.808426+0000","last_fullsized":"2023-07-06T01:10:08.808426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:52:38.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176628+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:10.176628+0000","last_peered":"2023-07-06T01:10:10.176628+0000","last_clean":"2023-07-06T01:10:10.176628+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:10.176628+0000","last_undegraded":"2023-07-06T01:10:10.176628+0000","last_fullsized":"2023-07-06T01:10:10.176628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:56:33.946928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526811+0000","last_change":"2023-07-06T01:10:07.818021+0000","last_active":"2023-07-06T01:10:09.526811+0000","last_peered":"2023-07-06T01:10:09.526811+0000","last_clean":"2023-07-06T01:10:09.526811+0000","last_became_active":"2023-07-06T01:10:07.817686+0000","last_became_peered":"2023-07-06T01:10:07.817686+0000","last_unstale":"2023-07-06T01:10:09.526811+0000","last_undegraded":"2023-07-06T01:10:09.526811+0000","last_fullsized":"2023-07-06T01:10:09.526811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:14.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526497+0000","last_change":"2023-07-06T01:10:06.807223+0000","last_active":"2023-07-06T01:10:09.526497+0000","last_peered":"2023-07-06T01:10:09.526497+0000","last_clean":"2023-07-06T01:10:09.526497+0000","last_became_active":"2023-07-06T01:10:06.806960+0000","last_became_peered":"2023-07-06T01:10:06.806960+0000","last_unstale":"2023-07-06T01:10:09.526497+0000","last_undegraded":"2023-07-06T01:10:09.526497+0000","last_fullsized":"2023-07-06T01:10:09.526497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:51:22.290143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292705+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:10.292705+0000","last_peered":"2023-07-06T01:10:10.292705+0000","last_clean":"2023-07-06T01:10:10.292705+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:10.292705+0000","last_undegraded":"2023-07-06T01:10:10.292705+0000","last_fullsized":"2023-07-06T01:10:10.292705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:47.944191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176395+0000","last_change":"2023-07-06T01:10:07.825033+0000","last_active":"2023-07-06T01:10:10.176395+0000","last_peered":"2023-07-06T01:10:10.176395+0000","last_clean":"2023-07-06T01:10:10.176395+0000","last_became_active":"2023-07-06T01:10:07.824350+0000","last_became_peered":"2023-07-06T01:10:07.824350+0000","last_unstale":"2023-07-06T01:10:10.176395+0000","last_undegraded":"2023-07-06T01:10:10.176395+0000","last_fullsized":"2023-07-06T01:10:10.176395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:33:50.353157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292370+0000","last_change":"2023-07-06T01:10:06.804068+0000","last_active":"2023-07-06T01:10:10.292370+0000","last_peered":"2023-07-06T01:10:10.292370+0000","last_clean":"2023-07-06T01:10:10.292370+0000","last_became_active":"2023-07-06T01:10:06.803802+0000","last_became_peered":"2023-07-06T01:10:06.803802+0000","last_unstale":"2023-07-06T01:10:10.292370+0000","last_undegraded":"2023-07-06T01:10:10.292370+0000","last_fullsized":"2023-07-06T01:10:10.292370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:26:00.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808654+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:08.808654+0000","last_peered":"2023-07-06T01:10:08.808654+0000","last_clean":"2023-07-06T01:10:08.808654+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:08.808654+0000","last_undegraded":"2023-07-06T01:10:08.808654+0000","last_fullsized":"2023-07-06T01:10:08.808654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:27:33.713444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":761722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.92200000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.81399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":170302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":760122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.40799999999999997},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.998}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":171318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.433},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.871}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":170324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.747}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":1.0680000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":169832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.753}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.626}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:17.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:17.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.350+0000 7f71127ff700 1 Processor -- start 2023-07-06T01:10:17.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.351+0000 7f71127ff700 1 -- start start 2023-07-06T01:10:17.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f71127ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 0x7f710c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f71127ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f710c0b60e0 0x7f710c0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f71127ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710c0cf780 con 0x7f710c15fca0 2023-07-06T01:10:17.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f71127ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710c0cd490 con 0x7f710c0b60e0 2023-07-06T01:10:17.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f71127ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0cd770 con 0x7f710c0b5c90 2023-07-06T01:10:17.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f710bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f710c15fca0 0x7f710c0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58012/0 (socket says 172.21.15.71:58012) 2023-07-06T01:10:17.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f710bfff700 1 -- 172.21.15.71:0/502558361 learned_addr learned my addr 172.21.15.71:0/502558361 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:17.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f710b7fe700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 0x7f710c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429564215 0 0) 0x7f710c0cf780 con 0x7f710c15fca0 2023-07-06T01:10:17.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f40035b0 con 0x7f710c15fca0 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.352+0000 7f7110d9c700 1 --2- 172.21.15.71:0/502558361 >> v2:172.21.15.194:3300/0 conn(0x7f710c0b60e0 0x7f710c0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3928523514 0 0) 0x7f70f40035b0 con 0x7f710c15fca0 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 msgr2=0x7f710c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 0x7f710c0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 >> v2:172.21.15.194:3300/0 conn(0x7f710c0b60e0 msgr2=0x7f710c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 --2- 172.21.15.71:0/502558361 >> v2:172.21.15.194:3300/0 conn(0x7f710c0b60e0 0x7f710c0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c0cda50 con 0x7f710c15fca0 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f70fc001670 con 0x7f710c15fca0 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 >> v1:172.21.15.71:6789/0 conn(0x7f710c15fca0 legacy=0x7f710c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 0x7f70f4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70f4003fd0 0x7f70f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4004d90 0x7f70f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0cd490 con 0x7f70f4003fd0 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c0cd770 con 0x7f70f4004d90 2023-07-06T01:10:17.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f400ba10 con 0x7f710c0b5c90 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710b7fe700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70f4003fd0 0x7f70f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f710bfff700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 0x7f70f4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.353+0000 7f7110d9c700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4004d90 0x7f70f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710b7fe700 1 -- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 msgr2=0x7f70f4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710b7fe700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c0b5c90 0x7f70f4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710b7fe700 1 -- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4004d90 msgr2=0x7f70f4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:17.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710b7fe700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4004d90 0x7f70f4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710b7fe700 1 -- 172.21.15.71:0/502558361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40035b0 con 0x7f70f4003fd0 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710b7fe700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70f4003fd0 0x7f70f4004850 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7100009b60 tx=0x7f70f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466a232faab0c90e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000e6c0 con 0x7f70f4003fd0 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710000e820 con 0x7f70f4003fd0 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f710affd700 1 -- 172.21.15.71:0/502558361 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000eb90 con 0x7f70f4003fd0 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.354+0000 7f71127ff700 1 -- 172.21.15.71:0/502558361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70f4003fd0 msgr2=0x7f70f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.355+0000 7f71127ff700 1 --2- 172.21.15.71:0/502558361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70f4003fd0 0x7f70f4004850 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7100009b60 tx=0x7f70f4005880 comp rx=0 tx=0).stop 2023-07-06T01:10:17.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.355+0000 7f7110d9c700 1 -- 172.21.15.71:0/502558361 reap_dead start 2023-07-06T01:10:17.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.355+0000 7f71127ff700 1 -- 172.21.15.71:0/502558361 shutdown_connections 2023-07-06T01:10:17.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.355+0000 7f71127ff700 1 -- 172.21.15.71:0/502558361 >> 172.21.15.71:0/502558361 conn(0x7f710c06c150 msgr2=0x7f710c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:17.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.355+0000 7f71127ff700 1 -- 172.21.15.71:0/502558361 shutdown_connections 2023-07-06T01:10:17.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.355+0000 7f71127ff700 1 -- 172.21.15.71:0/502558361 wait complete. 2023-07-06T01:10:17.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.356+0000 7f71127ff700 1 Processor -- start 2023-07-06T01:10:17.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.357+0000 7f71127ff700 1 -- start start 2023-07-06T01:10:17.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.357+0000 7f71127ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4003fd0 0x7f710c14ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f71127ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 0x7f710c0a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f71127ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c1f5e40 0x7f710c0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f71127ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c14b160 con 0x7f710c148fa0 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f71127ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c14b440 con 0x7f70f4003fd0 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f71127ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710c14b720 con 0x7f710c1f5e40 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 0x7f710c0a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 0x7f710c0a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57536/0 (socket says 172.21.15.71:57536) 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 -- 172.21.15.71:0/3236657753 learned_addr learned my addr 172.21.15.71:0/3236657753 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710bfff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4003fd0 0x7f710c14ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f7110d9c700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c1f5e40 0x7f710c0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 -- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c1f5e40 msgr2=0x7f710c0d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c1f5e40 0x7f710c0d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 -- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4003fd0 msgr2=0x7f710c14ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4003fd0 0x7f710c14ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 -- 172.21.15.71:0/3236657753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c14ba00 con 0x7f710c148fa0 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.358+0000 7f710b7fe700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 0x7f710c0a9e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f70f4004720 tx=0x7f71000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.359+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000e6c0 con 0x7f710c148fa0 2023-07-06T01:10:17.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.359+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100003ab0 con 0x7f710c148fa0 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.359+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c14bce0 con 0x7f710c148fa0 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.359+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100003e60 con 0x7f710c148fa0 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.359+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c0d0ed0 con 0x7f710c148fa0 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.360+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c1f1dd0 con 0x7f710c148fa0 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.361+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7100013470 con 0x7f710c148fa0 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.362+0000 7f7108ff9700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f70f806ace0 0x7f70f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.362+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f710008af50 con 0x7f710c148fa0 2023-07-06T01:10:17.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.362+0000 7f710bfff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f70f806ace0 0x7f70f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.363+0000 7f710bfff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f70f806ace0 0x7f70f806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f710c0b88f0 tx=0x7f70fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:17.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.366+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7100056110 con 0x7f710c148fa0 2023-07-06T01:10:17.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.556+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f710c14b5b0 con 0x7f70f806ace0 2023-07-06T01:10:17.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.566+0000 7f7108ff9700 1 -- 172.21.15.71:0/3236657753 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310555 (secure 0 0 0) 0x7f710c14b5b0 con 0x7f70f806ace0 2023-07-06T01:10:17.571 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:17.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f70f806ace0 msgr2=0x7f70f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f70f806ace0 0x7f70f806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f710c0b88f0 tx=0x7f70fc009040 comp rx=0 tx=0).stop 2023-07-06T01:10:17.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 msgr2=0x7f710c0a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 0x7f710c0a9e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f70f4004720 tx=0x7f71000047c0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 shutdown_connections 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f70f806ace0 0x7f70f806d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f710c1f5e40 0x7f710c0d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70f4003fd0 0x7f710c14ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 --2- 172.21.15.71:0/3236657753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f710c148fa0 0x7f710c0a9e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 >> 172.21.15.71:0/3236657753 conn(0x7f710c06c150 msgr2=0x7f710c0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:17.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 shutdown_connections 2023-07-06T01:10:17.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.570+0000 7f71127ff700 1 -- 172.21.15.71:0/3236657753 wait complete. 2023-07-06T01:10:17.575 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:17.591 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2023-07-06T01:10:16.852147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":4424,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":4530176,"data_stored":2543220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.057344"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293083+0000","last_change":"2023-07-06T01:10:07.822535+0000","last_active":"2023-07-06T01:10:10.293083+0000","last_peered":"2023-07-06T01:10:10.293083+0000","last_clean":"2023-07-06T01:10:10.293083+0000","last_became_active":"2023-07-06T01:10:07.822279+0000","last_became_peered":"2023-07-06T01:10:07.822279+0000","last_unstale":"2023-07-06T01:10:10.293083+0000","last_undegraded":"2023-07-06T01:10:10.293083+0000","last_fullsized":"2023-07-06T01:10:10.293083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:35.134211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292681+0000","last_change":"2023-07-06T01:10:07.812868+0000","last_active":"2023-07-06T01:10:10.292681+0000","last_peered":"2023-07-06T01:10:10.292681+0000","last_clean":"2023-07-06T01:10:10.292681+0000","last_became_active":"2023-07-06T01:10:07.812592+0000","last_became_peered":"2023-07-06T01:10:07.812592+0000","last_unstale":"2023-07-06T01:10:10.292681+0000","last_undegraded":"2023-07-06T01:10:10.292681+0000","last_fullsized":"2023-07-06T01:10:10.292681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:00:10.561369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807349+0000","last_change":"2023-07-06T01:10:07.809507+0000","last_active":"2023-07-06T01:10:08.807349+0000","last_peered":"2023-07-06T01:10:08.807349+0000","last_clean":"2023-07-06T01:10:08.807349+0000","last_became_active":"2023-07-06T01:10:07.809254+0000","last_became_peered":"2023-07-06T01:10:07.809254+0000","last_unstale":"2023-07-06T01:10:08.807349+0000","last_undegraded":"2023-07-06T01:10:08.807349+0000","last_fullsized":"2023-07-06T01:10:08.807349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:38:18.134260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925490+0000","last_change":"2023-07-06T01:10:07.819304+0000","last_active":"2023-07-06T01:10:08.925490+0000","last_peered":"2023-07-06T01:10:08.925490+0000","last_clean":"2023-07-06T01:10:08.925490+0000","last_became_active":"2023-07-06T01:10:07.818818+0000","last_became_peered":"2023-07-06T01:10:07.818818+0000","last_unstale":"2023-07-06T01:10:08.925490+0000","last_undegraded":"2023-07-06T01:10:08.925490+0000","last_fullsized":"2023-07-06T01:10:08.925490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:20:12.375361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925429+0000","last_change":"2023-07-06T01:10:07.810967+0000","last_active":"2023-07-06T01:10:08.925429+0000","last_peered":"2023-07-06T01:10:08.925429+0000","last_clean":"2023-07-06T01:10:08.925429+0000","last_became_active":"2023-07-06T01:10:07.810687+0000","last_became_peered":"2023-07-06T01:10:07.810687+0000","last_unstale":"2023-07-06T01:10:08.925429+0000","last_undegraded":"2023-07-06T01:10:08.925429+0000","last_fullsized":"2023-07-06T01:10:08.925429+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:49.575328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292456+0000","last_change":"2023-07-06T01:10:07.817746+0000","last_active":"2023-07-06T01:10:10.292456+0000","last_peered":"2023-07-06T01:10:10.292456+0000","last_clean":"2023-07-06T01:10:10.292456+0000","last_became_active":"2023-07-06T01:10:07.817454+0000","last_became_peered":"2023-07-06T01:10:07.817454+0000","last_unstale":"2023-07-06T01:10:10.292456+0000","last_undegraded":"2023-07-06T01:10:10.292456+0000","last_fullsized":"2023-07-06T01:10:10.292456+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:22:13.208835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928717+0000","last_change":"2023-07-06T01:10:07.823801+0000","last_active":"2023-07-06T01:10:08.928717+0000","last_peered":"2023-07-06T01:10:08.928717+0000","last_clean":"2023-07-06T01:10:08.928717+0000","last_became_active":"2023-07-06T01:10:07.823516+0000","last_became_peered":"2023-07-06T01:10:07.823516+0000","last_unstale":"2023-07-06T01:10:08.928717+0000","last_undegraded":"2023-07-06T01:10:08.928717+0000","last_fullsized":"2023-07-06T01:10:08.928717+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:01:43.715571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292327+0000","last_change":"2023-07-06T01:10:07.810858+0000","last_active":"2023-07-06T01:10:10.292327+0000","last_peered":"2023-07-06T01:10:10.292327+0000","last_clean":"2023-07-06T01:10:10.292327+0000","last_became_active":"2023-07-06T01:10:07.810632+0000","last_became_peered":"2023-07-06T01:10:07.810632+0000","last_unstale":"2023-07-06T01:10:10.292327+0000","last_undegraded":"2023-07-06T01:10:10.292327+0000","last_fullsized":"2023-07-06T01:10:10.292327+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:23.811778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807590+0000","last_change":"2023-07-06T01:10:07.809187+0000","last_active":"2023-07-06T01:10:08.807590+0000","last_peered":"2023-07-06T01:10:08.807590+0000","last_clean":"2023-07-06T01:10:08.807590+0000","last_became_active":"2023-07-06T01:10:07.808049+0000","last_became_peered":"2023-07-06T01:10:07.808049+0000","last_unstale":"2023-07-06T01:10:08.807590+0000","last_undegraded":"2023-07-06T01:10:08.807590+0000","last_fullsized":"2023-07-06T01:10:08.807590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:59:01.835630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928929+0000","last_change":"2023-07-06T01:10:07.812604+0000","last_active":"2023-07-06T01:10:08.928929+0000","last_peered":"2023-07-06T01:10:08.928929+0000","last_clean":"2023-07-06T01:10:08.928929+0000","last_became_active":"2023-07-06T01:10:07.812173+0000","last_became_peered":"2023-07-06T01:10:07.812173+0000","last_unstale":"2023-07-06T01:10:08.928929+0000","last_undegraded":"2023-07-06T01:10:08.928929+0000","last_fullsized":"2023-07-06T01:10:08.928929+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929391+0000","last_change":"2023-07-06T01:10:07.814043+0000","last_active":"2023-07-06T01:10:08.929391+0000","last_peered":"2023-07-06T01:10:08.929391+0000","last_clean":"2023-07-06T01:10:08.929391+0000","last_became_active":"2023-07-06T01:10:07.813789+0000","last_became_peered":"2023-07-06T01:10:07.813789+0000","last_unstale":"2023-07-06T01:10:08.929391+0000","last_undegraded":"2023-07-06T01:10:08.929391+0000","last_fullsized":"2023-07-06T01:10:08.929391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807355+0000","last_change":"2023-07-06T01:10:07.807508+0000","last_active":"2023-07-06T01:10:08.807355+0000","last_peered":"2023-07-06T01:10:08.807355+0000","last_clean":"2023-07-06T01:10:08.807355+0000","last_became_active":"2023-07-06T01:10:07.807242+0000","last_became_peered":"2023-07-06T01:10:07.807242+0000","last_unstale":"2023-07-06T01:10:08.807355+0000","last_undegraded":"2023-07-06T01:10:08.807355+0000","last_fullsized":"2023-07-06T01:10:08.807355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:15:38.073944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928889+0000","last_change":"2023-07-06T01:10:07.825131+0000","last_active":"2023-07-06T01:10:08.928889+0000","last_peered":"2023-07-06T01:10:08.928889+0000","last_clean":"2023-07-06T01:10:08.928889+0000","last_became_active":"2023-07-06T01:10:07.824874+0000","last_became_peered":"2023-07-06T01:10:07.824874+0000","last_unstale":"2023-07-06T01:10:08.928889+0000","last_undegraded":"2023-07-06T01:10:08.928889+0000","last_fullsized":"2023-07-06T01:10:08.928889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:05.173975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526966+0000","last_change":"2023-07-06T01:10:07.820491+0000","last_active":"2023-07-06T01:10:09.526966+0000","last_peered":"2023-07-06T01:10:09.526966+0000","last_clean":"2023-07-06T01:10:09.526966+0000","last_became_active":"2023-07-06T01:10:07.820151+0000","last_became_peered":"2023-07-06T01:10:07.820151+0000","last_unstale":"2023-07-06T01:10:09.526966+0000","last_undegraded":"2023-07-06T01:10:09.526966+0000","last_fullsized":"2023-07-06T01:10:09.526966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:19.364827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928685+0000","last_change":"2023-07-06T01:10:07.807665+0000","last_active":"2023-07-06T01:10:08.928685+0000","last_peered":"2023-07-06T01:10:08.928685+0000","last_clean":"2023-07-06T01:10:08.928685+0000","last_became_active":"2023-07-06T01:10:07.807438+0000","last_became_peered":"2023-07-06T01:10:07.807438+0000","last_unstale":"2023-07-06T01:10:08.928685+0000","last_undegraded":"2023-07-06T01:10:08.928685+0000","last_fullsized":"2023-07-06T01:10:08.928685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:35.134211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.175959+0000","last_change":"2023-07-06T01:10:07.822037+0000","last_active":"2023-07-06T01:10:10.175959+0000","last_peered":"2023-07-06T01:10:10.175959+0000","last_clean":"2023-07-06T01:10:10.175959+0000","last_became_active":"2023-07-06T01:10:07.821738+0000","last_became_peered":"2023-07-06T01:10:07.821738+0000","last_unstale":"2023-07-06T01:10:10.175959+0000","last_undegraded":"2023-07-06T01:10:10.175959+0000","last_fullsized":"2023-07-06T01:10:10.175959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176564+0000","last_change":"2023-07-06T01:10:07.824369+0000","last_active":"2023-07-06T01:10:10.176564+0000","last_peered":"2023-07-06T01:10:10.176564+0000","last_clean":"2023-07-06T01:10:10.176564+0000","last_became_active":"2023-07-06T01:10:07.824090+0000","last_became_peered":"2023-07-06T01:10:07.824090+0000","last_unstale":"2023-07-06T01:10:10.176564+0000","last_undegraded":"2023-07-06T01:10:10.176564+0000","last_fullsized":"2023-07-06T01:10:10.176564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:45:43.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808353+0000","last_change":"2023-07-06T01:10:07.825684+0000","last_active":"2023-07-06T01:10:08.808353+0000","last_peered":"2023-07-06T01:10:08.808353+0000","last_clean":"2023-07-06T01:10:08.808353+0000","last_became_active":"2023-07-06T01:10:07.825358+0000","last_became_peered":"2023-07-06T01:10:07.825358+0000","last_unstale":"2023-07-06T01:10:08.808353+0000","last_undegraded":"2023-07-06T01:10:08.808353+0000","last_fullsized":"2023-07-06T01:10:08.808353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:24.845135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925719+0000","last_change":"2023-07-06T01:10:07.820349+0000","last_active":"2023-07-06T01:10:08.925719+0000","last_peered":"2023-07-06T01:10:08.925719+0000","last_clean":"2023-07-06T01:10:08.925719+0000","last_became_active":"2023-07-06T01:10:07.819865+0000","last_became_peered":"2023-07-06T01:10:07.819865+0000","last_unstale":"2023-07-06T01:10:08.925719+0000","last_undegraded":"2023-07-06T01:10:08.925719+0000","last_fullsized":"2023-07-06T01:10:08.925719+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:14:35.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808306+0000","last_change":"2023-07-06T01:10:07.813969+0000","last_active":"2023-07-06T01:10:08.808306+0000","last_peered":"2023-07-06T01:10:08.808306+0000","last_clean":"2023-07-06T01:10:08.808306+0000","last_became_active":"2023-07-06T01:10:07.813644+0000","last_became_peered":"2023-07-06T01:10:07.813644+0000","last_unstale":"2023-07-06T01:10:08.808306+0000","last_undegraded":"2023-07-06T01:10:08.808306+0000","last_fullsized":"2023-07-06T01:10:08.808306+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:48.094496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929082+0000","last_change":"2023-07-06T01:10:07.815698+0000","last_active":"2023-07-06T01:10:08.929082+0000","last_peered":"2023-07-06T01:10:08.929082+0000","last_clean":"2023-07-06T01:10:08.929082+0000","last_became_active":"2023-07-06T01:10:07.815342+0000","last_became_peered":"2023-07-06T01:10:07.815342+0000","last_unstale":"2023-07-06T01:10:08.929082+0000","last_undegraded":"2023-07-06T01:10:08.929082+0000","last_fullsized":"2023-07-06T01:10:08.929082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:28.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526600+0000","last_change":"2023-07-06T01:10:07.816519+0000","last_active":"2023-07-06T01:10:09.526600+0000","last_peered":"2023-07-06T01:10:09.526600+0000","last_clean":"2023-07-06T01:10:09.526600+0000","last_became_active":"2023-07-06T01:10:07.816179+0000","last_became_peered":"2023-07-06T01:10:07.816179+0000","last_unstale":"2023-07-06T01:10:09.526600+0000","last_undegraded":"2023-07-06T01:10:09.526600+0000","last_fullsized":"2023-07-06T01:10:09.526600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176450+0000","last_change":"2023-07-06T01:10:07.814621+0000","last_active":"2023-07-06T01:10:10.176450+0000","last_peered":"2023-07-06T01:10:10.176450+0000","last_clean":"2023-07-06T01:10:10.176450+0000","last_became_active":"2023-07-06T01:10:07.814369+0000","last_became_peered":"2023-07-06T01:10:07.814369+0000","last_unstale":"2023-07-06T01:10:10.176450+0000","last_undegraded":"2023-07-06T01:10:10.176450+0000","last_fullsized":"2023-07-06T01:10:10.176450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:02:33.059652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925336+0000","last_change":"2023-07-06T01:10:07.823764+0000","last_active":"2023-07-06T01:10:08.925336+0000","last_peered":"2023-07-06T01:10:08.925336+0000","last_clean":"2023-07-06T01:10:08.925336+0000","last_became_active":"2023-07-06T01:10:07.823358+0000","last_became_peered":"2023-07-06T01:10:07.823358+0000","last_unstale":"2023-07-06T01:10:08.925336+0000","last_undegraded":"2023-07-06T01:10:08.925336+0000","last_fullsized":"2023-07-06T01:10:08.925336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:08:58.658280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808563+0000","last_change":"2023-07-06T01:10:07.813041+0000","last_active":"2023-07-06T01:10:08.808563+0000","last_peered":"2023-07-06T01:10:08.808563+0000","last_clean":"2023-07-06T01:10:08.808563+0000","last_became_active":"2023-07-06T01:10:07.812344+0000","last_became_peered":"2023-07-06T01:10:07.812344+0000","last_unstale":"2023-07-06T01:10:08.808563+0000","last_undegraded":"2023-07-06T01:10:08.808563+0000","last_fullsized":"2023-07-06T01:10:08.808563+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:40:42.603811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292842+0000","last_change":"2023-07-06T01:10:07.825442+0000","last_active":"2023-07-06T01:10:10.292842+0000","last_peered":"2023-07-06T01:10:10.292842+0000","last_clean":"2023-07-06T01:10:10.292842+0000","last_became_active":"2023-07-06T01:10:07.825204+0000","last_became_peered":"2023-07-06T01:10:07.825204+0000","last_unstale":"2023-07-06T01:10:10.292842+0000","last_undegraded":"2023-07-06T01:10:10.292842+0000","last_fullsized":"2023-07-06T01:10:10.292842+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:26:01.953305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808622+0000","last_change":"2023-07-06T01:10:07.818509+0000","last_active":"2023-07-06T01:10:08.808622+0000","last_peered":"2023-07-06T01:10:08.808622+0000","last_clean":"2023-07-06T01:10:08.808622+0000","last_became_active":"2023-07-06T01:10:07.818176+0000","last_became_peered":"2023-07-06T01:10:07.818176+0000","last_unstale":"2023-07-06T01:10:08.808622+0000","last_undegraded":"2023-07-06T01:10:08.808622+0000","last_fullsized":"2023-07-06T01:10:08.808622+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:56:11.718054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929043+0000","last_change":"2023-07-06T01:10:07.824249+0000","last_active":"2023-07-06T01:10:08.929043+0000","last_peered":"2023-07-06T01:10:08.929043+0000","last_clean":"2023-07-06T01:10:08.929043+0000","last_became_active":"2023-07-06T01:10:07.823772+0000","last_became_peered":"2023-07-06T01:10:07.823772+0000","last_unstale":"2023-07-06T01:10:08.929043+0000","last_undegraded":"2023-07-06T01:10:08.929043+0000","last_fullsized":"2023-07-06T01:10:08.929043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:16.530402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808558+0000","last_change":"2023-07-06T01:10:07.817726+0000","last_active":"2023-07-06T01:10:08.808558+0000","last_peered":"2023-07-06T01:10:08.808558+0000","last_clean":"2023-07-06T01:10:08.808558+0000","last_became_active":"2023-07-06T01:10:07.817443+0000","last_became_peered":"2023-07-06T01:10:07.817443+0000","last_unstale":"2023-07-06T01:10:08.808558+0000","last_undegraded":"2023-07-06T01:10:08.808558+0000","last_fullsized":"2023-07-06T01:10:08.808558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:30.539519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808496+0000","last_change":"2023-07-06T01:10:07.813165+0000","last_active":"2023-07-06T01:10:08.808496+0000","last_peered":"2023-07-06T01:10:08.808496+0000","last_clean":"2023-07-06T01:10:08.808496+0000","last_became_active":"2023-07-06T01:10:07.812878+0000","last_became_peered":"2023-07-06T01:10:07.812878+0000","last_unstale":"2023-07-06T01:10:08.808496+0000","last_undegraded":"2023-07-06T01:10:08.808496+0000","last_fullsized":"2023-07-06T01:10:08.808496+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:14:35.369042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176180+0000","last_change":"2023-07-06T01:10:07.813083+0000","last_active":"2023-07-06T01:10:10.176180+0000","last_peered":"2023-07-06T01:10:10.176180+0000","last_clean":"2023-07-06T01:10:10.176180+0000","last_became_active":"2023-07-06T01:10:07.812663+0000","last_became_peered":"2023-07-06T01:10:07.812663+0000","last_unstale":"2023-07-06T01:10:10.176180+0000","last_undegraded":"2023-07-06T01:10:10.176180+0000","last_fullsized":"2023-07-06T01:10:10.176180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:27:28.240470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292267+0000","last_change":"2023-07-06T01:10:07.812437+0000","last_active":"2023-07-06T01:10:10.292267+0000","last_peered":"2023-07-06T01:10:10.292267+0000","last_clean":"2023-07-06T01:10:10.292267+0000","last_became_active":"2023-07-06T01:10:07.811942+0000","last_became_peered":"2023-07-06T01:10:07.811942+0000","last_unstale":"2023-07-06T01:10:10.292267+0000","last_undegraded":"2023-07-06T01:10:10.292267+0000","last_fullsized":"2023-07-06T01:10:10.292267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:52:08.297110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176390+0000","last_change":"2023-07-06T01:10:07.819217+0000","last_active":"2023-07-06T01:10:10.176390+0000","last_peered":"2023-07-06T01:10:10.176390+0000","last_clean":"2023-07-06T01:10:10.176390+0000","last_became_active":"2023-07-06T01:10:07.818951+0000","last_became_peered":"2023-07-06T01:10:07.818951+0000","last_unstale":"2023-07-06T01:10:10.176390+0000","last_undegraded":"2023-07-06T01:10:10.176390+0000","last_fullsized":"2023-07-06T01:10:10.176390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:16:23.298268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808562+0000","last_change":"2023-07-06T01:10:06.805034+0000","last_active":"2023-07-06T01:10:08.808562+0000","last_peered":"2023-07-06T01:10:08.808562+0000","last_clean":"2023-07-06T01:10:08.808562+0000","last_became_active":"2023-07-06T01:10:06.804721+0000","last_became_peered":"2023-07-06T01:10:06.804721+0000","last_unstale":"2023-07-06T01:10:08.808562+0000","last_undegraded":"2023-07-06T01:10:08.808562+0000","last_fullsized":"2023-07-06T01:10:08.808562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:09:00.821344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292666+0000","last_change":"2023-07-06T01:10:07.826432+0000","last_active":"2023-07-06T01:10:10.292666+0000","last_peered":"2023-07-06T01:10:10.292666+0000","last_clean":"2023-07-06T01:10:10.292666+0000","last_became_active":"2023-07-06T01:10:07.825736+0000","last_became_peered":"2023-07-06T01:10:07.825736+0000","last_unstale":"2023-07-06T01:10:10.292666+0000","last_undegraded":"2023-07-06T01:10:10.292666+0000","last_fullsized":"2023-07-06T01:10:10.292666+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:23.811778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807525+0000","last_change":"2023-07-06T01:10:06.790212+0000","last_active":"2023-07-06T01:10:08.807525+0000","last_peered":"2023-07-06T01:10:08.807525+0000","last_clean":"2023-07-06T01:10:08.807525+0000","last_became_active":"2023-07-06T01:10:06.789874+0000","last_became_peered":"2023-07-06T01:10:06.789874+0000","last_unstale":"2023-07-06T01:10:08.807525+0000","last_undegraded":"2023-07-06T01:10:08.807525+0000","last_fullsized":"2023-07-06T01:10:08.807525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:20:49.430644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527024+0000","last_change":"2023-07-06T01:10:07.823077+0000","last_active":"2023-07-06T01:10:09.527024+0000","last_peered":"2023-07-06T01:10:09.527024+0000","last_clean":"2023-07-06T01:10:09.527024+0000","last_became_active":"2023-07-06T01:10:07.822443+0000","last_became_peered":"2023-07-06T01:10:07.822443+0000","last_unstale":"2023-07-06T01:10:09.527024+0000","last_undegraded":"2023-07-06T01:10:09.527024+0000","last_fullsized":"2023-07-06T01:10:09.527024+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:45:43.242231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292758+0000","last_change":"2023-07-06T01:10:06.805776+0000","last_active":"2023-07-06T01:10:10.292758+0000","last_peered":"2023-07-06T01:10:10.292758+0000","last_clean":"2023-07-06T01:10:10.292758+0000","last_became_active":"2023-07-06T01:10:06.805509+0000","last_became_peered":"2023-07-06T01:10:06.805509+0000","last_unstale":"2023-07-06T01:10:10.292758+0000","last_undegraded":"2023-07-06T01:10:10.292758+0000","last_fullsized":"2023-07-06T01:10:10.292758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:37.976734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293254+0000","last_change":"2023-07-06T01:10:07.811399+0000","last_active":"2023-07-06T01:10:10.293254+0000","last_peered":"2023-07-06T01:10:10.293254+0000","last_clean":"2023-07-06T01:10:10.293254+0000","last_became_active":"2023-07-06T01:10:07.811147+0000","last_became_peered":"2023-07-06T01:10:07.811147+0000","last_unstale":"2023-07-06T01:10:10.293254+0000","last_undegraded":"2023-07-06T01:10:10.293254+0000","last_fullsized":"2023-07-06T01:10:10.293254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:21:56.944359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526957+0000","last_change":"2023-07-06T01:10:06.806716+0000","last_active":"2023-07-06T01:10:09.526957+0000","last_peered":"2023-07-06T01:10:09.526957+0000","last_clean":"2023-07-06T01:10:09.526957+0000","last_became_active":"2023-07-06T01:10:06.806445+0000","last_became_peered":"2023-07-06T01:10:06.806445+0000","last_unstale":"2023-07-06T01:10:09.526957+0000","last_undegraded":"2023-07-06T01:10:09.526957+0000","last_fullsized":"2023-07-06T01:10:09.526957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:19.431286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807145+0000","last_change":"2023-07-06T01:10:07.816200+0000","last_active":"2023-07-06T01:10:08.807145+0000","last_peered":"2023-07-06T01:10:08.807145+0000","last_clean":"2023-07-06T01:10:08.807145+0000","last_became_active":"2023-07-06T01:10:07.815935+0000","last_became_peered":"2023-07-06T01:10:07.815935+0000","last_unstale":"2023-07-06T01:10:08.807145+0000","last_undegraded":"2023-07-06T01:10:08.807145+0000","last_fullsized":"2023-07-06T01:10:08.807145+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:35:36.817617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929253+0000","last_change":"2023-07-06T01:10:06.809079+0000","last_active":"2023-07-06T01:10:08.929253+0000","last_peered":"2023-07-06T01:10:08.929253+0000","last_clean":"2023-07-06T01:10:08.929253+0000","last_became_active":"2023-07-06T01:10:06.808787+0000","last_became_peered":"2023-07-06T01:10:06.808787+0000","last_unstale":"2023-07-06T01:10:08.929253+0000","last_undegraded":"2023-07-06T01:10:08.929253+0000","last_fullsized":"2023-07-06T01:10:08.929253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:16:22.292145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929017+0000","last_change":"2023-07-06T01:10:07.815750+0000","last_active":"2023-07-06T01:10:08.929017+0000","last_peered":"2023-07-06T01:10:08.929017+0000","last_clean":"2023-07-06T01:10:08.929017+0000","last_became_active":"2023-07-06T01:10:07.815473+0000","last_became_peered":"2023-07-06T01:10:07.815473+0000","last_unstale":"2023-07-06T01:10:08.929017+0000","last_undegraded":"2023-07-06T01:10:08.929017+0000","last_fullsized":"2023-07-06T01:10:08.929017+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:44:39.871702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176064+0000","last_change":"2023-07-06T01:10:06.800324+0000","last_active":"2023-07-06T01:10:10.176064+0000","last_peered":"2023-07-06T01:10:10.176064+0000","last_clean":"2023-07-06T01:10:10.176064+0000","last_became_active":"2023-07-06T01:10:06.800018+0000","last_became_peered":"2023-07-06T01:10:06.800018+0000","last_unstale":"2023-07-06T01:10:10.176064+0000","last_undegraded":"2023-07-06T01:10:10.176064+0000","last_fullsized":"2023-07-06T01:10:10.176064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:44:38.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526616+0000","last_change":"2023-07-06T01:10:07.820329+0000","last_active":"2023-07-06T01:10:09.526616+0000","last_peered":"2023-07-06T01:10:09.526616+0000","last_clean":"2023-07-06T01:10:09.526616+0000","last_became_active":"2023-07-06T01:10:07.820032+0000","last_became_peered":"2023-07-06T01:10:07.820032+0000","last_unstale":"2023-07-06T01:10:09.526616+0000","last_undegraded":"2023-07-06T01:10:09.526616+0000","last_fullsized":"2023-07-06T01:10:09.526616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:41.722974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292764+0000","last_change":"2023-07-06T01:10:06.806348+0000","last_active":"2023-07-06T01:10:10.292764+0000","last_peered":"2023-07-06T01:10:10.292764+0000","last_clean":"2023-07-06T01:10:10.292764+0000","last_became_active":"2023-07-06T01:10:06.806025+0000","last_became_peered":"2023-07-06T01:10:06.806025+0000","last_unstale":"2023-07-06T01:10:10.292764+0000","last_undegraded":"2023-07-06T01:10:10.292764+0000","last_fullsized":"2023-07-06T01:10:10.292764+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:18:26.224110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293080+0000","last_change":"2023-07-06T01:10:07.823248+0000","last_active":"2023-07-06T01:10:10.293080+0000","last_peered":"2023-07-06T01:10:10.293080+0000","last_clean":"2023-07-06T01:10:10.293080+0000","last_became_active":"2023-07-06T01:10:07.823019+0000","last_became_peered":"2023-07-06T01:10:07.823019+0000","last_unstale":"2023-07-06T01:10:10.293080+0000","last_undegraded":"2023-07-06T01:10:10.293080+0000","last_fullsized":"2023-07-06T01:10:10.293080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:10:08.264065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526501+0000","last_change":"2023-07-06T01:10:06.804303+0000","last_active":"2023-07-06T01:10:09.526501+0000","last_peered":"2023-07-06T01:10:09.526501+0000","last_clean":"2023-07-06T01:10:09.526501+0000","last_became_active":"2023-07-06T01:10:06.803992+0000","last_became_peered":"2023-07-06T01:10:06.803992+0000","last_unstale":"2023-07-06T01:10:09.526501+0000","last_undegraded":"2023-07-06T01:10:09.526501+0000","last_fullsized":"2023-07-06T01:10:09.526501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:36:37.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925625+0000","last_change":"2023-07-06T01:10:07.819091+0000","last_active":"2023-07-06T01:10:08.925625+0000","last_peered":"2023-07-06T01:10:08.925625+0000","last_clean":"2023-07-06T01:10:08.925625+0000","last_became_active":"2023-07-06T01:10:07.818453+0000","last_became_peered":"2023-07-06T01:10:07.818453+0000","last_unstale":"2023-07-06T01:10:08.925625+0000","last_undegraded":"2023-07-06T01:10:08.925625+0000","last_fullsized":"2023-07-06T01:10:08.925625+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:45:12.643274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293201+0000","last_change":"2023-07-06T01:10:06.804011+0000","last_active":"2023-07-06T01:10:10.293201+0000","last_peered":"2023-07-06T01:10:10.293201+0000","last_clean":"2023-07-06T01:10:10.293201+0000","last_became_active":"2023-07-06T01:10:06.803727+0000","last_became_peered":"2023-07-06T01:10:06.803727+0000","last_unstale":"2023-07-06T01:10:10.293201+0000","last_undegraded":"2023-07-06T01:10:10.293201+0000","last_fullsized":"2023-07-06T01:10:10.293201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:48:04.167852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176394+0000","last_change":"2023-07-06T01:10:07.814158+0000","last_active":"2023-07-06T01:10:10.176394+0000","last_peered":"2023-07-06T01:10:10.176394+0000","last_clean":"2023-07-06T01:10:10.176394+0000","last_became_active":"2023-07-06T01:10:07.813855+0000","last_became_peered":"2023-07-06T01:10:07.813855+0000","last_unstale":"2023-07-06T01:10:10.176394+0000","last_undegraded":"2023-07-06T01:10:10.176394+0000","last_fullsized":"2023-07-06T01:10:10.176394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:36:38.897886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929223+0000","last_change":"2023-07-06T01:10:06.813577+0000","last_active":"2023-07-06T01:10:08.929223+0000","last_peered":"2023-07-06T01:10:08.929223+0000","last_clean":"2023-07-06T01:10:08.929223+0000","last_became_active":"2023-07-06T01:10:06.813302+0000","last_became_peered":"2023-07-06T01:10:06.813302+0000","last_unstale":"2023-07-06T01:10:08.929223+0000","last_undegraded":"2023-07-06T01:10:08.929223+0000","last_fullsized":"2023-07-06T01:10:08.929223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:26:59.183194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807811+0000","last_change":"2023-07-06T01:10:07.815561+0000","last_active":"2023-07-06T01:10:08.807811+0000","last_peered":"2023-07-06T01:10:08.807811+0000","last_clean":"2023-07-06T01:10:08.807811+0000","last_became_active":"2023-07-06T01:10:07.815275+0000","last_became_peered":"2023-07-06T01:10:07.815275+0000","last_unstale":"2023-07-06T01:10:08.807811+0000","last_undegraded":"2023-07-06T01:10:08.807811+0000","last_fullsized":"2023-07-06T01:10:08.807811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:45:06.775851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929492+0000","last_change":"2023-07-06T01:10:06.808682+0000","last_active":"2023-07-06T01:10:08.929492+0000","last_peered":"2023-07-06T01:10:08.929492+0000","last_clean":"2023-07-06T01:10:08.929492+0000","last_became_active":"2023-07-06T01:10:06.808373+0000","last_became_peered":"2023-07-06T01:10:06.808373+0000","last_unstale":"2023-07-06T01:10:08.929492+0000","last_undegraded":"2023-07-06T01:10:08.929492+0000","last_fullsized":"2023-07-06T01:10:08.929492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:18.358704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527088+0000","last_change":"2023-07-06T01:10:07.818843+0000","last_active":"2023-07-06T01:10:09.527088+0000","last_peered":"2023-07-06T01:10:09.527088+0000","last_clean":"2023-07-06T01:10:09.527088+0000","last_became_active":"2023-07-06T01:10:07.818505+0000","last_became_peered":"2023-07-06T01:10:07.818505+0000","last_unstale":"2023-07-06T01:10:09.527088+0000","last_undegraded":"2023-07-06T01:10:09.527088+0000","last_fullsized":"2023-07-06T01:10:09.527088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:57:56.564105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292884+0000","last_change":"2023-07-06T01:10:06.807149+0000","last_active":"2023-07-06T01:10:10.292884+0000","last_peered":"2023-07-06T01:10:10.292884+0000","last_clean":"2023-07-06T01:10:10.292884+0000","last_became_active":"2023-07-06T01:10:06.806742+0000","last_became_peered":"2023-07-06T01:10:06.806742+0000","last_unstale":"2023-07-06T01:10:10.292884+0000","last_undegraded":"2023-07-06T01:10:10.292884+0000","last_fullsized":"2023-07-06T01:10:10.292884+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:18:26.224110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807318+0000","last_change":"2023-07-06T01:10:07.802573+0000","last_active":"2023-07-06T01:10:08.807318+0000","last_peered":"2023-07-06T01:10:08.807318+0000","last_clean":"2023-07-06T01:10:08.807318+0000","last_became_active":"2023-07-06T01:10:07.802323+0000","last_became_peered":"2023-07-06T01:10:07.802323+0000","last_unstale":"2023-07-06T01:10:08.807318+0000","last_undegraded":"2023-07-06T01:10:08.807318+0000","last_fullsized":"2023-07-06T01:10:08.807318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:44:55.514372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293119+0000","last_change":"2023-07-06T01:10:06.804534+0000","last_active":"2023-07-06T01:10:10.293119+0000","last_peered":"2023-07-06T01:10:10.293119+0000","last_clean":"2023-07-06T01:10:10.293119+0000","last_became_active":"2023-07-06T01:10:06.804209+0000","last_became_peered":"2023-07-06T01:10:06.804209+0000","last_unstale":"2023-07-06T01:10:10.293119+0000","last_undegraded":"2023-07-06T01:10:10.293119+0000","last_fullsized":"2023-07-06T01:10:10.293119+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:01:42.709448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292450+0000","last_change":"2023-07-06T01:10:07.808814+0000","last_active":"2023-07-06T01:10:10.292450+0000","last_peered":"2023-07-06T01:10:10.292450+0000","last_clean":"2023-07-06T01:10:10.292450+0000","last_became_active":"2023-07-06T01:10:07.808540+0000","last_became_peered":"2023-07-06T01:10:07.808540+0000","last_unstale":"2023-07-06T01:10:10.292450+0000","last_undegraded":"2023-07-06T01:10:10.292450+0000","last_fullsized":"2023-07-06T01:10:10.292450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:26:37.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292833+0000","last_change":"2023-07-06T01:10:06.807418+0000","last_active":"2023-07-06T01:10:10.292833+0000","last_peered":"2023-07-06T01:10:10.292833+0000","last_clean":"2023-07-06T01:10:10.292833+0000","last_became_active":"2023-07-06T01:10:06.807147+0000","last_became_peered":"2023-07-06T01:10:06.807147+0000","last_unstale":"2023-07-06T01:10:10.292833+0000","last_undegraded":"2023-07-06T01:10:10.292833+0000","last_fullsized":"2023-07-06T01:10:10.292833+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:01:18.944343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176511+0000","last_change":"2023-07-06T01:10:07.812345+0000","last_active":"2023-07-06T01:10:10.176511+0000","last_peered":"2023-07-06T01:10:10.176511+0000","last_clean":"2023-07-06T01:10:10.176511+0000","last_became_active":"2023-07-06T01:10:07.812003+0000","last_became_peered":"2023-07-06T01:10:07.812003+0000","last_unstale":"2023-07-06T01:10:10.176511+0000","last_undegraded":"2023-07-06T01:10:10.176511+0000","last_fullsized":"2023-07-06T01:10:10.176511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:24:19.364827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808029+0000","last_change":"2023-07-06T01:10:06.799586+0000","last_active":"2023-07-06T01:10:08.808029+0000","last_peered":"2023-07-06T01:10:08.808029+0000","last_clean":"2023-07-06T01:10:08.808029+0000","last_became_active":"2023-07-06T01:10:06.798927+0000","last_became_peered":"2023-07-06T01:10:06.798927+0000","last_unstale":"2023-07-06T01:10:08.808029+0000","last_undegraded":"2023-07-06T01:10:08.808029+0000","last_fullsized":"2023-07-06T01:10:08.808029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:45:11.637151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292983+0000","last_change":"2023-07-06T01:10:07.813586+0000","last_active":"2023-07-06T01:10:10.292983+0000","last_peered":"2023-07-06T01:10:10.292983+0000","last_clean":"2023-07-06T01:10:10.292983+0000","last_became_active":"2023-07-06T01:10:07.813309+0000","last_became_peered":"2023-07-06T01:10:07.813309+0000","last_unstale":"2023-07-06T01:10:10.292983+0000","last_undegraded":"2023-07-06T01:10:10.292983+0000","last_fullsized":"2023-07-06T01:10:10.292983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:07:10.691976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176151+0000","last_change":"2023-07-06T01:10:06.800447+0000","last_active":"2023-07-06T01:10:10.176151+0000","last_peered":"2023-07-06T01:10:10.176151+0000","last_clean":"2023-07-06T01:10:10.176151+0000","last_became_active":"2023-07-06T01:10:06.800066+0000","last_became_peered":"2023-07-06T01:10:06.800066+0000","last_unstale":"2023-07-06T01:10:10.176151+0000","last_undegraded":"2023-07-06T01:10:10.176151+0000","last_fullsized":"2023-07-06T01:10:10.176151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:23:56.193327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292877+0000","last_change":"2023-07-06T01:10:07.813658+0000","last_active":"2023-07-06T01:10:10.292877+0000","last_peered":"2023-07-06T01:10:10.292877+0000","last_clean":"2023-07-06T01:10:10.292877+0000","last_became_active":"2023-07-06T01:10:07.813362+0000","last_became_peered":"2023-07-06T01:10:07.813362+0000","last_unstale":"2023-07-06T01:10:10.292877+0000","last_undegraded":"2023-07-06T01:10:10.292877+0000","last_fullsized":"2023-07-06T01:10:10.292877+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:40:38.982857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929466+0000","last_change":"2023-07-06T01:10:06.808881+0000","last_active":"2023-07-06T01:10:08.929466+0000","last_peered":"2023-07-06T01:10:08.929466+0000","last_clean":"2023-07-06T01:10:08.929466+0000","last_became_active":"2023-07-06T01:10:06.808508+0000","last_became_peered":"2023-07-06T01:10:06.808508+0000","last_unstale":"2023-07-06T01:10:08.929466+0000","last_undegraded":"2023-07-06T01:10:08.929466+0000","last_fullsized":"2023-07-06T01:10:08.929466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:13.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929373+0000","last_change":"2023-07-06T01:10:07.824962+0000","last_active":"2023-07-06T01:10:08.929373+0000","last_peered":"2023-07-06T01:10:08.929373+0000","last_clean":"2023-07-06T01:10:08.929373+0000","last_became_active":"2023-07-06T01:10:07.824692+0000","last_became_peered":"2023-07-06T01:10:07.824692+0000","last_unstale":"2023-07-06T01:10:08.929373+0000","last_undegraded":"2023-07-06T01:10:08.929373+0000","last_fullsized":"2023-07-06T01:10:08.929373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:51:23.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527106+0000","last_change":"2023-07-06T01:10:06.809959+0000","last_active":"2023-07-06T01:10:09.527106+0000","last_peered":"2023-07-06T01:10:09.527106+0000","last_clean":"2023-07-06T01:10:09.527106+0000","last_became_active":"2023-07-06T01:10:06.809678+0000","last_became_peered":"2023-07-06T01:10:06.809678+0000","last_unstale":"2023-07-06T01:10:09.527106+0000","last_undegraded":"2023-07-06T01:10:09.527106+0000","last_fullsized":"2023-07-06T01:10:09.527106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:04:14.606778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.527110+0000","last_change":"2023-07-06T01:10:07.823316+0000","last_active":"2023-07-06T01:10:09.527110+0000","last_peered":"2023-07-06T01:10:09.527110+0000","last_clean":"2023-07-06T01:10:09.527110+0000","last_became_active":"2023-07-06T01:10:07.822822+0000","last_became_peered":"2023-07-06T01:10:07.822822+0000","last_unstale":"2023-07-06T01:10:09.527110+0000","last_undegraded":"2023-07-06T01:10:09.527110+0000","last_fullsized":"2023-07-06T01:10:09.527110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:34:00.276197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925653+0000","last_change":"2023-07-06T01:10:06.795677+0000","last_active":"2023-07-06T01:10:08.925653+0000","last_peered":"2023-07-06T01:10:08.925653+0000","last_clean":"2023-07-06T01:10:08.925653+0000","last_became_active":"2023-07-06T01:10:06.795397+0000","last_became_peered":"2023-07-06T01:10:06.795397+0000","last_unstale":"2023-07-06T01:10:08.925653+0000","last_undegraded":"2023-07-06T01:10:08.925653+0000","last_fullsized":"2023-07-06T01:10:08.925653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:55:23.839012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925774+0000","last_change":"2023-07-06T01:10:07.822940+0000","last_active":"2023-07-06T01:10:08.925774+0000","last_peered":"2023-07-06T01:10:08.925774+0000","last_clean":"2023-07-06T01:10:08.925774+0000","last_became_active":"2023-07-06T01:10:07.822643+0000","last_became_peered":"2023-07-06T01:10:07.822643+0000","last_unstale":"2023-07-06T01:10:08.925774+0000","last_undegraded":"2023-07-06T01:10:08.925774+0000","last_fullsized":"2023-07-06T01:10:08.925774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:52:39.080340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292725+0000","last_change":"2023-07-06T01:10:06.805082+0000","last_active":"2023-07-06T01:10:10.292725+0000","last_peered":"2023-07-06T01:10:10.292725+0000","last_clean":"2023-07-06T01:10:10.292725+0000","last_became_active":"2023-07-06T01:10:06.804838+0000","last_became_peered":"2023-07-06T01:10:06.804838+0000","last_unstale":"2023-07-06T01:10:10.292725+0000","last_undegraded":"2023-07-06T01:10:10.292725+0000","last_fullsized":"2023-07-06T01:10:10.292725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:50:37.124045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176156+0000","last_change":"2023-07-06T01:10:07.822018+0000","last_active":"2023-07-06T01:10:10.176156+0000","last_peered":"2023-07-06T01:10:10.176156+0000","last_clean":"2023-07-06T01:10:10.176156+0000","last_became_active":"2023-07-06T01:10:07.821703+0000","last_became_peered":"2023-07-06T01:10:07.821703+0000","last_unstale":"2023-07-06T01:10:10.176156+0000","last_undegraded":"2023-07-06T01:10:10.176156+0000","last_fullsized":"2023-07-06T01:10:10.176156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:16:16.530402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925465+0000","last_change":"2023-07-06T01:10:06.799356+0000","last_active":"2023-07-06T01:10:08.925465+0000","last_peered":"2023-07-06T01:10:08.925465+0000","last_clean":"2023-07-06T01:10:08.925465+0000","last_became_active":"2023-07-06T01:10:06.799048+0000","last_became_peered":"2023-07-06T01:10:06.799048+0000","last_unstale":"2023-07-06T01:10:08.925465+0000","last_undegraded":"2023-07-06T01:10:08.925465+0000","last_fullsized":"2023-07-06T01:10:08.925465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:29:55.235414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807225+0000","last_change":"2023-07-06T01:10:07.816019+0000","last_active":"2023-07-06T01:10:08.807225+0000","last_peered":"2023-07-06T01:10:08.807225+0000","last_clean":"2023-07-06T01:10:08.807225+0000","last_became_active":"2023-07-06T01:10:07.815683+0000","last_became_peered":"2023-07-06T01:10:07.815683+0000","last_unstale":"2023-07-06T01:10:08.807225+0000","last_undegraded":"2023-07-06T01:10:08.807225+0000","last_fullsized":"2023-07-06T01:10:08.807225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:49:24.105581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925606+0000","last_change":"2023-07-06T01:10:06.800220+0000","last_active":"2023-07-06T01:10:08.925606+0000","last_peered":"2023-07-06T01:10:08.925606+0000","last_clean":"2023-07-06T01:10:08.925606+0000","last_became_active":"2023-07-06T01:10:06.799927+0000","last_became_peered":"2023-07-06T01:10:06.799927+0000","last_unstale":"2023-07-06T01:10:08.925606+0000","last_undegraded":"2023-07-06T01:10:08.925606+0000","last_fullsized":"2023-07-06T01:10:08.925606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:12:47.088373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.928837+0000","last_change":"2023-07-06T01:10:07.809747+0000","last_active":"2023-07-06T01:10:08.928837+0000","last_peered":"2023-07-06T01:10:08.928837+0000","last_clean":"2023-07-06T01:10:08.928837+0000","last_became_active":"2023-07-06T01:10:07.809478+0000","last_became_peered":"2023-07-06T01:10:07.809478+0000","last_unstale":"2023-07-06T01:10:08.928837+0000","last_undegraded":"2023-07-06T01:10:08.928837+0000","last_fullsized":"2023-07-06T01:10:08.928837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:09:51.135163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176342+0000","last_change":"2023-07-06T01:10:06.795373+0000","last_active":"2023-07-06T01:10:10.176342+0000","last_peered":"2023-07-06T01:10:10.176342+0000","last_clean":"2023-07-06T01:10:10.176342+0000","last_became_active":"2023-07-06T01:10:06.795083+0000","last_became_peered":"2023-07-06T01:10:06.795083+0000","last_unstale":"2023-07-06T01:10:10.176342+0000","last_undegraded":"2023-07-06T01:10:10.176342+0000","last_fullsized":"2023-07-06T01:10:10.176342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:40.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.293037+0000","last_change":"2023-07-06T01:10:07.823627+0000","last_active":"2023-07-06T01:10:10.293037+0000","last_peered":"2023-07-06T01:10:10.293037+0000","last_clean":"2023-07-06T01:10:10.293037+0000","last_became_active":"2023-07-06T01:10:07.823404+0000","last_became_peered":"2023-07-06T01:10:07.823404+0000","last_unstale":"2023-07-06T01:10:10.293037+0000","last_undegraded":"2023-07-06T01:10:10.293037+0000","last_fullsized":"2023-07-06T01:10:10.293037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:01:19.950466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925271+0000","last_change":"2023-07-06T01:10:06.796576+0000","last_active":"2023-07-06T01:10:08.925271+0000","last_peered":"2023-07-06T01:10:08.925271+0000","last_clean":"2023-07-06T01:10:08.925271+0000","last_became_active":"2023-07-06T01:10:06.796099+0000","last_became_peered":"2023-07-06T01:10:06.796099+0000","last_unstale":"2023-07-06T01:10:08.925271+0000","last_undegraded":"2023-07-06T01:10:08.925271+0000","last_fullsized":"2023-07-06T01:10:08.925271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:43:30.136697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807226+0000","last_change":"2023-07-06T01:10:07.814294+0000","last_active":"2023-07-06T01:10:08.807226+0000","last_peered":"2023-07-06T01:10:08.807226+0000","last_clean":"2023-07-06T01:10:08.807226+0000","last_became_active":"2023-07-06T01:10:07.814055+0000","last_became_peered":"2023-07-06T01:10:07.814055+0000","last_unstale":"2023-07-06T01:10:08.807226+0000","last_undegraded":"2023-07-06T01:10:08.807226+0000","last_fullsized":"2023-07-06T01:10:08.807226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:30:20.006641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807716+0000","last_change":"2023-07-06T01:10:06.797438+0000","last_active":"2023-07-06T01:10:08.807716+0000","last_peered":"2023-07-06T01:10:08.807716+0000","last_clean":"2023-07-06T01:10:08.807716+0000","last_became_active":"2023-07-06T01:10:06.796874+0000","last_became_peered":"2023-07-06T01:10:06.796874+0000","last_unstale":"2023-07-06T01:10:08.807716+0000","last_undegraded":"2023-07-06T01:10:08.807716+0000","last_fullsized":"2023-07-06T01:10:08.807716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:19:58.925416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292773+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:10.292773+0000","last_peered":"2023-07-06T01:10:10.292773+0000","last_clean":"2023-07-06T01:10:10.292773+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:10.292773+0000","last_undegraded":"2023-07-06T01:10:10.292773+0000","last_fullsized":"2023-07-06T01:10:10.292773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T12:05:48.074798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292812+0000","last_change":"2023-07-06T01:10:07.826361+0000","last_active":"2023-07-06T01:10:10.292812+0000","last_peered":"2023-07-06T01:10:10.292812+0000","last_clean":"2023-07-06T01:10:10.292812+0000","last_became_active":"2023-07-06T01:10:07.826078+0000","last_became_peered":"2023-07-06T01:10:07.826078+0000","last_unstale":"2023-07-06T01:10:10.292812+0000","last_undegraded":"2023-07-06T01:10:10.292812+0000","last_fullsized":"2023-07-06T01:10:10.292812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:50:38.130168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.807728+0000","last_change":"2023-07-06T01:10:06.794351+0000","last_active":"2023-07-06T01:10:08.807728+0000","last_peered":"2023-07-06T01:10:08.807728+0000","last_clean":"2023-07-06T01:10:08.807728+0000","last_became_active":"2023-07-06T01:10:06.794075+0000","last_became_peered":"2023-07-06T01:10:06.794075+0000","last_unstale":"2023-07-06T01:10:08.807728+0000","last_undegraded":"2023-07-06T01:10:08.807728+0000","last_fullsized":"2023-07-06T01:10:08.807728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:19:44.480259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929252+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:08.929252+0000","last_peered":"2023-07-06T01:10:08.929252+0000","last_clean":"2023-07-06T01:10:08.929252+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:08.929252+0000","last_undegraded":"2023-07-06T01:10:08.929252+0000","last_fullsized":"2023-07-06T01:10:08.929252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:32:27.735979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176632+0000","last_change":"2023-07-06T01:10:07.823399+0000","last_active":"2023-07-06T01:10:10.176632+0000","last_peered":"2023-07-06T01:10:10.176632+0000","last_clean":"2023-07-06T01:10:10.176632+0000","last_became_active":"2023-07-06T01:10:07.823114+0000","last_became_peered":"2023-07-06T01:10:07.823114+0000","last_unstale":"2023-07-06T01:10:10.176632+0000","last_undegraded":"2023-07-06T01:10:10.176632+0000","last_fullsized":"2023-07-06T01:10:10.176632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:48:20.437409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925774+0000","last_change":"2023-07-06T01:10:06.809864+0000","last_active":"2023-07-06T01:10:08.925774+0000","last_peered":"2023-07-06T01:10:08.925774+0000","last_clean":"2023-07-06T01:10:08.925774+0000","last_became_active":"2023-07-06T01:10:06.809495+0000","last_became_peered":"2023-07-06T01:10:06.809495+0000","last_unstale":"2023-07-06T01:10:08.925774+0000","last_undegraded":"2023-07-06T01:10:08.925774+0000","last_fullsized":"2023-07-06T01:10:08.925774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:53:29.533396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.925406+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:08.925406+0000","last_peered":"2023-07-06T01:10:08.925406+0000","last_clean":"2023-07-06T01:10:08.925406+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:08.925406+0000","last_undegraded":"2023-07-06T01:10:08.925406+0000","last_fullsized":"2023-07-06T01:10:08.925406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:16:45.997901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929245+0000","last_change":"2023-07-06T01:10:07.826965+0000","last_active":"2023-07-06T01:10:08.929245+0000","last_peered":"2023-07-06T01:10:08.929245+0000","last_clean":"2023-07-06T01:10:08.929245+0000","last_became_active":"2023-07-06T01:10:07.826589+0000","last_became_peered":"2023-07-06T01:10:07.826589+0000","last_unstale":"2023-07-06T01:10:08.929245+0000","last_undegraded":"2023-07-06T01:10:08.929245+0000","last_fullsized":"2023-07-06T01:10:08.929245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:23:57.199450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176423+0000","last_change":"2023-07-06T01:10:06.798475+0000","last_active":"2023-07-06T01:10:10.176423+0000","last_peered":"2023-07-06T01:10:10.176423+0000","last_clean":"2023-07-06T01:10:10.176423+0000","last_became_active":"2023-07-06T01:10:06.798167+0000","last_became_peered":"2023-07-06T01:10:06.798167+0000","last_unstale":"2023-07-06T01:10:10.176423+0000","last_undegraded":"2023-07-06T01:10:10.176423+0000","last_fullsized":"2023-07-06T01:10:10.176423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:13.000283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929339+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:08.929339+0000","last_peered":"2023-07-06T01:10:08.929339+0000","last_clean":"2023-07-06T01:10:08.929339+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:08.929339+0000","last_undegraded":"2023-07-06T01:10:08.929339+0000","last_fullsized":"2023-07-06T01:10:08.929339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:35:16.280708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176298+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:10.176298+0000","last_peered":"2023-07-06T01:10:10.176298+0000","last_clean":"2023-07-06T01:10:10.176298+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:10.176298+0000","last_undegraded":"2023-07-06T01:10:10.176298+0000","last_fullsized":"2023-07-06T01:10:10.176298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:25:30.527939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292693+0000","last_change":"2023-07-06T01:10:07.825229+0000","last_active":"2023-07-06T01:10:10.292693+0000","last_peered":"2023-07-06T01:10:10.292693+0000","last_clean":"2023-07-06T01:10:10.292693+0000","last_became_active":"2023-07-06T01:10:07.824954+0000","last_became_peered":"2023-07-06T01:10:07.824954+0000","last_unstale":"2023-07-06T01:10:10.292693+0000","last_undegraded":"2023-07-06T01:10:10.292693+0000","last_fullsized":"2023-07-06T01:10:10.292693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:26:37.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.929419+0000","last_change":"2023-07-06T01:10:06.809002+0000","last_active":"2023-07-06T01:10:08.929419+0000","last_peered":"2023-07-06T01:10:08.929419+0000","last_clean":"2023-07-06T01:10:08.929419+0000","last_became_active":"2023-07-06T01:10:06.808542+0000","last_became_peered":"2023-07-06T01:10:06.808542+0000","last_unstale":"2023-07-06T01:10:08.929419+0000","last_undegraded":"2023-07-06T01:10:08.929419+0000","last_fullsized":"2023-07-06T01:10:08.929419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:03:40.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176378+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:10.176378+0000","last_peered":"2023-07-06T01:10:10.176378+0000","last_clean":"2023-07-06T01:10:10.176378+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:10.176378+0000","last_undegraded":"2023-07-06T01:10:10.176378+0000","last_fullsized":"2023-07-06T01:10:10.176378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:50:00.679088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292686+0000","last_change":"2023-07-06T01:10:07.820497+0000","last_active":"2023-07-06T01:10:10.292686+0000","last_peered":"2023-07-06T01:10:10.292686+0000","last_clean":"2023-07-06T01:10:10.292686+0000","last_became_active":"2023-07-06T01:10:07.820225+0000","last_became_peered":"2023-07-06T01:10:07.820225+0000","last_unstale":"2023-07-06T01:10:10.292686+0000","last_undegraded":"2023-07-06T01:10:10.292686+0000","last_fullsized":"2023-07-06T01:10:10.292686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:43:43.977091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808426+0000","last_change":"2023-07-06T01:10:06.801680+0000","last_active":"2023-07-06T01:10:08.808426+0000","last_peered":"2023-07-06T01:10:08.808426+0000","last_clean":"2023-07-06T01:10:08.808426+0000","last_became_active":"2023-07-06T01:10:06.801250+0000","last_became_peered":"2023-07-06T01:10:06.801250+0000","last_unstale":"2023-07-06T01:10:08.808426+0000","last_undegraded":"2023-07-06T01:10:08.808426+0000","last_fullsized":"2023-07-06T01:10:08.808426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:52:38.074217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176628+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:10.176628+0000","last_peered":"2023-07-06T01:10:10.176628+0000","last_clean":"2023-07-06T01:10:10.176628+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:10.176628+0000","last_undegraded":"2023-07-06T01:10:10.176628+0000","last_fullsized":"2023-07-06T01:10:10.176628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:56:33.946928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526811+0000","last_change":"2023-07-06T01:10:07.818021+0000","last_active":"2023-07-06T01:10:09.526811+0000","last_peered":"2023-07-06T01:10:09.526811+0000","last_clean":"2023-07-06T01:10:09.526811+0000","last_became_active":"2023-07-06T01:10:07.817686+0000","last_became_peered":"2023-07-06T01:10:07.817686+0000","last_unstale":"2023-07-06T01:10:09.526811+0000","last_undegraded":"2023-07-06T01:10:09.526811+0000","last_fullsized":"2023-07-06T01:10:09.526811+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:36:14.006406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:09.526497+0000","last_change":"2023-07-06T01:10:06.807223+0000","last_active":"2023-07-06T01:10:09.526497+0000","last_peered":"2023-07-06T01:10:09.526497+0000","last_clean":"2023-07-06T01:10:09.526497+0000","last_became_active":"2023-07-06T01:10:06.806960+0000","last_became_peered":"2023-07-06T01:10:06.806960+0000","last_unstale":"2023-07-06T01:10:09.526497+0000","last_undegraded":"2023-07-06T01:10:09.526497+0000","last_fullsized":"2023-07-06T01:10:09.526497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:51:22.290143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292705+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:10.292705+0000","last_peered":"2023-07-06T01:10:10.292705+0000","last_clean":"2023-07-06T01:10:10.292705+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:10.292705+0000","last_undegraded":"2023-07-06T01:10:10.292705+0000","last_fullsized":"2023-07-06T01:10:10.292705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:58:47.944191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.176395+0000","last_change":"2023-07-06T01:10:07.825033+0000","last_active":"2023-07-06T01:10:10.176395+0000","last_peered":"2023-07-06T01:10:10.176395+0000","last_clean":"2023-07-06T01:10:10.176395+0000","last_became_active":"2023-07-06T01:10:07.824350+0000","last_became_peered":"2023-07-06T01:10:07.824350+0000","last_unstale":"2023-07-06T01:10:10.176395+0000","last_undegraded":"2023-07-06T01:10:10.176395+0000","last_fullsized":"2023-07-06T01:10:10.176395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:06.777833+0000","last_clean_scrub_stamp":"2023-07-06T01:10:06.777833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:33:50.353157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:10.292370+0000","last_change":"2023-07-06T01:10:06.804068+0000","last_active":"2023-07-06T01:10:10.292370+0000","last_peered":"2023-07-06T01:10:10.292370+0000","last_clean":"2023-07-06T01:10:10.292370+0000","last_became_active":"2023-07-06T01:10:06.803802+0000","last_became_peered":"2023-07-06T01:10:06.803802+0000","last_unstale":"2023-07-06T01:10:10.292370+0000","last_undegraded":"2023-07-06T01:10:10.292370+0000","last_fullsized":"2023-07-06T01:10:10.292370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:05.771710+0000","last_clean_scrub_stamp":"2023-07-06T01:10:05.771710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T04:26:00.947182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-06T01:10:08.808654+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:08.808654+0000","last_peered":"2023-07-06T01:10:08.808654+0000","last_clean":"2023-07-06T01:10:08.808654+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:08.808654+0000","last_undegraded":"2023-07-06T01:10:08.808654+0000","last_fullsized":"2023-07-06T01:10:08.808654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:27:33.713444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":1019904,"data_stored":761722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.745}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.76300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":170302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.501}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.437},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.82799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":1007616,"data_stored":760122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.434},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":169790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.35599999999999998},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.498},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":171318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.31900000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.94899999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.90600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":170324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.625}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":169832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.753}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.626}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:17.599 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T01:10:17.599 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T01:10:17.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.830+0000 7fdae67ff700 1 Processor -- start 2023-07-06T01:10:17.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.830+0000 7fdae67ff700 1 -- start start 2023-07-06T01:10:17.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdae67ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdae015fca0 0x7fdae00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdae67ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdae00b5c90 0x7fdae00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdae67ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae00cf780 con 0x7fdae00b6110 2023-07-06T01:10:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdae67ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00cd490 con 0x7fdae00b5c90 2023-07-06T01:10:17.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdae67ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00cd770 con 0x7fdae015fca0 2023-07-06T01:10:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdadf7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdae00b5c90 0x7fdae00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdadf7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdae00b5c90 0x7fdae00d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57552/0 (socket says 172.21.15.71:57552) 2023-07-06T01:10:17.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdadf7fe700 1 -- 172.21.15.71:0/4247541009 learned_addr learned my addr 172.21.15.71:0/4247541009 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.831+0000 7fdadffff700 1 --2- 172.21.15.71:0/4247541009 >> v2:172.21.15.194:3300/0 conn(0x7fdae015fca0 0x7fdae00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadf7fe700 1 -- 172.21.15.71:0/4247541009 >> v2:172.21.15.194:3300/0 conn(0x7fdae015fca0 msgr2=0x7fdae00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadf7fe700 1 --2- 172.21.15.71:0/4247541009 >> v2:172.21.15.194:3300/0 conn(0x7fdae015fca0 0x7fdae00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadf7fe700 1 -- 172.21.15.71:0/4247541009 >> v1:172.21.15.194:6789/0 conn(0x7fdae00b6110 legacy=0x7fdae00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadf7fe700 1 -- 172.21.15.71:0/4247541009 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00cda50 con 0x7fdae00b5c90 2023-07-06T01:10:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadf7fe700 1 --2- 172.21.15.71:0/4247541009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b5c90 0x7fdae00d2d40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdae00d0930 tx=0x7fdad4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226a36054c58d30b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadeffd700 1 -- 172.21.15.71:0/4247541009 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400b870 con 0x7fdae00b5c90 2023-07-06T01:10:17.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadeffd700 1 -- 172.21.15.71:0/4247541009 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400b9d0 con 0x7fdae00b5c90 2023-07-06T01:10:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.832+0000 7fdadeffd700 1 -- 172.21.15.71:0/4247541009 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400bd60 con 0x7fdae00b5c90 2023-07-06T01:10:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 -- 172.21.15.71:0/4247541009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b5c90 msgr2=0x7fdae00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 --2- 172.21.15.71:0/4247541009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b5c90 0x7fdae00d2d40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdae00d0930 tx=0x7fdad4009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 -- 172.21.15.71:0/4247541009 shutdown_connections 2023-07-06T01:10:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 --2- 172.21.15.71:0/4247541009 >> v2:172.21.15.194:3300/0 conn(0x7fdae015fca0 0x7fdae00d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 --2- 172.21.15.71:0/4247541009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b5c90 0x7fdae00d2d40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 -- 172.21.15.71:0/4247541009 >> 172.21.15.71:0/4247541009 conn(0x7fdae006c150 msgr2=0x7fdae006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 -- 172.21.15.71:0/4247541009 shutdown_connections 2023-07-06T01:10:17.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.833+0000 7fdae67ff700 1 -- 172.21.15.71:0/4247541009 wait complete. 2023-07-06T01:10:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.835+0000 7fdae67ff700 1 Processor -- start 2023-07-06T01:10:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.835+0000 7fdae67ff700 1 -- start start 2023-07-06T01:10:17.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae67ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdae00b5c90 0x7fdae014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae67ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 0x7fdae015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae67ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdae015fca0 0x7fdae015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae67ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c7800 con 0x7fdae00b6110 2023-07-06T01:10:17.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae67ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c7c90 con 0x7fdae015fca0 2023-07-06T01:10:17.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae67ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae00c6910 con 0x7fdae00b5c90 2023-07-06T01:10:17.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 0x7fdae015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 0x7fdae015a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57564/0 (socket says 172.21.15.71:57564) 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 -- 172.21.15.71:0/2857018655 learned_addr learned my addr 172.21.15.71:0/2857018655 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadffff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdae00b5c90 0x7fdae014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdae4d9c700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdae015fca0 0x7fdae015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 -- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdae00b5c90 msgr2=0x7fdae014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdae00b5c90 0x7fdae014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 -- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdae015fca0 msgr2=0x7fdae015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:17.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.836+0000 7fdadf7fe700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdae015fca0 0x7fdae015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdadf7fe700 1 -- 172.21.15.71:0/2857018655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009550 con 0x7fdae00b6110 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdae4d9c700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdae015fca0 0x7fdae015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdadffff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdae00b5c90 0x7fdae014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdadf7fe700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 0x7fdae015a4f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4004540 con 0x7fdae00b6110 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40036a0 con 0x7fdae00b6110 2023-07-06T01:10:17.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae00c6bf0 con 0x7fdae00b6110 2023-07-06T01:10:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4003a30 con 0x7fdae00b6110 2023-07-06T01:10:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.837+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae00c71b0 con 0x7fdae00b6110 2023-07-06T01:10:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.838+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae00008d0 con 0x7fdae00b6110 2023-07-06T01:10:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.839+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdad4021070 con 0x7fdae00b6110 2023-07-06T01:10:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.841+0000 7fdadcff9700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdacc06ace0 0x7fdacc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:17.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.841+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdad408ab80 con 0x7fdae00b6110 2023-07-06T01:10:17.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.841+0000 7fdadffff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdacc06ace0 0x7fdacc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:17.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.842+0000 7fdadffff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdacc06ace0 0x7fdacc06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdad000ba70 tx=0x7fdad0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:17.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:17.845+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdad4055cc0 con 0x7fdae00b6110 2023-07-06T01:10:18.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.117+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdae00c7940 con 0x7fdae00b6110 2023-07-06T01:10:18.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.122+0000 7fdadcff9700 1 -- 172.21.15.71:0/2857018655 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fdad40150e0 con 0x7fdae00b6110 2023-07-06T01:10:18.125 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2023-07-06T01:10:18.125 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDiE6ZkSzPRJRAAmgb9CVEUw/PXwFq+mKxoFg== 2023-07-06T01:10:18.125 INFO:teuthology.orchestra.run.smithi071.stdout: caps mds = "allow" 2023-07-06T01:10:18.125 INFO:teuthology.orchestra.run.smithi071.stdout: caps mon = "allow r" 2023-07-06T01:10:18.125 INFO:teuthology.orchestra.run.smithi071.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-06T01:10:18.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdacc06ace0 msgr2=0x7fdacc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdacc06ace0 0x7fdacc06d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdad000ba70 tx=0x7fdad0008040 comp rx=0 tx=0).stop 2023-07-06T01:10:18.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 msgr2=0x7fdae015a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 0x7fdae015a4f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad4004750 comp rx=0 tx=0).stop 2023-07-06T01:10:18.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 shutdown_connections 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fdacc06ace0 0x7fdacc06d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdae015fca0 0x7fdae015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdae00b5c90 0x7fdae014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 --2- 172.21.15.71:0/2857018655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdae00b6110 0x7fdae015a4f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 >> 172.21.15.71:0/2857018655 conn(0x7fdae006c150 msgr2=0x7fdae00b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 shutdown_connections 2023-07-06T01:10:18.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.124+0000 7fdae67ff700 1 -- 172.21.15.71:0/2857018655 wait complete. 2023-07-06T01:10:18.129 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-07-06T01:10:18.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:10:18.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.336+0000 7f9640fff700 1 Processor -- start 2023-07-06T01:10:18.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.337+0000 7f9640fff700 1 -- start start 2023-07-06T01:10:18.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9640fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0c9010 0x7f963c0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9640fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f963c1565f0 0x7f963c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9640fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f963c0c9a60 con 0x7f963c06c330 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9640fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f963c159b70 con 0x7f963c1565f0 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9640fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c159e50 con 0x7f963c0c9010 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f963a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f963c06c330 0x7f963c06c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58014/0 (socket says 172.21.15.71:58014) 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f963a59c700 1 -- 172.21.15.71:0/3535247177 learned_addr learned my addr 172.21.15.71:0/3535247177 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:18.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f963ad9d700 1 --2- 172.21.15.71:0/3535247177 >> v2:172.21.15.71:3300/0 conn(0x7f963c1565f0 0x7f963c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:18.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9633fff700 1 --2- 172.21.15.71:0/3535247177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0c9010 0x7f963c0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f963ad9d700 1 -- 172.21.15.71:0/3535247177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0c9010 msgr2=0x7f963c0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f963ad9d700 1 --2- 172.21.15.71:0/3535247177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0c9010 0x7f963c0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f963ad9d700 1 -- 172.21.15.71:0/3535247177 >> v1:172.21.15.71:6789/0 conn(0x7f963c06c330 legacy=0x7f963c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f963ad9d700 1 -- 172.21.15.71:0/3535247177 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c15a130 con 0x7f963c1565f0 2023-07-06T01:10:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.338+0000 7f9639d9b700 1 -- 172.21.15.71:0/3535247177 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041816575 0 0) 0x7f963c0c9a60 con 0x7f963c06c330 2023-07-06T01:10:18.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f963ad9d700 1 --2- 172.21.15.71:0/3535247177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c1565f0 0x7f963c156a60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9634009d90 tx=0x7f963400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824bd434778485df server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f9639d9b700 1 -- 172.21.15.71:0/3535247177 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963400e070 con 0x7f963c1565f0 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f9639d9b700 1 -- 172.21.15.71:0/3535247177 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963400bb20 con 0x7f963c1565f0 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f9639d9b700 1 -- 172.21.15.71:0/3535247177 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634012430 con 0x7f963c1565f0 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f9640fff700 1 -- 172.21.15.71:0/3535247177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c1565f0 msgr2=0x7f963c156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.339+0000 7f9640fff700 1 --2- 172.21.15.71:0/3535247177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c1565f0 0x7f963c156a60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9634009d90 tx=0x7f963400b330 comp rx=0 tx=0).stop 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.340+0000 7f9640fff700 1 -- 172.21.15.71:0/3535247177 shutdown_connections 2023-07-06T01:10:18.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.340+0000 7f9640fff700 1 --2- 172.21.15.71:0/3535247177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c1565f0 0x7f963c156a60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.340+0000 7f9640fff700 1 --2- 172.21.15.71:0/3535247177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c0c9010 0x7f963c0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.340+0000 7f9640fff700 1 -- 172.21.15.71:0/3535247177 >> 172.21.15.71:0/3535247177 conn(0x7f963c0cb440 msgr2=0x7f963c0cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:18.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.340+0000 7f9640fff700 1 -- 172.21.15.71:0/3535247177 shutdown_connections 2023-07-06T01:10:18.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.340+0000 7f9640fff700 1 -- 172.21.15.71:0/3535247177 wait complete. 2023-07-06T01:10:18.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.342+0000 7f9640fff700 1 Processor -- start 2023-07-06T01:10:18.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.342+0000 7f9640fff700 1 -- start start 2023-07-06T01:10:18.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.343+0000 7f9640fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 0x7f963c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.343+0000 7f9640fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c0c9010 0x7f963c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.343+0000 7f9640fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c1565f0 0x7f963c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f9640fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c1f0d50 con 0x7f963c06c330 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f9640fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c0c7e70 con 0x7f963c0c9010 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f9640fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c1f0790 con 0x7f963c1565f0 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 0x7f963c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 0x7f963c0c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57572/0 (socket says 172.21.15.71:57572) 2023-07-06T01:10:18.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 -- 172.21.15.71:0/367915671 learned_addr learned my addr 172.21.15.71:0/367915671 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:18.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963ad9d700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c1565f0 0x7f963c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:18.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f9633fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c0c9010 0x7f963c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:18.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 -- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c1565f0 msgr2=0x7f963c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c1565f0 0x7f963c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 -- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c0c9010 msgr2=0x7f963c151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c0c9010 0x7f963c151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 -- 172.21.15.71:0/367915671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009a70 con 0x7f963c06c330 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.344+0000 7f963a59c700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 0x7f963c0c8300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c550 tx=0x7f962c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.345+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c004c80 con 0x7f963c06c330 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.345+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c004e00 con 0x7f963c06c330 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.345+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c007310 con 0x7f963c06c330 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.345+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963c1f0a70 con 0x7f963c06c330 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.345+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963c0c8840 con 0x7f963c06c330 2023-07-06T01:10:18.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.346+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963c0c7960 con 0x7f963c06c330 2023-07-06T01:10:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.347+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f962c007470 con 0x7f963c06c330 2023-07-06T01:10:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.348+0000 7f9632ffd700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f961c06ace0 0x7f961c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.348+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f962c088f40 con 0x7f963c06c330 2023-07-06T01:10:18.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.348+0000 7f9633fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f961c06ace0 0x7f961c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:18.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.349+0000 7f9633fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f961c06ace0 0x7f961c06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ad810 tx=0x7f9624009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:18.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.352+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f963c0c7960 con 0x7f963c06c330 2023-07-06T01:10:18.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.590+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f963c0c7960 con 0x7f963c06c330 2023-07-06T01:10:18.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.590+0000 7f9632ffd700 1 -- 172.21.15.71:0/367915671 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f963c0c7960 con 0x7f963c06c330 2023-07-06T01:10:18.593 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:18.593 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:10:07.271274+0000","modified":"2023-07-06T01:10:10.810493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6835/783929387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":783929387},{"type":"v1","addr":"172.21.15.71:6835","nonce":783929387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T01:10:18.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f961c06ace0 msgr2=0x7f961c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f961c06ace0 0x7f961c06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f963c0ad810 tx=0x7f9624009210 comp rx=0 tx=0).stop 2023-07-06T01:10:18.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 msgr2=0x7f963c0c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:18.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 0x7f963c0c8300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c550 tx=0x7f962c00c860 comp rx=0 tx=0).stop 2023-07-06T01:10:18.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 shutdown_connections 2023-07-06T01:10:18.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f961c06ace0 0x7f961c06d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f963c1565f0 0x7f963c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f963c06c330 0x7f963c0c8300 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 --2- 172.21.15.71:0/367915671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f963c0c9010 0x7f963c151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:18.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 >> 172.21.15.71:0/367915671 conn(0x7f963c0cb440 msgr2=0x7f963c1e2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:18.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 shutdown_connections 2023-07-06T01:10:18.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:18.593+0000 7f9640fff700 1 -- 172.21.15.71:0/367915671 wait complete. 2023-07-06T01:10:18.599 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 16 2023-07-06T01:10:19.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T01:10:07.271274+0000', 'modified': '2023-07-06T01:10:10.810493+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5145}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5145': {'gid': 5145, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6835/783929387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6833', 'nonce': 783929387}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 783929387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T01:10:19.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T01:10:19.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T01:10:19.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.213+0000 7f0ac27ff700 1 Processor -- start 2023-07-06T01:10:19.216 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.213+0000 7f0ac27ff700 1 -- start start 2023-07-06T01:10:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.214+0000 7f0ac27ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.214+0000 7f0ac27ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0cf780 con 0x7f0abc0b6100 2023-07-06T01:10:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0ac27ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0cd490 con 0x7f0abc0b5c90 2023-07-06T01:10:19.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0ac27ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0cd770 con 0x7f0abc15fca0 2023-07-06T01:10:19.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0ac0d9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0abc0b6100 0x7f0abc0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58016/0 (socket says 172.21.15.71:58016) 2023-07-06T01:10:19.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0ac0d9c700 1 -- 172.21.15.71:0/712906883 learned_addr learned my addr 172.21.15.71:0/712906883 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:19.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abbfff700 1 --2- 172.21.15.71:0/712906883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542850921 0 0) 0x7f0abc0cf780 con 0x7f0abc0b6100 2023-07-06T01:10:19.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa80035b0 con 0x7f0abc0b6100 2023-07-06T01:10:19.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613876036 0 0) 0x7f0abc0cd490 con 0x7f0abc0b5c90 2023-07-06T01:10:19.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0abc0cf780 con 0x7f0abc0b5c90 2023-07-06T01:10:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787984569 0 0) 0x7f0aa80035b0 con 0x7f0abc0b6100 2023-07-06T01:10:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abbfff700 1 -- 172.21.15.71:0/712906883 >> v1:172.21.15.194:6789/0 conn(0x7f0abc0b5c90 legacy=0x7f0abc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.215+0000 7f0abbfff700 1 -- 172.21.15.71:0/712906883 >> v1:172.21.15.71:6789/0 conn(0x7f0abc0b6100 legacy=0x7f0abc0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.216+0000 7f0abbfff700 1 -- 172.21.15.71:0/712906883 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0cda50 con 0x7f0abc15fca0 2023-07-06T01:10:19.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.216+0000 7f0abbfff700 1 --2- 172.21.15.71:0/712906883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0d1420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009870 tx=0x7f0aac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d4b6f97120456c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.216+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4001670 con 0x7f0abc15fca0 2023-07-06T01:10:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.216+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac004030 con 0x7f0abc15fca0 2023-07-06T01:10:19.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.216+0000 7f0abb7fe700 1 -- 172.21.15.71:0/712906883 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0043c0 con 0x7f0abc15fca0 2023-07-06T01:10:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 -- 172.21.15.71:0/712906883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 msgr2=0x7f0abc0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/712906883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0d1420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009870 tx=0x7f0aac009b80 comp rx=0 tx=0).stop 2023-07-06T01:10:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 -- 172.21.15.71:0/712906883 shutdown_connections 2023-07-06T01:10:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/712906883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0d1420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 -- 172.21.15.71:0/712906883 >> 172.21.15.71:0/712906883 conn(0x7f0abc06c150 msgr2=0x7f0abc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 -- 172.21.15.71:0/712906883 shutdown_connections 2023-07-06T01:10:19.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.217+0000 7f0ac27ff700 1 -- 172.21.15.71:0/712906883 wait complete. 2023-07-06T01:10:19.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.219+0000 7f0ac27ff700 1 Processor -- start 2023-07-06T01:10:19.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.219+0000 7f0ac27ff700 1 -- start start 2023-07-06T01:10:19.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.220+0000 7f0ac27ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 0x7f0abc156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0ac27ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0abc0b6100 0x7f0abc0cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0ac27ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0ac27ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1572f0 con 0x7f0abc0b5c90 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0ac27ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc15cc50 con 0x7f0abc0b6100 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0ac27ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc1e77e0 con 0x7f0abc15fca0 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 0x7f0abc156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 0x7f0abc156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57582/0 (socket says 172.21.15.71:57582) 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 -- 172.21.15.71:0/576956993 learned_addr learned my addr 172.21.15.71:0/576956993 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 -- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 msgr2=0x7f0abc0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 -- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0abc0b6100 msgr2=0x7f0abc0cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0abc0b6100 0x7f0abc0cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 -- 172.21.15.71:0/576956993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0094a0 con 0x7f0abc0b5c90 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.221+0000 7f0abbfff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 0x7f0abc156db0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.222+0000 7f0ab97fa700 1 -- 172.21.15.71:0/576956993 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac003e30 con 0x7f0abc0b5c90 2023-07-06T01:10:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.222+0000 7f0ab97fa700 1 -- 172.21.15.71:0/576956993 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac01f070 con 0x7f0abc0b5c90 2023-07-06T01:10:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.222+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc1e7ac0 con 0x7f0abc0b5c90 2023-07-06T01:10:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.222+0000 7f0ab97fa700 1 -- 172.21.15.71:0/576956993 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac011870 con 0x7f0abc0b5c90 2023-07-06T01:10:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.222+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc15c590 con 0x7f0abc0b5c90 2023-07-06T01:10:19.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.224+0000 7f0ab97fa700 1 -- 172.21.15.71:0/576956993 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0aac021030 con 0x7f0abc0b5c90 2023-07-06T01:10:19.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.225+0000 7f0ab97fa700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0a9c06ace0 0x7f0a9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.225+0000 7f0ab97fa700 1 -- 172.21.15.71:0/576956993 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0aac08a8d0 con 0x7f0abc0b5c90 2023-07-06T01:10:19.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.225+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0a9c06ace0 0x7f0a9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.226+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0a9c06ace0 0x7f0a9c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4001460 tx=0x7f0aa40017c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.226+0000 7f0ad6140b80 1 Processor -- start 2023-07-06T01:10:19.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 -- start start 2023-07-06T01:10:19.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 0x55d1fc546120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc569a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc523110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc497ea0 con 0x55d1fc545d50 2023-07-06T01:10:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc40b600 con 0x55d1fc54b190 2023-07-06T01:10:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.227+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc47a910 con 0x55d1fc520b50 2023-07-06T01:10:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 0x55d1fc546120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 0x55d1fc546120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57584/0 (socket says 172.21.15.71:57584) 2023-07-06T01:10:19.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 -- 172.21.15.71:0/807485811 learned_addr learned my addr 172.21.15.71:0/807485811 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc569a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc523110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 -- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 msgr2=0x55d1fc523110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc523110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 -- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 msgr2=0x55d1fc569a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc569a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 -- 172.21.15.71:0/807485811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1fc267790 con 0x55d1fc545d50 2023-07-06T01:10:19.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc523110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0abbfff700 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 0x55d1fc546120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0090b0 tx=0x7f0aac061aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13062601a56e667 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0ab1ffb700 1 -- 172.21.15.71:0/807485811 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac057950 con 0x55d1fc545d50 2023-07-06T01:10:19.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0ab1ffb700 1 -- 172.21.15.71:0/807485811 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac058c40 con 0x55d1fc545d50 2023-07-06T01:10:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.228+0000 7f0ab1ffb700 1 -- 172.21.15.71:0/807485811 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac061610 con 0x55d1fc545d50 2023-07-06T01:10:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 -- 172.21.15.71:0/807485811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 msgr2=0x55d1fc546120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 0x55d1fc546120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0090b0 tx=0x7f0aac061aa0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 -- 172.21.15.71:0/807485811 shutdown_connections 2023-07-06T01:10:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc523110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc545d50 0x55d1fc546120 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/807485811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc569a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 -- 172.21.15.71:0/807485811 >> 172.21.15.71:0/807485811 conn(0x55d1fc518310 msgr2=0x55d1fc5685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 -- 172.21.15.71:0/807485811 shutdown_connections 2023-07-06T01:10:19.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.229+0000 7f0ad6140b80 1 -- 172.21.15.71:0/807485811 wait complete. 2023-07-06T01:10:19.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.230+0000 7f0ad6140b80 1 -- start start 2023-07-06T01:10:19.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.230+0000 7f0ad6140b80 1 Processor -- start 2023-07-06T01:10:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc5403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 0x55d1fc543ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc473be0 con 0x55d1fc54b190 2023-07-06T01:10:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc4315b0 con 0x55d1fc545d50 2023-07-06T01:10:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc417910 con 0x55d1fc520b50 2023-07-06T01:10:19.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ad6140b80 10 client.0 _ll_register_callbacks cb 0x55d1fc42fb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T01:10:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.231+0000 7f0ac0d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 0x55d1fc543ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc5403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 0x55d1fc543ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57592/0 (socket says 172.21.15.71:57592) 2023-07-06T01:10:19.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 -- 172.21.15.71:0/261470620 learned_addr learned my addr 172.21.15.71:0/261470620 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 -- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 msgr2=0x55d1fc5403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc5403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 -- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 msgr2=0x55d1fc56c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 -- 172.21.15.71:0/261470620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc15c590 con 0x55d1fc54b190 2023-07-06T01:10:19.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 0x55d1fc543ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400d180 tx=0x7f0ab400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ded6d2fa5ac953 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0a9affd700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-07-06T01:10:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0a9affd700 1 -- 172.21.15.71:0/261470620 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4004870 con 0x55d1fc54b190 2023-07-06T01:10:19.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0a9affd700 1 -- 172.21.15.71:0/261470620 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ab4013be0 con 0x55d1fc54b190 2023-07-06T01:10:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.232+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1fc515920 con 0x55d1fc54b190 2023-07-06T01:10:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0a9affd700 1 -- 172.21.15.71:0/261470620 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab40012c0 con 0x55d1fc54b190 2023-07-06T01:10:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 10 client.5340 fetch_fsmap learned FSMap version 16 2023-07-06T01:10:19.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d1fc3540a0 con 0x55d1fc54b190 2023-07-06T01:10:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0a9affd700 1 -- 172.21.15.71:0/261470620 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1fc515920 con 0x55d1fc54b190 2023-07-06T01:10:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0a9affd700 1 -- 172.21.15.71:0/261470620 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0ab40049d0 con 0x55d1fc54b190 2023-07-06T01:10:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 10 client.5340 fetch_fsmap finished waiting for FSMap version 16 2023-07-06T01:10:19.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 10 client.5340 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T01:10:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 20 client.5340 populate_metadata read hostname 'smithi071' 2023-07-06T01:10:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc57b220 0x55d1fc57b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 4 client.5340 mds_command: new command op to 5145 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T01:10:19.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 --> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1fc4f20d0 con 0x55d1fc57b220 2023-07-06T01:10:19.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.233+0000 7f0abbfff700 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc57b220 0x55d1fc57b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.234+0000 7f0abbfff700 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc57b220 0x55d1fc57b5f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f65ef0b5d031a7 server_cookie=9629068766359f3d in_seq=0 out_seq=0 2023-07-06T01:10:19.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.234+0000 7f0a9affd700 10 client.5340 ms_handle_connect on v2:172.21.15.71:6833/783929387 2023-07-06T01:10:19.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.234+0000 7f0a9affd700 1 -- 172.21.15.71:0/261470620 <== mds.0 v2:172.21.15.71:6833/783929387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d1fc4f20d0 con 0x55d1fc57b220 2023-07-06T01:10:19.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.234+0000 7f0a9affd700 10 client.5340 handle_command_reply: tid=0 2023-07-06T01:10:19.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 client.5340 shutdown 2023-07-06T01:10:19.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 msgr2=0x55d1fc543ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 0x55d1fc543ee0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400d180 tx=0x7f0ab400d490 comp rx=0 tx=0).stop 2023-07-06T01:10:19.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 shutdown_connections 2023-07-06T01:10:19.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc57b220 0x55d1fc57b5f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc54b190 0x55d1fc543ee0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc520b50 0x55d1fc5403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0a9affd700 0 client.5340 ms_handle_reset on v2:172.21.15.71:6833/783929387 2023-07-06T01:10:19.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/261470620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 >> 172.21.15.71:0/261470620 conn(0x55d1fc518310 msgr2=0x55d1fc54ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 shutdown_connections 2023-07-06T01:10:19.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 1 -- 172.21.15.71:0/261470620 wait complete. 2023-07-06T01:10:19.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.235+0000 7f0ad6140b80 20 client.5340 trim_cache size 0 max 16384 2023-07-06T01:10:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.253+0000 7f0ad6140b80 1 Processor -- start 2023-07-06T01:10:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.253+0000 7f0ad6140b80 1 -- start start 2023-07-06T01:10:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc51e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc54b190 0x55d1fc521f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc522ea0 con 0x55d1fc520b50 2023-07-06T01:10:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc268390 con 0x55d1fc545d50 2023-07-06T01:10:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc57a900 con 0x55d1fc54b190 2023-07-06T01:10:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc51e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc51e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57596/0 (socket says 172.21.15.71:57596) 2023-07-06T01:10:19.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 -- 172.21.15.71:0/3202242988 learned_addr learned my addr 172.21.15.71:0/3202242988 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:19.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc54b190 0x55d1fc521f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 -- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc54b190 msgr2=0x55d1fc521f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc54b190 0x55d1fc521f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 -- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 msgr2=0x55d1fc56ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.254+0000 7f0abbfff700 1 -- 172.21.15.71:0/3202242988 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1fc439b10 con 0x55d1fc520b50 2023-07-06T01:10:19.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0abbfff700 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc51e3d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0aac05d8d0 tx=0x7f0aac05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c50b6947cfb8dd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ab27fc700 1 -- 172.21.15.71:0/3202242988 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac087040 con 0x55d1fc520b50 2023-07-06T01:10:19.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ab27fc700 1 -- 172.21.15.71:0/3202242988 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac061610 con 0x55d1fc520b50 2023-07-06T01:10:19.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ab27fc700 1 -- 172.21.15.71:0/3202242988 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac05ab40 con 0x55d1fc520b50 2023-07-06T01:10:19.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 -- 172.21.15.71:0/3202242988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 msgr2=0x55d1fc51e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc51e3d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0aac05d8d0 tx=0x7f0aac05b000 comp rx=0 tx=0).stop 2023-07-06T01:10:19.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 -- 172.21.15.71:0/3202242988 shutdown_connections 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc54b190 0x55d1fc521f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc51e3d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/3202242988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc545d50 0x55d1fc56ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 -- 172.21.15.71:0/3202242988 >> 172.21.15.71:0/3202242988 conn(0x55d1fc518310 msgr2=0x55d1fc581620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 -- 172.21.15.71:0/3202242988 shutdown_connections 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.255+0000 7f0ad6140b80 1 -- 172.21.15.71:0/3202242988 wait complete. 2023-07-06T01:10:19.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.256+0000 7f0ad6140b80 1 -- start start 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.256+0000 7f0ad6140b80 1 Processor -- start 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc5cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc545d50 0x55d1fc5cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc51c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc54ba40 con 0x55d1fc520b50 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc544c20 con 0x55d1fc54b190 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1fc56b5e0 con 0x55d1fc545d50 2023-07-06T01:10:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0ad6140b80 10 client.0 _ll_register_callbacks cb 0x7f0ab40078a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.257+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc5cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc5cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57608/0 (socket says 172.21.15.71:57608) 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 -- 172.21.15.71:0/297367860 learned_addr learned my addr 172.21.15.71:0/297367860 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc545d50 0x55d1fc5cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0ac0d9c700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc51c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 -- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc545d50 msgr2=0x55d1fc5cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc545d50 0x55d1fc5cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 -- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 msgr2=0x55d1fc51c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc51c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 -- 172.21.15.71:0/297367860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1fc267790 con 0x55d1fc520b50 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0abbfff700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc5cbec0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0aac088c90 tx=0x7f0aac003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bda91ccc5d72c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0a9affd700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0a9affd700 1 -- 172.21.15.71:0/297367860 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac087040 con 0x55d1fc520b50 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0a9affd700 1 -- 172.21.15.71:0/297367860 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0aac05ab40 con 0x55d1fc520b50 2023-07-06T01:10:19.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1fc569d00 con 0x55d1fc520b50 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0a9affd700 1 -- 172.21.15.71:0/297367860 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aac055540 con 0x55d1fc520b50 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.258+0000 7f0ad6140b80 10 client.5346 fetch_fsmap learned FSMap version 16 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d1fc2c81d0 con 0x55d1fc520b50 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0a9affd700 1 -- 172.21.15.71:0/297367860 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1fc569d00 con 0x55d1fc520b50 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0a9affd700 1 -- 172.21.15.71:0/297367860 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0aac0556a0 con 0x55d1fc520b50 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 10 client.5346 fetch_fsmap finished waiting for FSMap version 16 2023-07-06T01:10:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 10 client.5346 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 20 client.5346 populate_metadata read hostname 'smithi071' 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc51cae0 0x55d1fc5d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 4 client.5346 mds_command: new command op to 5145 tid=0[{"prefix": "status"}] 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 --> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f0aac058c40 con 0x55d1fc51cae0 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc51cae0 0x55d1fc5d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0a9affd700 10 client.5346 ms_handle_connect on v2:172.21.15.71:6833/783929387 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.259+0000 7f0ab37fe700 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc51cae0 0x55d1fc5d21e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292d0d55f4da0dc server_cookie=97ff2e2484626b81 in_seq=0 out_seq=0 2023-07-06T01:10:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0a9affd700 1 -- 172.21.15.71:0/297367860 <== mds.0 v2:172.21.15.71:6833/783929387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x7f0aac058c40 con 0x55d1fc51cae0 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0a9affd700 10 client.5346 handle_command_reply: tid=0 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 client.5346 shutdown 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 msgr2=0x55d1fc5cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc5cbec0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0aac088c90 tx=0x7f0aac003f90 comp rx=0 tx=0).stop 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 shutdown_connections 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d1fc54b190 0x55d1fc51c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:6833/783929387,v1:172.21.15.71:6835/783929387] conn(0x55d1fc51cae0 0x55d1fc5d21e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d1fc520b50 0x55d1fc5cbec0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 --2- 172.21.15.71:0/297367860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55d1fc545d50 0x55d1fc5cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0a9affd700 0 client.5346 ms_handle_reset on v2:172.21.15.71:6833/783929387 2023-07-06T01:10:19.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 >> 172.21.15.71:0/297367860 conn(0x55d1fc518310 msgr2=0x55d1fc51e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 shutdown_connections 2023-07-06T01:10:19.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 1 -- 172.21.15.71:0/297367860 wait complete. 2023-07-06T01:10:19.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.260+0000 7f0ad6140b80 20 client.5346 trim_cache size 0 max 16384 2023-07-06T01:10:19.278 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "2e134b12-52b2-40d1-8145-7c2e3ab16f64", 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5145, 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 11.459992394, 2023-07-06T01:10:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 16, 2023-07-06T01:10:19.280 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 36, 2023-07-06T01:10:19.280 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 36, 2023-07-06T01:10:19.280 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 20.34249737 2023-07-06T01:10:19.280 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0a9c06ace0 msgr2=0x7f0a9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0a9c06ace0 0x7f0a9c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4001460 tx=0x7f0aa40017c0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 msgr2=0x7f0abc156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 0x7f0abc156db0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac004750 comp rx=0 tx=0).stop 2023-07-06T01:10:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 shutdown_connections 2023-07-06T01:10:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0a9c06ace0 0x7f0a9c06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0abc15fca0 0x7f0abc0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0abc0b5c90 0x7f0abc156db0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 --2- 172.21.15.71:0/576956993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0abc0b6100 0x7f0abc0cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 >> 172.21.15.71:0/576956993 conn(0x7f0abc06c150 msgr2=0x7f0abc0b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 shutdown_connections 2023-07-06T01:10:19.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.261+0000 7f0ac27ff700 1 -- 172.21.15.71:0/576956993 wait complete. 2023-07-06T01:10:19.284 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T01:10:19.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.475+0000 7f622edff700 1 Processor -- start 2023-07-06T01:10:19.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.475+0000 7f622edff700 1 -- start start 2023-07-06T01:10:19.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.476+0000 7f622edff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f622815fca0 0x7f62280d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.476+0000 7f622edff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280cf780 con 0x7f62280b6110 2023-07-06T01:10:19.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.476+0000 7f622edff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280cd490 con 0x7f62280b5c90 2023-07-06T01:10:19.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.476+0000 7f622edff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62280cd770 con 0x7f622815fca0 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.476+0000 7f622d39c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f62280b6110 0x7f62280cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58032/0 (socket says 172.21.15.71:58032) 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.476+0000 7f622d39c700 1 -- 172.21.15.71:0/2443448118 learned_addr learned my addr 172.21.15.71:0/2443448118 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f622cb9b700 1 --2- 172.21.15.71:0/2443448118 >> v2:172.21.15.194:3300/0 conn(0x7f622815fca0 0x7f62280d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700327885 0 0) 0x7f62280cf780 con 0x7f62280b6110 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62180035b0 con 0x7f62280b6110 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052466047 0 0) 0x7f62280cd490 con 0x7f62280b5c90 2023-07-06T01:10:19.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62280cf780 con 0x7f62280b5c90 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f622cb9b700 1 -- 172.21.15.71:0/2443448118 >> v1:172.21.15.194:6789/0 conn(0x7f62280b5c90 legacy=0x7f62280d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f622cb9b700 1 -- 172.21.15.71:0/2443448118 >> v1:172.21.15.71:6789/0 conn(0x7f62280b6110 legacy=0x7f62280cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f622cb9b700 1 -- 172.21.15.71:0/2443448118 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280cda50 con 0x7f622815fca0 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.477+0000 7f622cb9b700 1 --2- 172.21.15.71:0/2443448118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f622815fca0 0x7f62280d1420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f621c009840 tx=0x7f621c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92c3ce941f51d4de server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011830 con 0x7f622815fca0 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c011990 con 0x7f622815fca0 2023-07-06T01:10:19.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f62277fe700 1 -- 172.21.15.71:0/2443448118 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c011d20 con 0x7f622815fca0 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 -- 172.21.15.71:0/2443448118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f622815fca0 msgr2=0x7f62280d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 --2- 172.21.15.71:0/2443448118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f622815fca0 0x7f62280d1420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f621c009840 tx=0x7f621c009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 -- 172.21.15.71:0/2443448118 shutdown_connections 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 --2- 172.21.15.71:0/2443448118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f622815fca0 0x7f62280d1420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 -- 172.21.15.71:0/2443448118 >> 172.21.15.71:0/2443448118 conn(0x7f622806c150 msgr2=0x7f622806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 -- 172.21.15.71:0/2443448118 shutdown_connections 2023-07-06T01:10:19.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.478+0000 7f622edff700 1 -- 172.21.15.71:0/2443448118 wait complete. 2023-07-06T01:10:19.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.480+0000 7f622edff700 1 Processor -- start 2023-07-06T01:10:19.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.480+0000 7f622edff700 1 -- start start 2023-07-06T01:10:19.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622edff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62280b5c90 0x7f62280c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622edff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62280b6110 0x7f62280b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622edff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 0x7f62280b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622edff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280c85f0 con 0x7f622815fca0 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622edff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280c9820 con 0x7f62280b6110 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622edff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62280c6e20 con 0x7f62280b5c90 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.481+0000 7f622d39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 0x7f62280b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 0x7f62280b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57622/0 (socket says 172.21.15.71:57622) 2023-07-06T01:10:19.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 -- 172.21.15.71:0/432549605 learned_addr learned my addr 172.21.15.71:0/432549605 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622cb9b700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62280b5c90 0x7f62280c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f6227fff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62280b6110 0x7f62280b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 -- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62280b5c90 msgr2=0x7f62280c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62280b5c90 0x7f62280c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 -- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62280b6110 msgr2=0x7f62280b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62280b6110 0x7f62280b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 -- 172.21.15.71:0/432549605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0094a0 con 0x7f622815fca0 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622cb9b700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62280b5c90 0x7f62280c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622d39c700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 0x7f62280b32f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f622000cba0 tx=0x7f622000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622000ab20 con 0x7f622815fca0 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622000ac80 con 0x7f622815fca0 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220012400 con 0x7f622815fca0 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.482+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62280c8800 con 0x7f622815fca0 2023-07-06T01:10:19.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.483+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62280c8dc0 con 0x7f622815fca0 2023-07-06T01:10:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.484+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62280008d0 con 0x7f622815fca0 2023-07-06T01:10:19.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.485+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f622001b3b0 con 0x7f622815fca0 2023-07-06T01:10:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.486+0000 7f62257fa700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f620c06ace0 0x7f620c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.486+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f62200892d0 con 0x7f622815fca0 2023-07-06T01:10:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.486+0000 7f622cb9b700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f620c06ace0 0x7f620c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:19.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.487+0000 7f622cb9b700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f620c06ace0 0x7f620c06d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f621c009fd0 tx=0x7f621c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:19.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.490+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6220057e10 con 0x7f622815fca0 2023-07-06T01:10:19.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.730+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f622806a850 con 0x7f622815fca0 2023-07-06T01:10:19.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.731+0000 7f62257fa700 1 -- 172.21.15.71:0/432549605 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f62200579a0 con 0x7f622815fca0 2023-07-06T01:10:19.734 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T01:10:19.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f620c06ace0 msgr2=0x7f620c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f620c06ace0 0x7f620c06d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f621c009fd0 tx=0x7f621c01c040 comp rx=0 tx=0).stop 2023-07-06T01:10:19.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 msgr2=0x7f62280b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:19.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 0x7f62280b32f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f622000cba0 tx=0x7f622000cf60 comp rx=0 tx=0).stop 2023-07-06T01:10:19.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 shutdown_connections 2023-07-06T01:10:19.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f620c06ace0 0x7f620c06d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f622815fca0 0x7f62280b32f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62280b5c90 0x7f62280c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 --2- 172.21.15.71:0/432549605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f62280b6110 0x7f62280b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:19.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 >> 172.21.15.71:0/432549605 conn(0x7f622806c150 msgr2=0x7f622815eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:19.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 shutdown_connections 2023-07-06T01:10:19.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:19.733+0000 7f622edff700 1 -- 172.21.15.71:0/432549605 wait complete. 2023-07-06T01:10:19.753 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T01:10:19.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T01:10:19.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-07-06T01:10:19.754 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T01:10:19.755 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T01:10:19.755 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T01:10:19.755 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T01:10:19.755 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T01:10:19.756 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T01:10:19.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:19.756 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-07-06T01:10:19.803 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:10:19.803 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:10:19.803 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-07-06T01:10:19.804 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-06T01:10:19.805 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42267sec preferred_lft 42267sec 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 2a:3c:e1:3a:cf:46 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b402:9aff:fe8a:d248/64 scope link 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 2a:3c:e1:3a:cf:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::283c:e1ff:fe3a:cf46/64 scope link 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether c2:d7:61:2d:56:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T01:10:19.807 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::c0d7:61ff:fe2d:563e/64 scope link 2023-07-06T01:10:19.808 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:19.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:19.809 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T01:10:19.915 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-07-06T01:10:19.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:19.918 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-07-06T01:10:19.966 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-07-06T01:10:19.967 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T01:10:19.967 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T01:10:19.967 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T01:10:19.967 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T01:10:19.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:19.969 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-07-06T01:10:19.969 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-07-06T01:10:19.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T01:10:19.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T01:10:19.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T01:10:19.971 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-07-06T01:10:20.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:20.138 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:10:20.184 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T01:10:20.184 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T01:10:20.185 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T01:10:20.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:20.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-07-06T01:10:20.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:10:20.294 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T01:10:20.338 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T01:10:20.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:10:20.339 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T01:10:20.424 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-07-06T01:10:20.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:20.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:10:20.568 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:10:20.569 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:10:20.595 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:10:20.595 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:10:20.596 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.194:3300,172.21.15.194:3301" 2023-07-06T01:10:20.596 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 0@2e134b12-52b2-40d1-8145-7c2e3ab16f64.cephfs=/ 2023-07-06T01:10:20.596 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.71:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2023-07-06T01:10:20.601 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T01:10:20.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:20.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T01:10:20.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:20.673 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:10:20.774 INFO:teuthology.orchestra.run.smithi071.stdout:client5355 2023-07-06T01:10:20.774 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:10:20.775 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:20.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T01:10:21.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.053+0000 7fd7ff9ff700 1 Processor -- start 2023-07-06T01:10:21.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.053+0000 7fd7ff9ff700 1 -- start start 2023-07-06T01:10:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7ff9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd7f815fca0 0x7fd7f80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:21.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7ff9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd7f80b6110 0x7fd7f80cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7ff9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80cf780 con 0x7fd7f80b5c90 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7ff9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80cd490 con 0x7fd7f80b6110 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7ff9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80cd770 con 0x7fd7f815fca0 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd7f80b6110 0x7fd7f80cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd7f80b6110 0x7fd7f80cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57632/0 (socket says 172.21.15.71:57632) 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/907077772 learned_addr learned my addr 172.21.15.71:0/907077772 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:21.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fd79b700 1 --2- 172.21.15.71:0/907077772 >> v2:172.21.15.194:3300/0 conn(0x7fd7f815fca0 0x7fd7f80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/907077772 >> v2:172.21.15.194:3300/0 conn(0x7fd7f815fca0 msgr2=0x7fd7f80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 --2- 172.21.15.71:0/907077772 >> v2:172.21.15.194:3300/0 conn(0x7fd7f815fca0 0x7fd7f80d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/907077772 >> v1:172.21.15.194:6789/0 conn(0x7fd7f80b5c90 legacy=0x7fd7f80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/907077772 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80cda50 con 0x7fd7f80b6110 2023-07-06T01:10:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.055+0000 7fd7fd79b700 1 --2- 172.21.15.71:0/907077772 >> v2:172.21.15.194:3300/0 conn(0x7fd7f815fca0 0x7fd7f80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:21.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7fdf9c700 1 --2- 172.21.15.71:0/907077772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cfc10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80d0930 tx=0x7fd7f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d3133773db56b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7effff700 1 -- 172.21.15.71:0/907077772 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000e070 con 0x7fd7f80b6110 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7effff700 1 -- 172.21.15.71:0/907077772 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000b9c0 con 0x7fd7f80b6110 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7effff700 1 -- 172.21.15.71:0/907077772 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000bd70 con 0x7fd7f80b6110 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/907077772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f80b6110 msgr2=0x7fd7f80cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/907077772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cfc10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80d0930 tx=0x7fd7f000b330 comp rx=0 tx=0).stop 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/907077772 shutdown_connections 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.056+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/907077772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cfc10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.057+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/907077772 >> v2:172.21.15.194:3300/0 conn(0x7fd7f815fca0 0x7fd7f80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.057+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/907077772 >> 172.21.15.71:0/907077772 conn(0x7fd7f806c150 msgr2=0x7fd7f806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:21.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.057+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/907077772 shutdown_connections 2023-07-06T01:10:21.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.057+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/907077772 wait complete. 2023-07-06T01:10:21.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.059+0000 7fd7ff9ff700 1 Processor -- start 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.059+0000 7fd7ff9ff700 1 -- start start 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.060+0000 7fd7ff9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f80b5c90 0x7fd7f81e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.060+0000 7fd7ff9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.060+0000 7fd7ff9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 0x7fd7f80cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.060+0000 7fd7ff9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8145ce0 con 0x7fd7f815fca0 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.060+0000 7fd7ff9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8148b80 con 0x7fd7f80b6110 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.060+0000 7fd7ff9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8145f80 con 0x7fd7f80b5c90 2023-07-06T01:10:21.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 0x7fd7f80cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 0x7fd7f80cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57640/0 (socket says 172.21.15.71:57640) 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/3413507686 learned_addr learned my addr 172.21.15.71:0/3413507686 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fd79b700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f80b5c90 0x7fd7f81e65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fcf9a700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f80b5c90 msgr2=0x7fd7f81e65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f80b5c90 0x7fd7f81e65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f80b6110 msgr2=0x7fd7f80cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 -- 172.21.15.71:0/3413507686 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009b30 con 0x7fd7f815fca0 2023-07-06T01:10:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fd79b700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f80b5c90 0x7fd7f81e65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fcf9a700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:21.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7fdf9c700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 0x7fd7f80cba40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd7f806d0f0 tx=0x7fd7f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.061+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00099b0 con 0x7fd7f815fca0 2023-07-06T01:10:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.062+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f00092e0 con 0x7fd7f815fca0 2023-07-06T01:10:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.062+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8146260 con 0x7fd7f815fca0 2023-07-06T01:10:21.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.062+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f001c640 con 0x7fd7f815fca0 2023-07-06T01:10:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.062+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f80c6930 con 0x7fd7f815fca0 2023-07-06T01:10:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.063+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f8146720 con 0x7fd7f815fca0 2023-07-06T01:10:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.064+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7f001c7a0 con 0x7fd7f815fca0 2023-07-06T01:10:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.064+0000 7fd7edffb700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd7dc06ace0 0x7fd7dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:21.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.065+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7f008aec0 con 0x7fd7f815fca0 2023-07-06T01:10:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.065+0000 7fd7fd79b700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd7dc06ace0 0x7fd7dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:21.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.066+0000 7fd7fd79b700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd7dc06ace0 0x7fd7dc06d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400c960 tx=0x7fd7f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:21.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.069+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd7f0055f60 con 0x7fd7f815fca0 2023-07-06T01:10:21.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.307+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7f80008d0 con 0x7fd7f815fca0 2023-07-06T01:10:21.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.308+0000 7fd7edffb700 1 -- 172.21.15.71:0/3413507686 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd7f0059580 con 0x7fd7f815fca0 2023-07-06T01:10:21.311 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T01:10:21.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.310+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd7dc06ace0 msgr2=0x7fd7dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:21.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.310+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd7dc06ace0 0x7fd7dc06d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400c960 tx=0x7fd7f4008040 comp rx=0 tx=0).stop 2023-07-06T01:10:21.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.310+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 msgr2=0x7fd7f80cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:21.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.310+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 0x7fd7f80cba40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd7f806d0f0 tx=0x7fd7f0004ad0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 shutdown_connections 2023-07-06T01:10:21.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd7dc06ace0 0x7fd7dc06d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7f815fca0 0x7fd7f80cba40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7f80b5c90 0x7fd7f81e65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 --2- 172.21.15.71:0/3413507686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7f80b6110 0x7fd7f80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:21.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 >> 172.21.15.71:0/3413507686 conn(0x7fd7f806c150 msgr2=0x7fd7f80d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:21.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 shutdown_connections 2023-07-06T01:10:21.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:21.311+0000 7fd7ff9ff700 1 -- 172.21.15.71:0/3413507686 wait complete. 2023-07-06T01:10:21.331 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T01:10:21.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T01:10:21.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2023-07-06T01:10:21.332 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-06T01:10:21.332 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T01:10:21.332 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T01:10:21.332 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T01:10:21.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T01:10:21.333 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-06T01:10:21.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.334 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2023-07-06T01:10:21.386 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T01:10:21.387 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T01:10:21.387 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T01:10:21.387 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.388 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-07-06T01:10:21.388 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.388 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:10:21.389 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:21.389 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2023-07-06T01:10:21.389 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:10:21.390 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:21.390 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2023-07-06T01:10:21.390 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T01:10:21.390 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:21.391 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T01:10:21.391 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:21.391 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-06T01:10:21.392 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-07-06T01:10:21.392 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2023-07-06T01:10:21.392 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.392 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T01:10:21.392 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether ca:ce:bb:15:22:7a brd ff:ff:ff:ff:ff:ff 2023-07-06T01:10:21.393 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T01:10:21.393 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.393 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::800b:b3ff:fe17:e97d/64 scope link 2023-07-06T01:10:21.393 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.394 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T01:10:21.394 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether f6:1f:d1:ee:89:d6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T01:10:21.394 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::f41f:d1ff:feee:89d6/64 scope link 2023-07-06T01:10:21.394 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.395 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T01:10:21.395 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether ca:ce:bb:15:22:7a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T01:10:21.395 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::c8ce:bbff:fe15:227a/64 scope link 2023-07-06T01:10:21.395 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-07-06T01:10:21.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.396 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T01:10:21.467 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-07-06T01:10:21.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.471 DEBUG:teuthology.orchestra.run.smithi194:> route 2023-07-06T01:10:21.520 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2023-07-06T01:10:21.520 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T01:10:21.520 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-06T01:10:21.520 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-06T01:10:21.521 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T01:10:21.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.522 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-07-06T01:10:21.523 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-07-06T01:10:21.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-06T01:10:21.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-06T01:10:21.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-06T01:10:21.526 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-07-06T01:10:21.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.695 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:10:21.739 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-06T01:10:21.740 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T01:10:21.741 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-06T01:10:21.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.741 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2023-07-06T01:10:21.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:10:21.851 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-06T01:10:21.896 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-06T01:10:21.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T01:10:21.897 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-06T01:10:21.980 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-07-06T01:10:21.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:21.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:10:22.124 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:10:22.124 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:10:22.151 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-07-06T01:10:22.151 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-07-06T01:10:22.152 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.71:3300,172.21.15.194:3300,172.21.15.194:3301" 2023-07-06T01:10:22.152 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@2e134b12-52b2-40d1-8145-7c2e3ab16f64.cephfs=/ 2023-07-06T01:10:22.152 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.71:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2023-07-06T01:10:22.156 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T01:10:22.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:22.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-06T01:10:22.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:22.226 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T01:10:22.312 INFO:teuthology.orchestra.run.smithi194.stdout:client5364 2023-07-06T01:10:22.313 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:10:22.313 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:22.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:22.360 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-07-06T01:10:22.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:22.417 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir) 2023-07-06T01:10:22.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:22.467 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2023-07-06T01:10:22.512 INFO:teuthology.orchestra.run.smithi071.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2023-07-06T01:10:22.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:10:22.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:22.514 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir) 2023-07-06T01:10:22.600 INFO:teuthology.orchestra.run.smithi071.stderr:setfattr: ./subdir: Invalid argument 2023-07-06T01:10:22.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:10:22.602 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T01:10:22.603 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T01:10:22.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T01:10:22.846 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T01:10:22.846 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:10:22.846 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:22.892 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:10:22.893 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:22.977 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:23.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.207+0000 7f4305dff700 1 Processor -- start 2023-07-06T01:10:23.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.207+0000 7f4305dff700 1 -- start start 2023-07-06T01:10:23.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f4305dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43000b0440 0x7f4300143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f4305dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015df60 0x7f43000b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f4305dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43001441f0 con 0x7f430015b0e0 2023-07-06T01:10:23.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f4305dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430015a930 con 0x7f43000b0440 2023-07-06T01:10:23.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f4305dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430015e3b0 con 0x7f430015df60 2023-07-06T01:10:23.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f42ff7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f43000b0440 0x7f4300143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f42fffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f430015b0e0 0x7f4300070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45884/0 (socket says 172.21.15.71:45884) 2023-07-06T01:10:23.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f42fffff700 1 -- 172.21.15.71:0/3466493440 learned_addr learned my addr 172.21.15.71:0/3466493440 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:23.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.208+0000 7f42f7fff700 1 --2- 172.21.15.71:0/3466493440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015df60 0x7f43000b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42feffd700 1 -- 172.21.15.71:0/3466493440 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536357283 0 0) 0x7f43001441f0 con 0x7f430015b0e0 2023-07-06T01:10:23.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42feffd700 1 -- 172.21.15.71:0/3466493440 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ec0035b0 con 0x7f430015b0e0 2023-07-06T01:10:23.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42ff7fe700 1 -- 172.21.15.71:0/3466493440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015df60 msgr2=0x7f43000b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42ff7fe700 1 --2- 172.21.15.71:0/3466493440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015df60 0x7f43000b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42ff7fe700 1 -- 172.21.15.71:0/3466493440 >> v1:172.21.15.71:6789/0 conn(0x7f430015b0e0 legacy=0x7f4300070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42ff7fe700 1 -- 172.21.15.71:0/3466493440 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000b0d50 con 0x7f43000b0440 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42ff7fe700 1 --2- 172.21.15.71:0/3466493440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43000b0440 0x7f4300143900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009840 tx=0x7f42f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d99eaf2f1dbd59 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42feffd700 1 -- 172.21.15.71:0/3466493440 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0011830 con 0x7f43000b0440 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42feffd700 1 -- 172.21.15.71:0/3466493440 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0011990 con 0x7f43000b0440 2023-07-06T01:10:23.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.209+0000 7f42feffd700 1 -- 172.21.15.71:0/3466493440 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0011d20 con 0x7f43000b0440 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 -- 172.21.15.71:0/3466493440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43000b0440 msgr2=0x7f4300143900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 --2- 172.21.15.71:0/3466493440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43000b0440 0x7f4300143900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009840 tx=0x7f42f0009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 -- 172.21.15.71:0/3466493440 shutdown_connections 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 --2- 172.21.15.71:0/3466493440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43000b0440 0x7f4300143900 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 --2- 172.21.15.71:0/3466493440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015df60 0x7f43000b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 -- 172.21.15.71:0/3466493440 >> 172.21.15.71:0/3466493440 conn(0x7f43000cb440 msgr2=0x7f43000cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 -- 172.21.15.71:0/3466493440 shutdown_connections 2023-07-06T01:10:23.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.210+0000 7f4305dff700 1 -- 172.21.15.71:0/3466493440 wait complete. 2023-07-06T01:10:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.212+0000 7f4305dff700 1 Processor -- start 2023-07-06T01:10:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.212+0000 7f4305dff700 1 -- start start 2023-07-06T01:10:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f4305dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43000b0440 0x7f4300157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f4305dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015b0e0 0x7f43000a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f4305dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 0x7f430006c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f4305dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43000ab2a0 con 0x7f430015df60 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f4305dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43000a9b40 con 0x7f43000b0440 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f4305dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43000a8f30 con 0x7f430015b0e0 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f42fffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 0x7f430006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f42fffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 0x7f430006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55050/0 (socket says 172.21.15.71:55050) 2023-07-06T01:10:23.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f42fffff700 1 -- 172.21.15.71:0/2757560676 learned_addr learned my addr 172.21.15.71:0/2757560676 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f42f7fff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015b0e0 0x7f43000a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.213+0000 7f42ff7fe700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43000b0440 0x7f4300157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fffff700 1 -- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015b0e0 msgr2=0x7f43000a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fffff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015b0e0 0x7f43000a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fffff700 1 -- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43000b0440 msgr2=0x7f4300157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fffff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43000b0440 0x7f4300157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fffff700 1 -- 172.21.15.71:0/2757560676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00094a0 con 0x7f430015df60 2023-07-06T01:10:23.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fffff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 0x7f430006c270 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f42f800caa0 tx=0x7f42f800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800a9e0 con 0x7f430015df60 2023-07-06T01:10:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f800ab40 con 0x7f430015df60 2023-07-06T01:10:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8012400 con 0x7f430015df60 2023-07-06T01:10:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43000a9210 con 0x7f430015df60 2023-07-06T01:10:23.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.214+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43000a97d0 con 0x7f430015df60 2023-07-06T01:10:23.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.215+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430006fa50 con 0x7f430015df60 2023-07-06T01:10:23.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.216+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42f801b3b0 con 0x7f430015df60 2023-07-06T01:10:23.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.217+0000 7f42fcff9700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42e006ace0 0x7f42e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.217+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42f8089180 con 0x7f430015df60 2023-07-06T01:10:23.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.217+0000 7f42ff7fe700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42e006ace0 0x7f42e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.218+0000 7f42ff7fe700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42e006ace0 0x7f42e006d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:23.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.221+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42f80541c0 con 0x7f430015df60 2023-07-06T01:10:23.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.415+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43000b1400 con 0x7f430015df60 2023-07-06T01:10:23.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.416+0000 7f42fcff9700 1 -- 172.21.15.71:0/2757560676 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f42f80577e0 con 0x7f430015df60 2023-07-06T01:10:23.419 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:23.419 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":36,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:08.799855+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:23.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42e006ace0 msgr2=0x7f42e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42e006ace0 0x7f42e006d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f001c040 comp rx=0 tx=0).stop 2023-07-06T01:10:23.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 msgr2=0x7f430006c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 0x7f430006c270 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f42f800caa0 tx=0x7f42f800cdb0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 shutdown_connections 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f42e006ace0 0x7f42e006d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f430015df60 0x7f430006c270 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43000b0440 0x7f4300157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 --2- 172.21.15.71:0/2757560676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f430015b0e0 0x7f43000a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 >> 172.21.15.71:0/2757560676 conn(0x7f43000cb440 msgr2=0x7f43000ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 shutdown_connections 2023-07-06T01:10:23.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.418+0000 7f4305dff700 1 -- 172.21.15.71:0/2757560676 wait complete. 2023-07-06T01:10:23.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:10:05.447038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:10:06.255735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:10:23.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:10:23.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.637+0000 7febb03ff700 1 Processor -- start 2023-07-06T01:10:23.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.638+0000 7febb03ff700 1 -- start start 2023-07-06T01:10:23.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febb03ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feba815fca0 0x7feba80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febb03ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feba80b5c90 0x7feba80d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febb03ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80cf780 con 0x7feba80b6110 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febb03ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80cd490 con 0x7feba80b5c90 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febb03ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80cd770 con 0x7feba815fca0 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febae99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feba80b6110 0x7feba80cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45888/0 (socket says 172.21.15.71:45888) 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febae99c700 1 -- 172.21.15.71:0/3935482237 learned_addr learned my addr 172.21.15.71:0/3935482237 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:23.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febae19b700 1 --2- 172.21.15.71:0/3935482237 >> v2:172.21.15.194:3300/0 conn(0x7feba815fca0 0x7feba80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febad99a700 1 --2- 172.21.15.71:0/3935482237 >> v2:172.21.15.71:3300/0 conn(0x7feba80b5c90 0x7feba80d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.639+0000 7febad199700 1 -- 172.21.15.71:0/3935482237 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846090128 0 0) 0x7feba80cf780 con 0x7feba80b6110 2023-07-06T01:10:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad199700 1 -- 172.21.15.71:0/3935482237 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb940035b0 con 0x7feba80b6110 2023-07-06T01:10:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad99a700 1 -- 172.21.15.71:0/3935482237 >> v2:172.21.15.194:3300/0 conn(0x7feba815fca0 msgr2=0x7feba80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad99a700 1 --2- 172.21.15.71:0/3935482237 >> v2:172.21.15.194:3300/0 conn(0x7feba815fca0 0x7feba80d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad99a700 1 -- 172.21.15.71:0/3935482237 >> v1:172.21.15.71:6789/0 conn(0x7feba80b6110 legacy=0x7feba80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad99a700 1 -- 172.21.15.71:0/3935482237 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80cda50 con 0x7feba80b5c90 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febae19b700 1 --2- 172.21.15.71:0/3935482237 >> v2:172.21.15.194:3300/0 conn(0x7feba815fca0 0x7feba80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad99a700 1 --2- 172.21.15.71:0/3935482237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80d2d40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feba80d0930 tx=0x7feb98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb9becefa55c603 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad199700 1 -- 172.21.15.71:0/3935482237 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98011830 con 0x7feba80b5c90 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad199700 1 -- 172.21.15.71:0/3935482237 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb98011990 con 0x7feba80b5c90 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.640+0000 7febad199700 1 -- 172.21.15.71:0/3935482237 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98011d20 con 0x7feba80b5c90 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 -- 172.21.15.71:0/3935482237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 msgr2=0x7feba80d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 --2- 172.21.15.71:0/3935482237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80d2d40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feba80d0930 tx=0x7feb98009b20 comp rx=0 tx=0).stop 2023-07-06T01:10:23.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 -- 172.21.15.71:0/3935482237 shutdown_connections 2023-07-06T01:10:23.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 --2- 172.21.15.71:0/3935482237 >> v2:172.21.15.194:3300/0 conn(0x7feba815fca0 0x7feba80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 --2- 172.21.15.71:0/3935482237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80d2d40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 -- 172.21.15.71:0/3935482237 >> 172.21.15.71:0/3935482237 conn(0x7feba806c150 msgr2=0x7feba806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:23.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 -- 172.21.15.71:0/3935482237 shutdown_connections 2023-07-06T01:10:23.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.641+0000 7febb03ff700 1 -- 172.21.15.71:0/3935482237 wait complete. 2023-07-06T01:10:23.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.642+0000 7febb03ff700 1 Processor -- start 2023-07-06T01:10:23.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.643+0000 7febb03ff700 1 -- start start 2023-07-06T01:10:23.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.643+0000 7febb03ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febb03ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba80b6110 0x7feba8149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febb03ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815fca0 0x7feba80cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febb03ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cb0b0 con 0x7feba80b5c90 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febb03ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba8149880 con 0x7feba80b6110 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febb03ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80ccb90 con 0x7feba815fca0 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55074/0 (socket says 172.21.15.71:55074) 2023-07-06T01:10:23.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 -- 172.21.15.71:0/343779641 learned_addr learned my addr 172.21.15.71:0/343779641 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febad99a700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba80b6110 0x7feba8149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae99c700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815fca0 0x7feba80cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 -- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815fca0 msgr2=0x7feba80cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815fca0 0x7feba80cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 -- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba80b6110 msgr2=0x7feba8149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba80b6110 0x7feba8149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 -- 172.21.15.71:0/343779641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40094a0 con 0x7feba80b5c90 2023-07-06T01:10:23.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae99c700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815fca0 0x7feba80cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.644+0000 7febae19b700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80c9f10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feba400ebe0 tx=0x7feba400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.645+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400c850 con 0x7feba80b5c90 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.645+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba400c9b0 con 0x7feba80b5c90 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.645+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400cd40 con 0x7feba80b5c90 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.645+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb980094a0 con 0x7feba80b5c90 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.645+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80ca810 con 0x7feba80b5c90 2023-07-06T01:10:23.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.646+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba80008d0 con 0x7feba80b5c90 2023-07-06T01:10:23.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.647+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feba4013470 con 0x7feba80b5c90 2023-07-06T01:10:23.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.648+0000 7feb9effd700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8c06ace0 0x7feb8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:23.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.648+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feba40895b0 con 0x7feba80b5c90 2023-07-06T01:10:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.648+0000 7febad99a700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8c06ace0 0x7feb8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:23.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.649+0000 7febad99a700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8c06ace0 0x7feb8c06d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb980090b0 tx=0x7feb98008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:23.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.652+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feba40545c0 con 0x7feba80b5c90 2023-07-06T01:10:23.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.851+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feba80c6910 con 0x7feba80b5c90 2023-07-06T01:10:23.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.852+0000 7feb9effd700 1 -- 172.21.15.71:0/343779641 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7feba400cea0 con 0x7feba80b5c90 2023-07-06T01:10:23.855 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:10:23.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8c06ace0 msgr2=0x7feb8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8c06ace0 0x7feb8c06d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feb980090b0 tx=0x7feb98008030 comp rx=0 tx=0).stop 2023-07-06T01:10:23.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 msgr2=0x7feba80c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:23.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80c9f10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feba400ebe0 tx=0x7feba400eef0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 shutdown_connections 2023-07-06T01:10:23.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8c06ace0 0x7feb8c06d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815fca0 0x7feba80cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba80b5c90 0x7feba80c9f10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 --2- 172.21.15.71:0/343779641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba80b6110 0x7feba8149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 >> 172.21.15.71:0/343779641 conn(0x7feba806c150 msgr2=0x7feba80d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 shutdown_connections 2023-07-06T01:10:23.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:23.854+0000 7febb03ff700 1 -- 172.21.15.71:0/343779641 wait complete. 2023-07-06T01:10:23.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:10:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.069+0000 7f9ea07ff700 1 Processor -- start 2023-07-06T01:10:24.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.070+0000 7f9ea07ff700 1 -- start start 2023-07-06T01:10:24.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9ea07ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e9815fca0 0x7f9e980d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9ea07ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e980b5c90 0x7f9e980d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9ea07ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e980cf780 con 0x7f9e980b6100 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9ea07ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980cd490 con 0x7f9e980b5c90 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9ea07ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980cd770 con 0x7f9e9815fca0 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e980b5c90 0x7f9e980d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9dd9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9e980b5c90 0x7f9e980d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55078/0 (socket says 172.21.15.71:55078) 2023-07-06T01:10:24.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9dd9a700 1 -- 172.21.15.71:0/1185352493 learned_addr learned my addr 172.21.15.71:0/1185352493 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:24.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9e59b700 1 --2- 172.21.15.71:0/1185352493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e9815fca0 0x7f9e980d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9dd9a700 1 -- 172.21.15.71:0/1185352493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e9815fca0 msgr2=0x7f9e980d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9dd9a700 1 --2- 172.21.15.71:0/1185352493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e9815fca0 0x7f9e980d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.071+0000 7f9e9dd9a700 1 -- 172.21.15.71:0/1185352493 >> v1:172.21.15.194:6789/0 conn(0x7f9e980b6100 legacy=0x7f9e980cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.072+0000 7f9e9dd9a700 1 -- 172.21.15.71:0/1185352493 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980cda50 con 0x7f9e980b5c90 2023-07-06T01:10:24.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.072+0000 7f9e9dd9a700 1 --2- 172.21.15.71:0/1185352493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e980b5c90 0x7f9e980d2d40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9e880098f0 tx=0x7f9e88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254740c4bcbdefd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.072+0000 7f9e9d599700 1 -- 172.21.15.71:0/1185352493 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800b8a0 con 0x7f9e980b5c90 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.072+0000 7f9e9d599700 1 -- 172.21.15.71:0/1185352493 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8800ba00 con 0x7f9e980b5c90 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.072+0000 7f9e9d599700 1 -- 172.21.15.71:0/1185352493 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8800bd90 con 0x7f9e980b5c90 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 -- 172.21.15.71:0/1185352493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e980b5c90 msgr2=0x7f9e980d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/1185352493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e980b5c90 0x7f9e980d2d40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9e880098f0 tx=0x7f9e88009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 -- 172.21.15.71:0/1185352493 shutdown_connections 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/1185352493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e9815fca0 0x7f9e980d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/1185352493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e980b5c90 0x7f9e980d2d40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 -- 172.21.15.71:0/1185352493 >> 172.21.15.71:0/1185352493 conn(0x7f9e9806c150 msgr2=0x7f9e9806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:24.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 -- 172.21.15.71:0/1185352493 shutdown_connections 2023-07-06T01:10:24.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.073+0000 7f9ea07ff700 1 -- 172.21.15.71:0/1185352493 wait complete. 2023-07-06T01:10:24.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.074+0000 7f9ea07ff700 1 Processor -- start 2023-07-06T01:10:24.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.075+0000 7f9ea07ff700 1 -- start start 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9ea07ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e980b5c90 0x7f9e9814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9ea07ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e980b6100 0x7f9e980b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9ea07ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 0x7f9e980d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9ea07ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9814c820 con 0x7f9e9815fca0 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9ea07ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9815c4a0 con 0x7f9e980b5c90 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9ea07ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9815c740 con 0x7f9e980b6100 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 0x7f9e980d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 0x7f9e980d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55094/0 (socket says 172.21.15.71:55094) 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 -- 172.21.15.71:0/277591412 learned_addr learned my addr 172.21.15.71:0/277591412 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9e59b700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e980b5c90 0x7f9e9814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9dd9a700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e980b6100 0x7f9e980b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 -- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e980b6100 msgr2=0x7f9e980b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e980b6100 0x7f9e980b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 -- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e980b5c90 msgr2=0x7f9e9814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e980b5c90 0x7f9e9814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.076+0000 7f9e9ed9c700 1 -- 172.21.15.71:0/277591412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88009550 con 0x7f9e9815fca0 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.077+0000 7f9e9ed9c700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 0x7f9e980d2bb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000cbc0 tx=0x7f9e9000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.077+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90003c00 con 0x7f9e9815fca0 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.077+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90003d60 con 0x7f9e9815fca0 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.077+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000aae0 con 0x7f9e9815fca0 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.077+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9815ca20 con 0x7f9e9815fca0 2023-07-06T01:10:24.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.077+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9815cfe0 con 0x7f9e9815fca0 2023-07-06T01:10:24.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.078+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9815d1d0 con 0x7f9e9815fca0 2023-07-06T01:10:24.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.079+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e9000ac40 con 0x7f9e9815fca0 2023-07-06T01:10:24.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.080+0000 7f9e8effd700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e7c06ace0 0x7f9e7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.080+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e900894d0 con 0x7f9e9815fca0 2023-07-06T01:10:24.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.080+0000 7f9e9e59b700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e7c06ace0 0x7f9e7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.081+0000 7f9e9e59b700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e7c06ace0 0x7f9e7c06d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e94006b20 tx=0x7f9e94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.084+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9e900544e0 con 0x7f9e9815fca0 2023-07-06T01:10:24.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.277+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e980008d0 con 0x7f9e9815fca0 2023-07-06T01:10:24.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.277+0000 7f9e8effd700 1 -- 172.21.15.71:0/277591412 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e90057b00 con 0x7f9e9815fca0 2023-07-06T01:10:24.281 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:10:24.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.279+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e7c06ace0 msgr2=0x7f9e7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e7c06ace0 0x7f9e7c06d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e94006b20 tx=0x7f9e94008040 comp rx=0 tx=0).stop 2023-07-06T01:10:24.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 msgr2=0x7f9e980d2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 0x7f9e980d2bb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000cbc0 tx=0x7f9e9000ced0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 shutdown_connections 2023-07-06T01:10:24.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9e7c06ace0 0x7f9e7c06d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9815fca0 0x7f9e980d2bb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e980b5c90 0x7f9e9814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 --2- 172.21.15.71:0/277591412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e980b6100 0x7f9e980b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 >> 172.21.15.71:0/277591412 conn(0x7f9e9806c150 msgr2=0x7f9e980b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:24.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 shutdown_connections 2023-07-06T01:10:24.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.280+0000 7f9ea07ff700 1 -- 172.21.15.71:0/277591412 wait complete. 2023-07-06T01:10:24.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:10:24.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.495+0000 7f63bb3ff700 1 Processor -- start 2023-07-06T01:10:24.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.495+0000 7f63bb3ff700 1 -- start start 2023-07-06T01:10:24.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.496+0000 7f63bb3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 0x7f63b40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.496+0000 7f63bb3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40cf780 con 0x7f63b415fca0 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.496+0000 7f63bb3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40cd490 con 0x7f63b40b60e0 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.496+0000 7f63bb3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40cd770 con 0x7f63b40b5c90 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63b919b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f63b415fca0 0x7f63b40d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45890/0 (socket says 172.21.15.71:45890) 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63b919b700 1 -- 172.21.15.71:0/3674213522 learned_addr learned my addr 172.21.15.71:0/3674213522 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63b899a700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 0x7f63b40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357641393 0 0) 0x7f63b40cf780 con 0x7f63b415fca0 2023-07-06T01:10:24.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a00035b0 con 0x7f63b415fca0 2023-07-06T01:10:24.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133489620 0 0) 0x7f63a00035b0 con 0x7f63b415fca0 2023-07-06T01:10:24.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 msgr2=0x7f63b40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 0x7f63b40d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 >> v1:172.21.15.194:6789/0 conn(0x7f63b40b60e0 legacy=0x7f63b40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40cda50 con 0x7f63b415fca0 2023-07-06T01:10:24.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f63b0001670 con 0x7f63b415fca0 2023-07-06T01:10:24.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.497+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 >> v1:172.21.15.71:6789/0 conn(0x7f63b415fca0 legacy=0x7f63b40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63abfff700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a0003a30 0x7f63a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63abfff700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 0x7f63a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63abfff700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0004d90 0x7f63a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40cd770 con 0x7f63a0004d90 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a000bb20 con 0x7f63a0003a30 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a000bce0 con 0x7f63b40b5c90 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b999c700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0004d90 0x7f63a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b899a700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 0x7f63a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b919b700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a0003a30 0x7f63a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b999c700 1 -- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 msgr2=0x7f63a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b999c700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63b40b5c90 0x7f63a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b999c700 1 -- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a0003a30 msgr2=0x7f63a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b999c700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63a0003a30 0x7f63a0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.498+0000 7f63b999c700 1 -- 172.21.15.71:0/3674213522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00035b0 con 0x7f63a0004d90 2023-07-06T01:10:24.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63b999c700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0004d90 0x7f63a0005200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c160 tx=0x7f63a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb83dd34ae67e51 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac001db0 con 0x7f63a0004d90 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac00cca0 con 0x7f63a0004d90 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63abfff700 1 -- 172.21.15.71:0/3674213522 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac003c40 con 0x7f63a0004d90 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63bb3ff700 1 -- 172.21.15.71:0/3674213522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0004d90 msgr2=0x7f63a0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/3674213522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63a0004d90 0x7f63a0005200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c160 tx=0x7f63a0005880 comp rx=0 tx=0).stop 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63b999c700 1 -- 172.21.15.71:0/3674213522 reap_dead start 2023-07-06T01:10:24.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63bb3ff700 1 -- 172.21.15.71:0/3674213522 shutdown_connections 2023-07-06T01:10:24.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63bb3ff700 1 -- 172.21.15.71:0/3674213522 >> 172.21.15.71:0/3674213522 conn(0x7f63b406c150 msgr2=0x7f63b406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:24.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63bb3ff700 1 -- 172.21.15.71:0/3674213522 shutdown_connections 2023-07-06T01:10:24.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.499+0000 7f63bb3ff700 1 -- 172.21.15.71:0/3674213522 wait complete. 2023-07-06T01:10:24.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.501+0000 7f63bb3ff700 1 Processor -- start 2023-07-06T01:10:24.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.501+0000 7f63bb3ff700 1 -- start start 2023-07-06T01:10:24.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.502+0000 7f63bb3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63a0004d90 0x7f63b40b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.502+0000 7f63bb3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 0x7f63b4150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.502+0000 7f63bb3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63b40cc100 0x7f63b40cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.502+0000 7f63bb3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b41508a0 con 0x7f63b414fef0 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.502+0000 7f63bb3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40cbea0 con 0x7f63b40cc100 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.502+0000 7f63bb3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40cb0e0 con 0x7f63a0004d90 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 0x7f63b4150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 0x7f63b4150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55110/0 (socket says 172.21.15.71:55110) 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 -- 172.21.15.71:0/1653729865 learned_addr learned my addr 172.21.15.71:0/1653729865 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b919b700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63a0004d90 0x7f63b40b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 -- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63a0004d90 msgr2=0x7f63b40b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b999c700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63b40cc100 0x7f63b40cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63a0004d90 0x7f63b40b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 -- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63b40cc100 msgr2=0x7f63b40cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63b40cc100 0x7f63b40cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 -- 172.21.15.71:0/1653729865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40cb3c0 con 0x7f63b414fef0 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b919b700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63a0004d90 0x7f63b40b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:24.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b999c700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63b40cc100 0x7f63b40cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63b899a700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 0x7f63b4150360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011aa0 tx=0x7f63a4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.503+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400f980 con 0x7f63b414fef0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.504+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a400fae0 con 0x7f63b414fef0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.504+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b40cb6a0 con 0x7f63b414fef0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.504+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a400fe90 con 0x7f63b414fef0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.504+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b40ccab0 con 0x7f63b414fef0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.505+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b40008d0 con 0x7f63b414fef0 2023-07-06T01:10:24.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.506+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63a4014440 con 0x7f63b414fef0 2023-07-06T01:10:24.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.506+0000 7f63a9ffb700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f639806ace0 0x7f639806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.507+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63a4089c90 con 0x7f63b414fef0 2023-07-06T01:10:24.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.507+0000 7f63b919b700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f639806ace0 0x7f639806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.513 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.508+0000 7f63b919b700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f639806ace0 0x7f639806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63b00017a0 tx=0x7f63b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.510+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63a4058930 con 0x7f63b414fef0 2023-07-06T01:10:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.704+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63b40cbcf0 con 0x7f63b414fef0 2023-07-06T01:10:24.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.705+0000 7f63a9ffb700 1 -- 172.21.15.71:0/1653729865 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63a40584c0 con 0x7f63b414fef0 2023-07-06T01:10:24.708 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:10:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f639806ace0 msgr2=0x7f639806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f639806ace0 0x7f639806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63b00017a0 tx=0x7f63b0009040 comp rx=0 tx=0).stop 2023-07-06T01:10:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 msgr2=0x7f63b4150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 0x7f63b4150360 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63a4011aa0 tx=0x7f63a4011e60 comp rx=0 tx=0).stop 2023-07-06T01:10:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 shutdown_connections 2023-07-06T01:10:24.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f639806ace0 0x7f639806d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63b40cc100 0x7f63b40cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63a0004d90 0x7f63b40b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 --2- 172.21.15.71:0/1653729865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63b414fef0 0x7f63b4150360 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 >> 172.21.15.71:0/1653729865 conn(0x7f63b406c150 msgr2=0x7f63b415a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 shutdown_connections 2023-07-06T01:10:24.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.707+0000 7f63bb3ff700 1 -- 172.21.15.71:0/1653729865 wait complete. 2023-07-06T01:10:24.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:10:24.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.923+0000 7f56e07ff700 1 Processor -- start 2023-07-06T01:10:24.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.923+0000 7f56e07ff700 1 -- start start 2023-07-06T01:10:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.924+0000 7f56e07ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f56d815fca0 0x7f56d80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.924+0000 7f56e07ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80cf780 con 0x7f56d80b6110 2023-07-06T01:10:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.924+0000 7f56e07ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80cd490 con 0x7f56d80b5c90 2023-07-06T01:10:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.924+0000 7f56e07ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80cd770 con 0x7f56d815fca0 2023-07-06T01:10:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56ded9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f56d80b6110 0x7f56d80cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45900/0 (socket says 172.21.15.71:45900) 2023-07-06T01:10:24.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56ded9c700 1 -- 172.21.15.71:0/1190424601 learned_addr learned my addr 172.21.15.71:0/1190424601 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56de59b700 1 --2- 172.21.15.71:0/1190424601 >> v2:172.21.15.194:3300/0 conn(0x7f56d815fca0 0x7f56d80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631027152 0 0) 0x7f56d80cf780 con 0x7f56d80b6110 2023-07-06T01:10:24.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c40035b0 con 0x7f56d80b6110 2023-07-06T01:10:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169775273 0 0) 0x7f56d80cd490 con 0x7f56d80b5c90 2023-07-06T01:10:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d80cf780 con 0x7f56d80b5c90 2023-07-06T01:10:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096277990 0 0) 0x7f56c40035b0 con 0x7f56d80b6110 2023-07-06T01:10:24.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 >> v2:172.21.15.194:3300/0 conn(0x7f56d815fca0 msgr2=0x7f56d80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 --2- 172.21.15.71:0/1190424601 >> v2:172.21.15.194:3300/0 conn(0x7f56d815fca0 0x7f56d80d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 >> v1:172.21.15.194:6789/0 conn(0x7f56d80b5c90 legacy=0x7f56d80d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80cda50 con 0x7f56d80b6110 2023-07-06T01:10:24.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f56d0001970 con 0x7f56d80b6110 2023-07-06T01:10:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 >> v1:172.21.15.71:6789/0 conn(0x7f56d80b6110 legacy=0x7f56d80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56c4003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56c4004850 0x7f56c4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56c4005200 0x7f56c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80cd770 con 0x7f56c4003be0 2023-07-06T01:10:24.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c400c0e0 con 0x7f56c4004850 2023-07-06T01:10:24.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.925+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c400c270 con 0x7f56c4005200 2023-07-06T01:10:24.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56c4003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56ddd9a700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56c4004850 0x7f56c4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56ded9c700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56c4005200 0x7f56c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 -- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56c4005200 msgr2=0x7f56c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56c4005200 0x7f56c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 -- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56c4004850 msgr2=0x7f56c4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56c4004850 0x7f56c4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 -- 172.21.15.71:0/1190424601 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40035b0 con 0x7f56c4003be0 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56ddd9a700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56c4004850 0x7f56c4004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56ded9c700 1 -- 172.21.15.71:0/1190424601 reap_dead start 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56de59b700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56c4003fd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009b30 tx=0x7f56c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbebbdf73466fbd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400e6c0 con 0x7f56c4003be0 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d400e820 con 0x7f56c4003be0 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.926+0000 7f56dd599700 1 -- 172.21.15.71:0/1190424601 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400ebb0 con 0x7f56c4003be0 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 -- 172.21.15.71:0/1190424601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 msgr2=0x7f56c4003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56c4003fd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009b30 tx=0x7f56c4005880 comp rx=0 tx=0).stop 2023-07-06T01:10:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 -- 172.21.15.71:0/1190424601 shutdown_connections 2023-07-06T01:10:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1190424601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56c4003fd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 -- 172.21.15.71:0/1190424601 >> 172.21.15.71:0/1190424601 conn(0x7f56d806c150 msgr2=0x7f56d806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 -- 172.21.15.71:0/1190424601 shutdown_connections 2023-07-06T01:10:24.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.927+0000 7f56e07ff700 1 -- 172.21.15.71:0/1190424601 wait complete. 2023-07-06T01:10:24.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.929+0000 7f56e07ff700 1 Processor -- start 2023-07-06T01:10:24.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.929+0000 7f56e07ff700 1 -- start start 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56e07ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56d80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56e07ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d814d130 0x7f56d80b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56e07ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56d814d5a0 0x7f56d80b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56e07ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c6d10 con 0x7f56c4003be0 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56e07ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c6ff0 con 0x7f56d814d130 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56e07ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c72d0 con 0x7f56d814d5a0 2023-07-06T01:10:24.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56de59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56d80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56de59b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56d80c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55126/0 (socket says 172.21.15.71:55126) 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56de59b700 1 -- 172.21.15.71:0/1307869866 learned_addr learned my addr 172.21.15.71:0/1307869866 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56ddd9a700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d814d130 0x7f56d80b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.930+0000 7f56ded9c700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56d814d5a0 0x7f56d80b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56de59b700 1 -- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56d814d5a0 msgr2=0x7f56d80b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56de59b700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56d814d5a0 0x7f56d80b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56de59b700 1 -- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d814d130 msgr2=0x7f56d80b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56de59b700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d814d130 0x7f56d80b7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56de59b700 1 -- 172.21.15.71:0/1307869866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80c75b0 con 0x7f56c4003be0 2023-07-06T01:10:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56de59b700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56d80c8920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f56c40047a0 tx=0x7f56d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400e6c0 con 0x7f56c4003be0 2023-07-06T01:10:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4003ad0 con 0x7f56c4003be0 2023-07-06T01:10:24.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d4003e80 con 0x7f56c4003be0 2023-07-06T01:10:24.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d80c7890 con 0x7f56c4003be0 2023-07-06T01:10:24.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.931+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d80c82e0 con 0x7f56c4003be0 2023-07-06T01:10:24.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.932+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d80c7a20 con 0x7f56c4003be0 2023-07-06T01:10:24.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.933+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56d4013470 con 0x7f56c4003be0 2023-07-06T01:10:24.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.934+0000 7f56ceffd700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f56bc06ace0 0x7f56bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.934+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56d408ac70 con 0x7f56c4003be0 2023-07-06T01:10:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.935+0000 7f56ddd9a700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f56bc06ace0 0x7f56bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.935+0000 7f56ddd9a700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f56bc06ace0 0x7f56bc06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f56d804fce0 tx=0x7f56c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:24.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:24.938+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56d4055e30 con 0x7f56c4003be0 2023-07-06T01:10:25.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.134+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56d80008d0 con 0x7f56c4003be0 2023-07-06T01:10:25.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.134+0000 7f56ceffd700 1 -- 172.21.15.71:0/1307869866 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56d40170a0 con 0x7f56c4003be0 2023-07-06T01:10:25.137 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:10:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f56bc06ace0 msgr2=0x7f56bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f56bc06ace0 0x7f56bc06d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f56d804fce0 tx=0x7f56c8009040 comp rx=0 tx=0).stop 2023-07-06T01:10:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 msgr2=0x7f56d80c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56d80c8920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f56c40047a0 tx=0x7f56d40047c0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 shutdown_connections 2023-07-06T01:10:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f56bc06ace0 0x7f56bc06d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56d814d5a0 0x7f56d80b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56c4003be0 0x7f56d80c8920 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 --2- 172.21.15.71:0/1307869866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d814d130 0x7f56d80b7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 >> 172.21.15.71:0/1307869866 conn(0x7f56d806c150 msgr2=0x7f56d80d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:25.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.136+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 shutdown_connections 2023-07-06T01:10:25.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.137+0000 7f56e07ff700 1 -- 172.21.15.71:0/1307869866 wait complete. 2023-07-06T01:10:25.157 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T01:10:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.349+0000 7f3c18dff700 1 Processor -- start 2023-07-06T01:10:25.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.349+0000 7f3c18dff700 1 -- start start 2023-07-06T01:10:25.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.350+0000 7f3c18dff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3c140b5c90 0x7f3c140d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:25.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.350+0000 7f3c18dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c140d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:25.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c18dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c140cf780 con 0x7f3c1415fca0 2023-07-06T01:10:25.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c18dff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c140cd490 con 0x7f3c140b5c90 2023-07-06T01:10:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c18dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140cd770 con 0x7f3c140b6110 2023-07-06T01:10:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c1259c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3c1415fca0 0x7f3c140d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45904/0 (socket says 172.21.15.71:45904) 2023-07-06T01:10:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c1259c700 1 -- 172.21.15.71:0/2411676176 learned_addr learned my addr 172.21.15.71:0/2411676176 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:25.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/2411676176 >> v2:172.21.15.194:3300/0 conn(0x7f3c140b5c90 0x7f3c140d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c140d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c11d9b700 1 -- 172.21.15.71:0/2411676176 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274430148 0 0) 0x7f3c140cf780 con 0x7f3c1415fca0 2023-07-06T01:10:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.351+0000 7f3c11d9b700 1 -- 172.21.15.71:0/2411676176 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c000035b0 con 0x7f3c1415fca0 2023-07-06T01:10:25.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c11d9b700 1 -- 172.21.15.71:0/2411676176 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348651793 0 0) 0x7f3c000035b0 con 0x7f3c1415fca0 2023-07-06T01:10:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c0bfff700 1 -- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 msgr2=0x7f3c140d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:25.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c140d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c0bfff700 1 -- 172.21.15.71:0/2411676176 >> v1:172.21.15.71:6789/0 conn(0x7f3c1415fca0 legacy=0x7f3c140d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c0bfff700 1 -- 172.21.15.71:0/2411676176 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140cda50 con 0x7f3c140b5c90 2023-07-06T01:10:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c140d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:25.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c140d2d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009840 tx=0x7f3bfc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb32475f573ad86 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c11d9b700 1 -- 172.21.15.71:0/2411676176 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04001670 con 0x7f3c140b5c90 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c11d9b700 1 -- 172.21.15.71:0/2411676176 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc004030 con 0x7f3c140b5c90 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.352+0000 7f3c11d9b700 1 -- 172.21.15.71:0/2411676176 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0043c0 con 0x7f3c140b5c90 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 -- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 msgr2=0x7f3c140d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c140d2d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009840 tx=0x7f3bfc009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 -- 172.21.15.71:0/2411676176 shutdown_connections 2023-07-06T01:10:25.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c140d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 --2- 172.21.15.71:0/2411676176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c140d2d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 -- 172.21.15.71:0/2411676176 >> 172.21.15.71:0/2411676176 conn(0x7f3c1406c150 msgr2=0x7f3c1406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 -- 172.21.15.71:0/2411676176 shutdown_connections 2023-07-06T01:10:25.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.353+0000 7f3c18dff700 1 -- 172.21.15.71:0/2411676176 wait complete. 2023-07-06T01:10:25.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.354+0000 7f3c18dff700 1 Processor -- start 2023-07-06T01:10:25.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.355+0000 7f3c18dff700 1 -- start start 2023-07-06T01:10:25.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.355+0000 7f3c18dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c141f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.355+0000 7f3c18dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c14159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c18dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 0x7f3c140d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c18dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140c7f90 con 0x7f3c1415fca0 2023-07-06T01:10:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c18dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140b2610 con 0x7f3c140b5c90 2023-07-06T01:10:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c18dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c141595c0 con 0x7f3c140b6110 2023-07-06T01:10:25.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 0x7f3c140d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 0x7f3c140d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55142/0 (socket says 172.21.15.71:55142) 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 -- 172.21.15.71:0/1518976187 learned_addr learned my addr 172.21.15.71:0/1518976187 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c14159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c141f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 -- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 msgr2=0x7f3c14159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c14159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 -- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 msgr2=0x7f3c141f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c141f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 -- 172.21.15.71:0/1518976187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c009a70 con 0x7f3c1415fca0 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.356+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 0x7f3c140d0960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00efc0 tx=0x7f3c0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.357+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c009d70 con 0x7f3c1415fca0 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.357+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c00f040 con 0x7f3c1415fca0 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.357+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc0094a0 con 0x7f3c1415fca0 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.357+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00ce00 con 0x7f3c1415fca0 2023-07-06T01:10:25.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.357+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c141f1dd0 con 0x7f3c1415fca0 2023-07-06T01:10:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.358+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c140008d0 con 0x7f3c1415fca0 2023-07-06T01:10:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.359+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c0c014480 con 0x7f3c1415fca0 2023-07-06T01:10:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.359+0000 7f3c0affd700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf406ace0 0x7f3bf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.360+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c0c089d30 con 0x7f3c1415fca0 2023-07-06T01:10:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.360+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf406ace0 0x7f3bf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:25.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.361+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf406ace0 0x7f3bf406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c040011e0 tx=0x7f3c04007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:25.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.364+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c0c054d40 con 0x7f3c1415fca0 2023-07-06T01:10:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.574+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3c140b2a40 con 0x7f3c1415fca0 2023-07-06T01:10:25.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.574+0000 7f3c0affd700 1 -- 172.21.15.71:0/1518976187 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3c0c058360 con 0x7f3c1415fca0 2023-07-06T01:10:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf406ace0 msgr2=0x7f3bf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf406ace0 0x7f3bf406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c040011e0 tx=0x7f3c04007a40 comp rx=0 tx=0).stop 2023-07-06T01:10:25.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 msgr2=0x7f3c140d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 0x7f3c140d0960 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00efc0 tx=0x7f3c0c00c3a0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 shutdown_connections 2023-07-06T01:10:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f3bf406ace0 0x7f3bf406d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1415fca0 0x7f3c140d0960 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c140b5c90 0x7f3c141f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 --2- 172.21.15.71:0/1518976187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c140b6110 0x7f3c14159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.576+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 >> 172.21.15.71:0/1518976187 conn(0x7f3c1406c150 msgr2=0x7f3c1415ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.577+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 shutdown_connections 2023-07-06T01:10:25.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:25.577+0000 7f3c18dff700 1 -- 172.21.15.71:0/1518976187 wait complete. 2023-07-06T01:10:25.582 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2023-07-06T01:10:25.597 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T01:10:25.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:25.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-06T01:10:25.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:10:25.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:25.687 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T01:10:25.733 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:10:25.734 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:25.785 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:10:25.785 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:25.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:26.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.023+0000 7f1e57bff700 1 Processor -- start 2023-07-06T01:10:26.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.023+0000 7f1e57bff700 1 -- start start 2023-07-06T01:10:26.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e57bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e5015fca0 0x7f1e500d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e57bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e57bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e500cf780 con 0x7f1e500b60e0 2023-07-06T01:10:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e57bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e500cd490 con 0x7f1e5015fca0 2023-07-06T01:10:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e57bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500cd770 con 0x7f1e500b5c90 2023-07-06T01:10:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e5619c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1e500b60e0 0x7f1e500cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45914/0 (socket says 172.21.15.71:45914) 2023-07-06T01:10:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e5619c700 1 -- 172.21.15.71:0/1005841253 learned_addr learned my addr 172.21.15.71:0/1005841253 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:26.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e5599b700 1 --2- 172.21.15.71:0/1005841253 >> v2:172.21.15.194:3300/0 conn(0x7f1e5015fca0 0x7f1e500d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e5519a700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e54999700 1 -- 172.21.15.71:0/1005841253 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842351598 0 0) 0x7f1e500cf780 con 0x7f1e500b60e0 2023-07-06T01:10:26.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.025+0000 7f1e54999700 1 -- 172.21.15.71:0/1005841253 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e3c0035b0 con 0x7f1e500b60e0 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e5599b700 1 -- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 msgr2=0x7f1e500d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e5599b700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e5599b700 1 -- 172.21.15.71:0/1005841253 >> v1:172.21.15.71:6789/0 conn(0x7f1e500b60e0 legacy=0x7f1e500cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e54999700 1 -- 172.21.15.71:0/1005841253 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1748905313 0 0) 0x7f1e3c0035b0 con 0x7f1e500b60e0 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e5599b700 1 -- 172.21.15.71:0/1005841253 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500cda50 con 0x7f1e5015fca0 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e5519a700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:26.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e5599b700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 0x7f1e500d1420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009840 tx=0x7f1e4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782e02394871d4a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e54999700 1 -- 172.21.15.71:0/1005841253 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480019f0 con 0x7f1e5015fca0 2023-07-06T01:10:26.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e54999700 1 -- 172.21.15.71:0/1005841253 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c004030 con 0x7f1e5015fca0 2023-07-06T01:10:26.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.026+0000 7f1e54999700 1 -- 172.21.15.71:0/1005841253 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c0043c0 con 0x7f1e5015fca0 2023-07-06T01:10:26.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 -- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 msgr2=0x7f1e500d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 0x7f1e500d1420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009840 tx=0x7f1e4c009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 -- 172.21.15.71:0/1005841253 shutdown_connections 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 0x7f1e500d1420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1005841253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 -- 172.21.15.71:0/1005841253 >> 172.21.15.71:0/1005841253 conn(0x7f1e5006c150 msgr2=0x7f1e5006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 -- 172.21.15.71:0/1005841253 shutdown_connections 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.027+0000 7f1e57bff700 1 -- 172.21.15.71:0/1005841253 wait complete. 2023-07-06T01:10:26.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.028+0000 7f1e57bff700 1 Processor -- start 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.029+0000 7f1e57bff700 1 -- start start 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e57bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e57bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 0x7f1e50159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e57bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 0x7f1e500cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e57bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015ba80 con 0x7f1e500b60e0 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e57bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015b730 con 0x7f1e5015fca0 2023-07-06T01:10:26.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e57bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015a0b0 con 0x7f1e500b5c90 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 0x7f1e50159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 0x7f1e50159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55152/0 (socket says 172.21.15.71:55152) 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 -- 172.21.15.71:0/1157301034 learned_addr learned my addr 172.21.15.71:0/1157301034 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5599b700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 -- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 msgr2=0x7f1e500b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 -- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 msgr2=0x7f1e500cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 0x7f1e500cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.030+0000 7f1e5519a700 1 -- 172.21.15.71:0/1157301034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400094a0 con 0x7f1e500b60e0 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.031+0000 7f1e5519a700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 0x7f1e50159740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000ebe0 tx=0x7f1e4000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.031+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40009800 con 0x7f1e500b60e0 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.031+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4000c910 con 0x7f1e500b60e0 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.031+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4c0094a0 con 0x7f1e500b60e0 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.031+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4000cc80 con 0x7f1e500b60e0 2023-07-06T01:10:26.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.031+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5015a670 con 0x7f1e500b60e0 2023-07-06T01:10:26.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.032+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e500008d0 con 0x7f1e500b60e0 2023-07-06T01:10:26.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.033+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e40013470 con 0x7f1e500b60e0 2023-07-06T01:10:26.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.034+0000 7f1e467fc700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e3406ace0 0x7f1e3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.035+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e40089580 con 0x7f1e500b60e0 2023-07-06T01:10:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.035+0000 7f1e5599b700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e3406ace0 0x7f1e3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.036+0000 7f1e5599b700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e3406ace0 0x7f1e3406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00a010 tx=0x7f1e4c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.039+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e400580d0 con 0x7f1e500b60e0 2023-07-06T01:10:26.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.232+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e500b2c40 con 0x7f1e500b60e0 2023-07-06T01:10:26.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.233+0000 7f1e467fc700 1 -- 172.21.15.71:0/1157301034 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f1e40057c60 con 0x7f1e500b60e0 2023-07-06T01:10:26.236 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:26.237 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":36,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:08.799855+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e3406ace0 msgr2=0x7f1e3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e3406ace0 0x7f1e3406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00a010 tx=0x7f1e4c008030 comp rx=0 tx=0).stop 2023-07-06T01:10:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 msgr2=0x7f1e50159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 0x7f1e50159740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000ebe0 tx=0x7f1e4000eef0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 shutdown_connections 2023-07-06T01:10:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f1e3406ace0 0x7f1e3406d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e5015fca0 0x7f1e500cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e500b5c90 0x7f1e500b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 --2- 172.21.15.71:0/1157301034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e500b60e0 0x7f1e50159740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 >> 172.21.15.71:0/1157301034 conn(0x7f1e5006c150 msgr2=0x7f1e500d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 shutdown_connections 2023-07-06T01:10:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.236+0000 7f1e57bff700 1 -- 172.21.15.71:0/1157301034 wait complete. 2023-07-06T01:10:26.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:10:05.447038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:10:06.255735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:10:26.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:10:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.453+0000 7f53d33ff700 1 Processor -- start 2023-07-06T01:10:26.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.454+0000 7f53d33ff700 1 -- start start 2023-07-06T01:10:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d33ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53cc15fca0 0x7f53cc0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d33ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0cf780 con 0x7f53cc0b5c90 2023-07-06T01:10:26.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d33ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0cd490 con 0x7f53cc0b6110 2023-07-06T01:10:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d33ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0cd770 con 0x7f53cc15fca0 2023-07-06T01:10:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d119b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f53cc15fca0 0x7f53cc0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d099a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f53cc0b5c90 0x7f53cc0d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45930/0 (socket says 172.21.15.71:45930) 2023-07-06T01:10:26.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d099a700 1 -- 172.21.15.71:0/1472912925 learned_addr learned my addr 172.21.15.71:0/1472912925 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d119b700 1 -- 172.21.15.71:0/1472912925 >> v1:172.21.15.194:6789/0 conn(0x7f53cc0b6110 legacy=0x7f53cc0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d119b700 1 -- 172.21.15.71:0/1472912925 >> v1:172.21.15.71:6789/0 conn(0x7f53cc0b5c90 legacy=0x7f53cc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53d119b700 1 -- 172.21.15.71:0/1472912925 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0cda50 con 0x7f53cc15fca0 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.455+0000 7f53c3fff700 1 -- 172.21.15.71:0/1472912925 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838409789 0 0) 0x7f53cc0cf780 con 0x7f53cc0b5c90 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.456+0000 7f53d119b700 1 --2- 172.21.15.71:0/1472912925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0d1420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009840 tx=0x7f53c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e997145fd7399b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.456+0000 7f53c3fff700 1 -- 172.21.15.71:0/1472912925 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011830 con 0x7f53cc15fca0 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.456+0000 7f53c3fff700 1 -- 172.21.15.71:0/1472912925 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8011990 con 0x7f53cc15fca0 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.456+0000 7f53c3fff700 1 -- 172.21.15.71:0/1472912925 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8011d20 con 0x7f53cc15fca0 2023-07-06T01:10:26.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.456+0000 7f53d33ff700 1 -- 172.21.15.71:0/1472912925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 msgr2=0x7f53cc0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.456+0000 7f53d33ff700 1 --2- 172.21.15.71:0/1472912925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0d1420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f53c8009840 tx=0x7f53c8009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.457+0000 7f53d33ff700 1 -- 172.21.15.71:0/1472912925 shutdown_connections 2023-07-06T01:10:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.457+0000 7f53d33ff700 1 --2- 172.21.15.71:0/1472912925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0d1420 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.457+0000 7f53d33ff700 1 -- 172.21.15.71:0/1472912925 >> 172.21.15.71:0/1472912925 conn(0x7f53cc06c150 msgr2=0x7f53cc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.457+0000 7f53d33ff700 1 -- 172.21.15.71:0/1472912925 shutdown_connections 2023-07-06T01:10:26.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.457+0000 7f53d33ff700 1 -- 172.21.15.71:0/1472912925 wait complete. 2023-07-06T01:10:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.458+0000 7f53d33ff700 1 Processor -- start 2023-07-06T01:10:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.458+0000 7f53d33ff700 1 -- start start 2023-07-06T01:10:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.459+0000 7f53d33ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53cc0b5c90 0x7f53cc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.459+0000 7f53d33ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53cc0b6110 0x7f53cc0ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.459+0000 7f53d33ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.459+0000 7f53d33ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0c6910 con 0x7f53cc15fca0 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.459+0000 7f53d33ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0c6bf0 con 0x7f53cc0b6110 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.459+0000 7f53d33ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0cb3e0 con 0x7f53cc0b5c90 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55172/0 (socket says 172.21.15.71:55172) 2023-07-06T01:10:26.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 -- 172.21.15.71:0/3610734568 learned_addr learned my addr 172.21.15.71:0/3610734568 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d099a700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53cc0b6110 0x7f53cc0ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d119b700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53cc0b5c90 0x7f53cc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 -- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53cc0b5c90 msgr2=0x7f53cc1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53cc0b5c90 0x7f53cc1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 -- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53cc0b6110 msgr2=0x7f53cc0ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53cc0b6110 0x7f53cc0ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 -- 172.21.15.71:0/3610734568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80094a0 con 0x7f53cc15fca0 2023-07-06T01:10:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.460+0000 7f53d199c700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0c89a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53c400cc80 tx=0x7f53c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.461+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4003c00 con 0x7f53cc15fca0 2023-07-06T01:10:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.461+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4003d60 con 0x7f53cc15fca0 2023-07-06T01:10:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.461+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c400aaa0 con 0x7f53cc15fca0 2023-07-06T01:10:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.461+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc0cb6c0 con 0x7f53cc15fca0 2023-07-06T01:10:26.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.461+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc0cc8b0 con 0x7f53cc15fca0 2023-07-06T01:10:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.462+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc0c6d80 con 0x7f53cc15fca0 2023-07-06T01:10:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.463+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53c400ac00 con 0x7f53cc15fca0 2023-07-06T01:10:26.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.464+0000 7f53c1ffb700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f53b006ace0 0x7f53b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.464+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53c4089400 con 0x7f53cc15fca0 2023-07-06T01:10:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.464+0000 7f53d119b700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f53b006ace0 0x7f53b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.465+0000 7f53d119b700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f53b006ace0 0x7f53b006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f53c80090b0 tx=0x7f53c801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.468+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53c40544a0 con 0x7f53cc15fca0 2023-07-06T01:10:26.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.662+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53cc067000 con 0x7f53cc15fca0 2023-07-06T01:10:26.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.662+0000 7f53c1ffb700 1 -- 172.21.15.71:0/3610734568 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53c4057ac0 con 0x7f53cc15fca0 2023-07-06T01:10:26.665 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:10:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f53b006ace0 msgr2=0x7f53b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f53b006ace0 0x7f53b006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f53c80090b0 tx=0x7f53c801c040 comp rx=0 tx=0).stop 2023-07-06T01:10:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 msgr2=0x7f53cc0c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0c89a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f53c400cc80 tx=0x7f53c400cf90 comp rx=0 tx=0).stop 2023-07-06T01:10:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 shutdown_connections 2023-07-06T01:10:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f53b006ace0 0x7f53b006d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53cc15fca0 0x7f53cc0c89a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53cc0b5c90 0x7f53cc1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 --2- 172.21.15.71:0/3610734568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53cc0b6110 0x7f53cc0ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.664+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 >> 172.21.15.71:0/3610734568 conn(0x7f53cc06c150 msgr2=0x7f53cc0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:26.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.665+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 shutdown_connections 2023-07-06T01:10:26.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.665+0000 7f53d33ff700 1 -- 172.21.15.71:0/3610734568 wait complete. 2023-07-06T01:10:26.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:10:26.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.883+0000 7f005bfff700 1 Processor -- start 2023-07-06T01:10:26.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.883+0000 7f005bfff700 1 -- start start 2023-07-06T01:10:26.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.884+0000 7f005bfff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f005406c330 0x7f005406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.884+0000 7f005bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00540c9010 0x7f00540c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.884+0000 7f005bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005406cc40 con 0x7f00541565f0 2023-07-06T01:10:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.884+0000 7f005bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540c9a60 con 0x7f00540c9010 2023-07-06T01:10:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.884+0000 7f005bfff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0054159b70 con 0x7f005406c330 2023-07-06T01:10:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00540c9010 0x7f00540c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005a59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f00541565f0 0x7f0054156a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45934/0 (socket says 172.21.15.71:45934) 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005a59c700 1 -- 172.21.15.71:0/2829181253 learned_addr learned my addr 172.21.15.71:0/2829181253 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f00540c9010 0x7f00540c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55178/0 (socket says 172.21.15.71:55178) 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f0059d9b700 1 --2- 172.21.15.71:0/2829181253 >> v2:172.21.15.194:3300/0 conn(0x7f005406c330 0x7f005406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f0058d99700 1 -- 172.21.15.71:0/2829181253 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895376748 0 0) 0x7f005406cc40 con 0x7f00541565f0 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f0058d99700 1 -- 172.21.15.71:0/2829181253 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00400035b0 con 0x7f00541565f0 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 -- 172.21.15.71:0/2829181253 >> v2:172.21.15.194:3300/0 conn(0x7f005406c330 msgr2=0x7f005406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 --2- 172.21.15.71:0/2829181253 >> v2:172.21.15.194:3300/0 conn(0x7f005406c330 0x7f005406c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 -- 172.21.15.71:0/2829181253 >> v1:172.21.15.71:6789/0 conn(0x7f00541565f0 legacy=0x7f0054156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 -- 172.21.15.71:0/2829181253 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054159e50 con 0x7f00540c9010 2023-07-06T01:10:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.885+0000 7f005959a700 1 --2- 172.21.15.71:0/2829181253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00540c9010 0x7f00540c9480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f005406f160 tx=0x7f004400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63326c6f7a46651 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f0058d99700 1 -- 172.21.15.71:0/2829181253 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400dc70 con 0x7f00540c9010 2023-07-06T01:10:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f0058d99700 1 -- 172.21.15.71:0/2829181253 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400ddd0 con 0x7f00540c9010 2023-07-06T01:10:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f0058d99700 1 -- 172.21.15.71:0/2829181253 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044010690 con 0x7f00540c9010 2023-07-06T01:10:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 -- 172.21.15.71:0/2829181253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00540c9010 msgr2=0x7f00540c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 --2- 172.21.15.71:0/2829181253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00540c9010 0x7f00540c9480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f005406f160 tx=0x7f004400bdc0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 -- 172.21.15.71:0/2829181253 shutdown_connections 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 --2- 172.21.15.71:0/2829181253 >> v2:172.21.15.194:3300/0 conn(0x7f005406c330 0x7f005406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 --2- 172.21.15.71:0/2829181253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00540c9010 0x7f00540c9480 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 -- 172.21.15.71:0/2829181253 >> 172.21.15.71:0/2829181253 conn(0x7f00540cb440 msgr2=0x7f00540cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 -- 172.21.15.71:0/2829181253 shutdown_connections 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.886+0000 7f005bfff700 1 -- 172.21.15.71:0/2829181253 wait complete. 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.888+0000 7f005bfff700 1 Processor -- start 2023-07-06T01:10:26.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.888+0000 7f005bfff700 1 -- start start 2023-07-06T01:10:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005bfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f005406c330 0x7f00540b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005bfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00540c9010 0x7f005414c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 0x7f00540b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540b47b0 con 0x7f00541565f0 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005bfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540b37e0 con 0x7f00540c9010 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005bfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0054153300 con 0x7f005406c330 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 0x7f00540b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 0x7f00540b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55180/0 (socket says 172.21.15.71:55180) 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005a59c700 1 -- 172.21.15.71:0/2049551633 learned_addr learned my addr 172.21.15.71:0/2049551633 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f0059d9b700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f005406c330 0x7f00540b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.889+0000 7f005959a700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00540c9010 0x7f005414c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005a59c700 1 -- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f005406c330 msgr2=0x7f00540b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005a59c700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f005406c330 0x7f00540b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005a59c700 1 -- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00540c9010 msgr2=0x7f005414c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005a59c700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00540c9010 0x7f005414c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005a59c700 1 -- 172.21.15.71:0/2049551633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004400b740 con 0x7f00541565f0 2023-07-06T01:10:26.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005a59c700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 0x7f00540b1a70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f004c00cb70 tx=0x7f004c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00aa60 con 0x7f00541565f0 2023-07-06T01:10:26.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00abc0 con 0x7f00541565f0 2023-07-06T01:10:26.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00541535e0 con 0x7f00541565f0 2023-07-06T01:10:26.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c012400 con 0x7f00541565f0 2023-07-06T01:10:26.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.890+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005414c620 con 0x7f00541565f0 2023-07-06T01:10:26.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.891+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0054153770 con 0x7f00541565f0 2023-07-06T01:10:26.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.892+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f004c01b3b0 con 0x7f00541565f0 2023-07-06T01:10:26.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.893+0000 7f004a7fc700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f003806ace0 0x7f003806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:26.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.893+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f004c089230 con 0x7f00541565f0 2023-07-06T01:10:26.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.894+0000 7f0059d9b700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f003806ace0 0x7f003806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:26.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.894+0000 7f0059d9b700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f003806ace0 0x7f003806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00540c8f70 tx=0x7f0050008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:26.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:26.897+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f004c0542d0 con 0x7f00541565f0 2023-07-06T01:10:27.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.093+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00540008d0 con 0x7f00541565f0 2023-07-06T01:10:27.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.094+0000 7f004a7fc700 1 -- 172.21.15.71:0/2049551633 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f004c0578f0 con 0x7f00541565f0 2023-07-06T01:10:27.097 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:10:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f003806ace0 msgr2=0x7f003806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f003806ace0 0x7f003806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00540c8f70 tx=0x7f0050008040 comp rx=0 tx=0).stop 2023-07-06T01:10:27.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 msgr2=0x7f00540b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 0x7f00540b1a70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f004c00cb70 tx=0x7f004c00ce80 comp rx=0 tx=0).stop 2023-07-06T01:10:27.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 shutdown_connections 2023-07-06T01:10:27.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f003806ace0 0x7f003806d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f00541565f0 0x7f00540b1a70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f005406c330 0x7f00540b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.096+0000 7f005bfff700 1 --2- 172.21.15.71:0/2049551633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00540c9010 0x7f005414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.097+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 >> 172.21.15.71:0/2049551633 conn(0x7f00540cb440 msgr2=0x7f0054155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.097+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 shutdown_connections 2023-07-06T01:10:27.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.097+0000 7f005bfff700 1 -- 172.21.15.71:0/2049551633 wait complete. 2023-07-06T01:10:27.117 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:10:27.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.313+0000 7f8b4cdff700 1 Processor -- start 2023-07-06T01:10:27.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.313+0000 7f8b4cdff700 1 -- start start 2023-07-06T01:10:27.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.314+0000 7f8b4cdff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8b480b6110 0x7f8b480cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.314+0000 7f8b4cdff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480cf780 con 0x7f8b480b5c90 2023-07-06T01:10:27.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.314+0000 7f8b4cdff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480cd490 con 0x7f8b4815fca0 2023-07-06T01:10:27.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.314+0000 7f8b4cdff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b480cd770 con 0x7f8b480b6110 2023-07-06T01:10:27.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8b480b6110 0x7f8b480cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8b480b6110 0x7f8b480cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55188/0 (socket says 172.21.15.71:55188) 2023-07-06T01:10:27.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 -- 172.21.15.71:0/2389506835 learned_addr learned my addr 172.21.15.71:0/2389506835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:27.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b3ffff700 1 --1- 172.21.15.71:0/2389506835 >> v1:172.21.15.71:6789/0 conn(0x7f8b480b5c90 0x7f8b480d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45950/0 (socket says 172.21.15.71:45950) 2023-07-06T01:10:27.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 -- 172.21.15.71:0/2389506835 >> v1:172.21.15.194:6789/0 conn(0x7f8b4815fca0 legacy=0x7f8b480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 -- 172.21.15.71:0/2389506835 >> v1:172.21.15.71:6789/0 conn(0x7f8b480b5c90 legacy=0x7f8b480d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 -- 172.21.15.71:0/2389506835 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480cda50 con 0x7f8b480b6110 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.315+0000 7f8b46d9d700 1 --2- 172.21.15.71:0/2389506835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b6110 0x7f8b480cfc10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009e50 tx=0x7f8b4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286584ed205e603e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b45d9b700 1 -- 172.21.15.71:0/2389506835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000e070 con 0x7f8b480b6110 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b45d9b700 1 -- 172.21.15.71:0/2389506835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000b9c0 con 0x7f8b480b6110 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b45d9b700 1 -- 172.21.15.71:0/2389506835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000bd70 con 0x7f8b480b6110 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 -- 172.21.15.71:0/2389506835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b6110 msgr2=0x7f8b480cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/2389506835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b6110 0x7f8b480cfc10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009e50 tx=0x7f8b4000b330 comp rx=0 tx=0).stop 2023-07-06T01:10:27.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 -- 172.21.15.71:0/2389506835 shutdown_connections 2023-07-06T01:10:27.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/2389506835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b6110 0x7f8b480cfc10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 -- 172.21.15.71:0/2389506835 >> 172.21.15.71:0/2389506835 conn(0x7f8b4806c150 msgr2=0x7f8b4806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:27.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 -- 172.21.15.71:0/2389506835 shutdown_connections 2023-07-06T01:10:27.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.316+0000 7f8b4cdff700 1 -- 172.21.15.71:0/2389506835 wait complete. 2023-07-06T01:10:27.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.318+0000 7f8b4cdff700 1 Processor -- start 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.318+0000 7f8b4cdff700 1 -- start start 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 0x7f8b481571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b480b6110 0x7f8b480c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b4815fca0 0x7f8b480c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c7480 con 0x7f8b480b5c90 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c7760 con 0x7f8b4815fca0 2023-07-06T01:10:27.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480c7a40 con 0x7f8b480b6110 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 0x7f8b481571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 0x7f8b481571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55190/0 (socket says 172.21.15.71:55190) 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.319+0000 7f8b4659c700 1 -- 172.21.15.71:0/936729054 learned_addr learned my addr 172.21.15.71:0/936729054 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b3ffff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b480b6110 0x7f8b480c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b46d9d700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b4815fca0 0x7f8b480c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4659c700 1 -- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b480b6110 msgr2=0x7f8b480c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4659c700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b480b6110 0x7f8b480c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4659c700 1 -- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b4815fca0 msgr2=0x7f8b480c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4659c700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b4815fca0 0x7f8b480c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4659c700 1 -- 172.21.15.71:0/936729054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009b30 con 0x7f8b480b5c90 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b46d9d700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b4815fca0 0x7f8b480c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b3ffff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b480b6110 0x7f8b480c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4659c700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 0x7f8b481571d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800c450 tx=0x7f8b3800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:27.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380052d0 con 0x7f8b480b5c90 2023-07-06T01:10:27.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b38005430 con 0x7f8b480b5c90 2023-07-06T01:10:27.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b480c7d20 con 0x7f8b480b5c90 2023-07-06T01:10:27.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380038c0 con 0x7f8b480b5c90 2023-07-06T01:10:27.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.320+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4815f1c0 con 0x7f8b480b5c90 2023-07-06T01:10:27.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.321+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b480008d0 con 0x7f8b480b5c90 2023-07-06T01:10:27.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.322+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b38003a20 con 0x7f8b480b5c90 2023-07-06T01:10:27.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.323+0000 7f8b3effd700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8b2806ace0 0x7f8b2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.323+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b38088930 con 0x7f8b480b5c90 2023-07-06T01:10:27.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.324+0000 7f8b3ffff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8b2806ace0 0x7f8b2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.324+0000 7f8b3ffff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8b2806ace0 0x7f8b2806d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000f60 tx=0x7f8b30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:27.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.327+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b380539d0 con 0x7f8b480b5c90 2023-07-06T01:10:27.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.520+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b480cfd60 con 0x7f8b480b5c90 2023-07-06T01:10:27.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.521+0000 7f8b3effd700 1 -- 172.21.15.71:0/936729054 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b38056ff0 con 0x7f8b480b5c90 2023-07-06T01:10:27.524 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8b2806ace0 msgr2=0x7f8b2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8b2806ace0 0x7f8b2806d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8b30000f60 tx=0x7f8b30009040 comp rx=0 tx=0).stop 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 msgr2=0x7f8b481571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 0x7f8b481571d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800c450 tx=0x7f8b3800c810 comp rx=0 tx=0).stop 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 shutdown_connections 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8b2806ace0 0x7f8b2806d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b4815fca0 0x7f8b480c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b480b5c90 0x7f8b481571d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 --2- 172.21.15.71:0/936729054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b480b6110 0x7f8b480c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 >> 172.21.15.71:0/936729054 conn(0x7f8b4806c150 msgr2=0x7f8b480b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 shutdown_connections 2023-07-06T01:10:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.523+0000 7f8b4cdff700 1 -- 172.21.15.71:0/936729054 wait complete. 2023-07-06T01:10:27.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:10:27.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.739+0000 7fed75dff700 1 Processor -- start 2023-07-06T01:10:27.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.739+0000 7fed75dff700 1 -- start start 2023-07-06T01:10:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed75dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 0x7fed700cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed75dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed700cf780 con 0x7fed7015fca0 2023-07-06T01:10:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed75dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed700cd490 con 0x7fed700b5c90 2023-07-06T01:10:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed75dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed700cd770 con 0x7fed700b6110 2023-07-06T01:10:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed6f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fed7015fca0 0x7fed700d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45956/0 (socket says 172.21.15.71:45956) 2023-07-06T01:10:27.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed6f7fe700 1 -- 172.21.15.71:0/1560139000 learned_addr learned my addr 172.21.15.71:0/1560139000 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170988066 0 0) 0x7fed700cf780 con 0x7fed7015fca0 2023-07-06T01:10:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5c0035b0 con 0x7fed7015fca0 2023-07-06T01:10:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.741+0000 7fed6ffff700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 0x7fed700cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861563683 0 0) 0x7fed5c0035b0 con 0x7fed7015fca0 2023-07-06T01:10:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 msgr2=0x7fed700cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:27.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 0x7fed700cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 >> v1:172.21.15.194:6789/0 conn(0x7fed700b5c90 legacy=0x7fed700d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700cda50 con 0x7fed7015fca0 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fed60001670 con 0x7fed7015fca0 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 >> v1:172.21.15.71:6789/0 conn(0x7fed7015fca0 legacy=0x7fed700d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed5c003a30 0x7fed5c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 0x7fed5c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed5c004d90 0x7fed5c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700cd770 con 0x7fed5c003a30 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c00baf0 con 0x7fed5c004d90 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c00bcb0 con 0x7fed700b6110 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed5c003a30 0x7fed5c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed67fff700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 0x7fed5c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6ffff700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed5c004d90 0x7fed5c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6f7fe700 1 -- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 msgr2=0x7fed5c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:27.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.742+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed700b6110 0x7fed5c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6f7fe700 1 -- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed5c004d90 msgr2=0x7fed5c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed5c004d90 0x7fed5c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6f7fe700 1 -- 172.21.15.71:0/1560139000 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0035b0 con 0x7fed5c003a30 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed5c003a30 0x7fed5c003e40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c160 tx=0x7fed5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b12a1eedc407982 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60007b70 con 0x7fed5c003a30 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6000cd20 con 0x7fed5c003a30 2023-07-06T01:10:27.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6effd700 1 -- 172.21.15.71:0/1560139000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed60005ba0 con 0x7fed5c003a30 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed75dff700 1 -- 172.21.15.71:0/1560139000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed5c003a30 msgr2=0x7fed5c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed75dff700 1 --2- 172.21.15.71:0/1560139000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed5c003a30 0x7fed5c003e40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c160 tx=0x7fed5c005880 comp rx=0 tx=0).stop 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.743+0000 7fed6ffff700 1 -- 172.21.15.71:0/1560139000 reap_dead start 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.744+0000 7fed75dff700 1 -- 172.21.15.71:0/1560139000 shutdown_connections 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.744+0000 7fed75dff700 1 -- 172.21.15.71:0/1560139000 >> 172.21.15.71:0/1560139000 conn(0x7fed7006c150 msgr2=0x7fed7006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.744+0000 7fed75dff700 1 -- 172.21.15.71:0/1560139000 shutdown_connections 2023-07-06T01:10:27.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.744+0000 7fed75dff700 1 -- 172.21.15.71:0/1560139000 wait complete. 2023-07-06T01:10:27.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.745+0000 7fed75dff700 1 Processor -- start 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.745+0000 7fed75dff700 1 -- start start 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.746+0000 7fed75dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5c003a30 0x7fed7014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.746+0000 7fed75dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 0x7fed700cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.746+0000 7fed75dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed700ca180 0x7fed700ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.746+0000 7fed75dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700ccab0 con 0x7fed700cc100 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.746+0000 7fed75dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed700caee0 con 0x7fed700ca180 2023-07-06T01:10:27.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.746+0000 7fed75dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed700cb1c0 con 0x7fed5c003a30 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 0x7fed700cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 0x7fed700cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55204/0 (socket says 172.21.15.71:55204) 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 -- 172.21.15.71:0/971475227 learned_addr learned my addr 172.21.15.71:0/971475227 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5c003a30 0x7fed7014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed6ffff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed700ca180 0x7fed700ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 -- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5c003a30 msgr2=0x7fed7014d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5c003a30 0x7fed7014d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 -- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed700ca180 msgr2=0x7fed700ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed700ca180 0x7fed700ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 -- 172.21.15.71:0/971475227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700cb4a0 con 0x7fed700cc100 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.747+0000 7fed67fff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 0x7fed700cc570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fed5800f820 tx=0x7fed5800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.748+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580052e0 con 0x7fed700cc100 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.748+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed58005440 con 0x7fed700cc100 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.748+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580038c0 con 0x7fed700cc100 2023-07-06T01:10:27.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.748+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed700cb780 con 0x7fed700cc100 2023-07-06T01:10:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.748+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7014dae0 con 0x7fed700cc100 2023-07-06T01:10:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.749+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed700cbaf0 con 0x7fed700cc100 2023-07-06T01:10:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.750+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed58003a20 con 0x7fed700cc100 2023-07-06T01:10:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.751+0000 7fed6cff9700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fed5006ace0 0x7fed5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.751+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed58089130 con 0x7fed700cc100 2023-07-06T01:10:27.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.751+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fed5006ace0 0x7fed5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:27.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.752+0000 7fed6f7fe700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fed5006ace0 0x7fed5006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed60000c00 tx=0x7fed60007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:27.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.755+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed58054270 con 0x7fed700cc100 2023-07-06T01:10:27.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.949+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed700008d0 con 0x7fed700cc100 2023-07-06T01:10:27.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.949+0000 7fed6cff9700 1 -- 172.21.15.71:0/971475227 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed58057890 con 0x7fed700cc100 2023-07-06T01:10:27.952 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:10:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fed5006ace0 msgr2=0x7fed5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fed5006ace0 0x7fed5006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed60000c00 tx=0x7fed60007000 comp rx=0 tx=0).stop 2023-07-06T01:10:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 msgr2=0x7fed700cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 0x7fed700cc570 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fed5800f820 tx=0x7fed5800fb30 comp rx=0 tx=0).stop 2023-07-06T01:10:27.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 shutdown_connections 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fed5006ace0 0x7fed5006d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed700ca180 0x7fed700ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5c003a30 0x7fed7014d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 --2- 172.21.15.71:0/971475227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed700cc100 0x7fed700cc570 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 >> 172.21.15.71:0/971475227 conn(0x7fed7006c150 msgr2=0x7fed700d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.951+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 shutdown_connections 2023-07-06T01:10:27.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:27.952+0000 7fed75dff700 1 -- 172.21.15.71:0/971475227 wait complete. 2023-07-06T01:10:27.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T01:10:28.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.165+0000 7fd20cfff700 1 Processor -- start 2023-07-06T01:10:28.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.165+0000 7fd20cfff700 1 -- start start 2023-07-06T01:10:28.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.166+0000 7fd20cfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd20815fca0 0x7fd2080d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.166+0000 7fd20cfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2080b5c90 0x7fd2080d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.166+0000 7fd20cfff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2080cf780 con 0x7fd2080b6100 2023-07-06T01:10:28.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.166+0000 7fd20cfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080cd490 con 0x7fd2080b5c90 2023-07-06T01:10:28.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.166+0000 7fd20cfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080cd770 con 0x7fd20815fca0 2023-07-06T01:10:28.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2080b5c90 0x7fd2080d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd2080b5c90 0x7fd2080d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55212/0 (socket says 172.21.15.71:55212) 2023-07-06T01:10:28.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 -- 172.21.15.71:0/2392732483 learned_addr learned my addr 172.21.15.71:0/2392732483 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:28.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd20659c700 1 --2- 172.21.15.71:0/2392732483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd20815fca0 0x7fd2080d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 -- 172.21.15.71:0/2392732483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd20815fca0 msgr2=0x7fd2080d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 --2- 172.21.15.71:0/2392732483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd20815fca0 0x7fd2080d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 -- 172.21.15.71:0/2392732483 >> v1:172.21.15.194:6789/0 conn(0x7fd2080b6100 legacy=0x7fd2080cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 -- 172.21.15.71:0/2392732483 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080cda50 con 0x7fd2080b5c90 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.167+0000 7fd1fffff700 1 --2- 172.21.15.71:0/2392732483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2080b5c90 0x7fd2080d2d40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098f0 tx=0x7fd1f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d271460bcb99cbd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd205d9b700 1 -- 172.21.15.71:0/2392732483 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000b8a0 con 0x7fd2080b5c90 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd205d9b700 1 -- 172.21.15.71:0/2392732483 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000ba00 con 0x7fd2080b5c90 2023-07-06T01:10:28.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd205d9b700 1 -- 172.21.15.71:0/2392732483 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000bd90 con 0x7fd2080b5c90 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 -- 172.21.15.71:0/2392732483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2080b5c90 msgr2=0x7fd2080d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2392732483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2080b5c90 0x7fd2080d2d40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00098f0 tx=0x7fd1f0009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 -- 172.21.15.71:0/2392732483 shutdown_connections 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2392732483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd20815fca0 0x7fd2080d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2392732483 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2080b5c90 0x7fd2080d2d40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 -- 172.21.15.71:0/2392732483 >> 172.21.15.71:0/2392732483 conn(0x7fd20806c150 msgr2=0x7fd20806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 -- 172.21.15.71:0/2392732483 shutdown_connections 2023-07-06T01:10:28.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.168+0000 7fd20cfff700 1 -- 172.21.15.71:0/2392732483 wait complete. 2023-07-06T01:10:28.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.170+0000 7fd20cfff700 1 Processor -- start 2023-07-06T01:10:28.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.170+0000 7fd20cfff700 1 -- start start 2023-07-06T01:10:28.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.171+0000 7fd20cfff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2080b5c90 0x7fd20814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.171+0000 7fd20cfff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2080b6100 0x7fd20815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.171+0000 7fd20cfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 0x7fd2080b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.171+0000 7fd20cfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081e6080 con 0x7fd20815fca0 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.171+0000 7fd20cfff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081e6360 con 0x7fd2080b5c90 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.171+0000 7fd20cfff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081e6640 con 0x7fd2080b6100 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 0x7fd2080b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 0x7fd2080b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55214/0 (socket says 172.21.15.71:55214) 2023-07-06T01:10:28.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 -- 172.21.15.71:0/2091285166 learned_addr learned my addr 172.21.15.71:0/2091285166 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd20659c700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2080b5c90 0x7fd20814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd1fffff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2080b6100 0x7fd20815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 -- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2080b6100 msgr2=0x7fd20815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2080b6100 0x7fd20815e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 -- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2080b5c90 msgr2=0x7fd20814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2080b5c90 0x7fd20814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 -- 172.21.15.71:0/2091285166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0009550 con 0x7fd20815fca0 2023-07-06T01:10:28.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd1fffff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2080b6100 0x7fd20815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd20659c700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2080b5c90 0x7fd20814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd206d9d700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 0x7fd2080b2f20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd20000cbc0 tx=0x7fd20000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.172+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200003c00 con 0x7fd20815fca0 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.173+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200003d60 con 0x7fd20815fca0 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.173+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081e6920 con 0x7fd20815fca0 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.173+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000abf0 con 0x7fd20815fca0 2023-07-06T01:10:28.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.173+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208159690 con 0x7fd20815fca0 2023-07-06T01:10:28.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.174+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208159c40 con 0x7fd20815fca0 2023-07-06T01:10:28.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.175+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd20000ad50 con 0x7fd20815fca0 2023-07-06T01:10:28.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.176+0000 7fd1feffd700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd1e806ace0 0x7fd1e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.176+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2000894d0 con 0x7fd20815fca0 2023-07-06T01:10:28.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.177+0000 7fd20659c700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd1e806ace0 0x7fd1e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.177+0000 7fd20659c700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd1e806ace0 0x7fd1e806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800ba70 tx=0x7fd1f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:28.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.180+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd208159c40 con 0x7fd20815fca0 2023-07-06T01:10:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.389+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2081e6e40 con 0x7fd20815fca0 2023-07-06T01:10:28.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.390+0000 7fd1feffd700 1 -- 172.21.15.71:0/2091285166 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd2081e6e40 con 0x7fd20815fca0 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd1e806ace0 msgr2=0x7fd1e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd1e806ace0 0x7fd1e806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800ba70 tx=0x7fd1f8008040 comp rx=0 tx=0).stop 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 msgr2=0x7fd2080b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 0x7fd2080b2f20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd20000cbc0 tx=0x7fd20000cf80 comp rx=0 tx=0).stop 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 shutdown_connections 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fd1e806ace0 0x7fd1e806d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd20815fca0 0x7fd2080b2f20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2080b5c90 0x7fd20814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 --2- 172.21.15.71:0/2091285166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2080b6100 0x7fd20815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 >> 172.21.15.71:0/2091285166 conn(0x7fd20806c150 msgr2=0x7fd2080d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 shutdown_connections 2023-07-06T01:10:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.392+0000 7fd20cfff700 1 -- 172.21.15.71:0/2091285166 wait complete. 2023-07-06T01:10:28.396 INFO:teuthology.orchestra.run.smithi071.stderr:listed 0 entries 2023-07-06T01:10:28.412 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-06T01:10:28.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:28.413 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-06T01:10:28.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:10:28.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:28.508 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-06T01:10:28.555 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:10:28.556 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:28.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-06T01:10:28.602 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:10:28.602 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:28.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345700k,nr_inodes=4086425,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T01:10:28.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:10:28.844 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.842+0000 7f83099ff700 1 Processor -- start 2023-07-06T01:10:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.842+0000 7f83099ff700 1 -- start start 2023-07-06T01:10:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.843+0000 7f83099ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415fca0 0x7f83040d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.843+0000 7f83099ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f83040b5c90 0x7f83040d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.843+0000 7f83099ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83040cf780 con 0x7f83040b6100 2023-07-06T01:10:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.843+0000 7f83099ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040cd490 con 0x7f83040b5c90 2023-07-06T01:10:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.843+0000 7f83099ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040cd770 con 0x7f830415fca0 2023-07-06T01:10:28.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f8302ffd700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415fca0 0x7f83040d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f83037fe700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f83040b6100 0x7f83040cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:59022/0 (socket says 172.21.15.71:59022) 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f83037fe700 1 -- 172.21.15.71:0/205646027 learned_addr learned my addr 172.21.15.71:0/205646027 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f83027fc700 1 --2- 172.21.15.71:0/205646027 >> v2:172.21.15.194:3300/0 conn(0x7f83040b5c90 0x7f83040d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f8301ffb700 1 -- 172.21.15.71:0/205646027 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769876442 0 0) 0x7f83040cf780 con 0x7f83040b6100 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f8302ffd700 1 -- 172.21.15.71:0/205646027 >> v2:172.21.15.194:3300/0 conn(0x7f83040b5c90 msgr2=0x7f83040d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f8302ffd700 1 --2- 172.21.15.71:0/205646027 >> v2:172.21.15.194:3300/0 conn(0x7f83040b5c90 0x7f83040d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f8302ffd700 1 -- 172.21.15.71:0/205646027 >> v1:172.21.15.194:6789/0 conn(0x7f83040b6100 legacy=0x7f83040cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.844+0000 7f8302ffd700 1 -- 172.21.15.71:0/205646027 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040cda50 con 0x7f830415fca0 2023-07-06T01:10:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.845+0000 7f8302ffd700 1 --2- 172.21.15.71:0/205646027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415fca0 0x7f83040d1420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009840 tx=0x7f82f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e73b77084540618 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.845+0000 7f8301ffb700 1 -- 172.21.15.71:0/205646027 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4011830 con 0x7f830415fca0 2023-07-06T01:10:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.845+0000 7f8301ffb700 1 -- 172.21.15.71:0/205646027 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f4011990 con 0x7f830415fca0 2023-07-06T01:10:28.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.845+0000 7f8301ffb700 1 -- 172.21.15.71:0/205646027 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4011d20 con 0x7f830415fca0 2023-07-06T01:10:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.845+0000 7f83099ff700 1 -- 172.21.15.71:0/205646027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415fca0 msgr2=0x7f83040d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 --2- 172.21.15.71:0/205646027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415fca0 0x7f83040d1420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009840 tx=0x7f82f4009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 -- 172.21.15.71:0/205646027 shutdown_connections 2023-07-06T01:10:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 --2- 172.21.15.71:0/205646027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415fca0 0x7f83040d1420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 --2- 172.21.15.71:0/205646027 >> v2:172.21.15.194:3300/0 conn(0x7f83040b5c90 0x7f83040d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 -- 172.21.15.71:0/205646027 >> 172.21.15.71:0/205646027 conn(0x7f830406c150 msgr2=0x7f830406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 -- 172.21.15.71:0/205646027 shutdown_connections 2023-07-06T01:10:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.846+0000 7f83099ff700 1 -- 172.21.15.71:0/205646027 wait complete. 2023-07-06T01:10:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.848+0000 7f83099ff700 1 Processor -- start 2023-07-06T01:10:28.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.848+0000 7f83099ff700 1 -- start start 2023-07-06T01:10:28.852 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83099ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 0x7f83040b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83099ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83040b6100 0x7f83040b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83099ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f830415fca0 0x7f8304153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83099ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830415d190 con 0x7f830415fca0 2023-07-06T01:10:28.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83099ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040b3ab0 con 0x7f83040b5c90 2023-07-06T01:10:28.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83099ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040b42f0 con 0x7f83040b6100 2023-07-06T01:10:28.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83037fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f830415fca0 0x7f8304153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 0x7f83040b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 0x7f83040b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.71:58370/0 (socket says 172.21.15.71:58370) 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 -- 172.21.15.71:0/336749336 learned_addr learned my addr 172.21.15.71:0/336749336 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f83027fc700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83040b6100 0x7f83040b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 -- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83040b6100 msgr2=0x7f83040b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83040b6100 0x7f83040b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 -- 172.21.15.71:0/336749336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f830415fca0 msgr2=0x7f8304153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:28.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f830415fca0 0x7f8304153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.849+0000 7f8302ffd700 1 -- 172.21.15.71:0/336749336 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f40094a0 con 0x7f83040b5c90 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.850+0000 7f8302ffd700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 0x7f83040b3570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82f4014040 tx=0x7f82f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.850+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f4004550 con 0x7f83040b5c90 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.850+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f401f070 con 0x7f83040b5c90 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.850+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83040b3d30 con 0x7f83040b5c90 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.850+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f40038c0 con 0x7f83040b5c90 2023-07-06T01:10:28.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.850+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8304155000 con 0x7f83040b5c90 2023-07-06T01:10:28.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.851+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83040008d0 con 0x7f83040b5c90 2023-07-06T01:10:28.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.852+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82f4003a20 con 0x7f83040b5c90 2023-07-06T01:10:28.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.853+0000 7f82ebfff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82f006ace0 0x7f82f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:28.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.853+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82f4021070 con 0x7f83040b5c90 2023-07-06T01:10:28.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.853+0000 7f83027fc700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82f006ace0 0x7f82f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:28.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.854+0000 7f83027fc700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82f006ace0 0x7f82f006d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f83041f5940 tx=0x7f82f8009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:28.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:28.859+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f82f4055d00 con 0x7f83040b5c90 2023-07-06T01:10:29.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.094+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f830415f4c0 con 0x7f83040b5c90 2023-07-06T01:10:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.095+0000 7f82ebfff700 1 -- 172.21.15.71:0/336749336 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f82f4015090 con 0x7f83040b5c90 2023-07-06T01:10:29.097 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:29.097 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:10:07.271274+0000","modified":"2023-07-06T01:10:10.810493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6835/783929387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":783929387},{"type":"v1","addr":"172.21.15.71:6835","nonce":783929387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T01:10:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82f006ace0 msgr2=0x7f82f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82f006ace0 0x7f82f006d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f83041f5940 tx=0x7f82f8009210 comp rx=0 tx=0).stop 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 msgr2=0x7f83040b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 0x7f83040b3570 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f82f4014040 tx=0x7f82f4004750 comp rx=0 tx=0).stop 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 shutdown_connections 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f82f006ace0 0x7f82f006d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f830415fca0 0x7f8304153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83040b5c90 0x7f83040b3570 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 --2- 172.21.15.71:0/336749336 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83040b6100 0x7f83040b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 >> 172.21.15.71:0/336749336 conn(0x7f830406c150 msgr2=0x7f83040d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 shutdown_connections 2023-07-06T01:10:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.097+0000 7f83099ff700 1 -- 172.21.15.71:0/336749336 wait complete. 2023-07-06T01:10:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 16 2023-07-06T01:10:29.117 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:29.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.309+0000 7f8ad39ff700 1 Processor -- start 2023-07-06T01:10:29.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.309+0000 7f8ad39ff700 1 -- start start 2023-07-06T01:10:29.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.310+0000 7f8ad39ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8acc0cfe80 0x7f8acc0b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.310+0000 7f8ad39ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0d1370 con 0x7f8acc0ceed0 2023-07-06T01:10:29.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.310+0000 7f8ad39ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0d1650 con 0x7f8acc0b8610 2023-07-06T01:10:29.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.310+0000 7f8ad39ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8acc0b8cd0 con 0x7f8acc0cfe80 2023-07-06T01:10:29.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad1f9c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f8acc0ceed0 0x7f8acc0d2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45966/0 (socket says 172.21.15.71:45966) 2023-07-06T01:10:29.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad1f9c700 1 -- 172.21.15.71:0/3023859223 learned_addr learned my addr 172.21.15.71:0/3023859223 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:29.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad0f9a700 1 --2- 172.21.15.71:0/3023859223 >> v2:172.21.15.194:3300/0 conn(0x7f8acc0cfe80 0x7f8acc0b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982353155 0 0) 0x7f8acc0d1370 con 0x7f8acc0ceed0 2023-07-06T01:10:29.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab80035b0 con 0x7f8acc0ceed0 2023-07-06T01:10:29.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697538770 0 0) 0x7f8acc0d1650 con 0x7f8acc0b8610 2023-07-06T01:10:29.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc0d1370 con 0x7f8acc0b8610 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad0f9a700 1 -- 172.21.15.71:0/3023859223 >> v1:172.21.15.194:6789/0 conn(0x7f8acc0b8610 legacy=0x7f8acc0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad0f9a700 1 -- 172.21.15.71:0/3023859223 >> v1:172.21.15.71:6789/0 conn(0x7f8acc0ceed0 legacy=0x7f8acc0d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad0f9a700 1 -- 172.21.15.71:0/3023859223 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0cd580 con 0x7f8acc0cfe80 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.311+0000 7f8ad0f9a700 1 --2- 172.21.15.71:0/3023859223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0cfe80 0x7f8acc0b2180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009840 tx=0x7f8abc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7940fc8d4e43b31 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc011830 con 0x7f8acc0cfe80 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc011990 con 0x7f8acc0cfe80 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ac3fff700 1 -- 172.21.15.71:0/3023859223 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc011d20 con 0x7f8acc0cfe80 2023-07-06T01:10:29.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 -- 172.21.15.71:0/3023859223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0cfe80 msgr2=0x7f8acc0b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/3023859223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0cfe80 0x7f8acc0b2180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009840 tx=0x7f8abc009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:29.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 -- 172.21.15.71:0/3023859223 shutdown_connections 2023-07-06T01:10:29.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/3023859223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0cfe80 0x7f8acc0b2180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 -- 172.21.15.71:0/3023859223 >> 172.21.15.71:0/3023859223 conn(0x7f8acc071690 msgr2=0x7f8acc071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:29.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 -- 172.21.15.71:0/3023859223 shutdown_connections 2023-07-06T01:10:29.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.312+0000 7f8ad39ff700 1 -- 172.21.15.71:0/3023859223 wait complete. 2023-07-06T01:10:29.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.314+0000 7f8ad39ff700 1 Processor -- start 2023-07-06T01:10:29.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.314+0000 7f8ad39ff700 1 -- start start 2023-07-06T01:10:29.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad39ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 0x7f8acc1e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad39ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0ceed0 0x7f8acc0cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad39ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8acc0cfe80 0x7f8acc15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad39ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1e8940 con 0x7f8acc0b8610 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad39ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1566e0 con 0x7f8acc0ceed0 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad39ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc1e7360 con 0x7f8acc0cfe80 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 0x7f8acc1e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad179b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 0x7f8acc1e8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55242/0 (socket says 172.21.15.71:55242) 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.315+0000 7f8ad179b700 1 -- 172.21.15.71:0/382468074 learned_addr learned my addr 172.21.15.71:0/382468074 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad0f9a700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0ceed0 0x7f8acc0cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad1f9c700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8acc0cfe80 0x7f8acc15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad179b700 1 -- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8acc0cfe80 msgr2=0x7f8acc15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad179b700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8acc0cfe80 0x7f8acc15f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad179b700 1 -- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0ceed0 msgr2=0x7f8acc0cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad179b700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0ceed0 0x7f8acc0cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad179b700 1 -- 172.21.15.71:0/382468074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0094a0 con 0x7f8acc0b8610 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad0f9a700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0ceed0 0x7f8acc0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad179b700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 0x7f8acc1e8400 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800c520 tx=0x7f8ac800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80052d0 con 0x7f8acc0b8610 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8005430 con 0x7f8acc0b8610 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc1e7640 con 0x7f8acc0b8610 2023-07-06T01:10:29.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80038c0 con 0x7f8acc0b8610 2023-07-06T01:10:29.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.316+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc1e7c00 con 0x7f8acc0b8610 2023-07-06T01:10:29.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.317+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc0008d0 con 0x7f8acc0b8610 2023-07-06T01:10:29.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.318+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ac8003a20 con 0x7f8acc0b8610 2023-07-06T01:10:29.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.320+0000 7f8ac1ffb700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.320+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ac8088a40 con 0x7f8acc0b8610 2023-07-06T01:10:29.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.320+0000 7f8ad0f9a700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.321+0000 7f8ad0f9a700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009fd0 tx=0x7f8abc01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:29.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.325+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8ac8053ae0 con 0x7f8acc0b8610 2023-07-06T01:10:29.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.520+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8acc0b5120 con 0x7f8acc0b8610 2023-07-06T01:10:29.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.522+0000 7f8ac1ffb700 1 -- 172.21.15.71:0/382468074 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f8ac8057100 con 0x7f8acc0b8610 2023-07-06T01:10:29.524 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:29.525 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":36,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:08.799855+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 msgr2=0x7f8ab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009fd0 tx=0x7f8abc01c040 comp rx=0 tx=0).stop 2023-07-06T01:10:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 msgr2=0x7f8acc1e8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 0x7f8acc1e8400 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800c520 tx=0x7f8ac800c8e0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 shutdown_connections 2023-07-06T01:10:29.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f8ab006ace0 0x7f8ab006d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8acc0cfe80 0x7f8acc15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8acc0b8610 0x7f8acc1e8400 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 --2- 172.21.15.71:0/382468074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8acc0ceed0 0x7f8acc0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 >> 172.21.15.71:0/382468074 conn(0x7f8acc071690 msgr2=0x7f8acc0b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 shutdown_connections 2023-07-06T01:10:29.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.524+0000 7f8ad39ff700 1 -- 172.21.15.71:0/382468074 wait complete. 2023-07-06T01:10:29.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T01:08:36.877828+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T01:08:43.496374+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T01:10:05.447038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T01:10:06.255735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T01:10:29.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T01:10:29.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.740+0000 7fa0c5fff700 1 Processor -- start 2023-07-06T01:10:29.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.740+0000 7fa0c5fff700 1 -- start start 2023-07-06T01:10:29.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.741+0000 7fa0c5fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa0c00c9010 0x7fa0c006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.741+0000 7fa0c5fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00cd370 con 0x7fa0c0158cd0 2023-07-06T01:10:29.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.741+0000 7fa0c5fff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00ad7f0 con 0x7fa0c00adba0 2023-07-06T01:10:29.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.741+0000 7fa0c5fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c00cbf50 con 0x7fa0c00c9010 2023-07-06T01:10:29.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.741+0000 7fa0bf7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa0c0158cd0 0x7fa0c00cdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45968/0 (socket says 172.21.15.71:45968) 2023-07-06T01:10:29.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0bf7fe700 1 -- 172.21.15.71:0/2117266106 learned_addr learned my addr 172.21.15.71:0/2117266106 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310731433 0 0) 0x7fa0c00cd370 con 0x7fa0c0158cd0 2023-07-06T01:10:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0beffd700 1 --2- 172.21.15.71:0/2117266106 >> v2:172.21.15.194:3300/0 conn(0x7fa0c00c9010 0x7fa0c006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a80035b0 con 0x7fa0c0158cd0 2023-07-06T01:10:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4005615850 0 0) 0x7fa0a80035b0 con 0x7fa0c0158cd0 2023-07-06T01:10:29.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 >> v2:172.21.15.194:3300/0 conn(0x7fa0c00c9010 msgr2=0x7fa0c006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 --2- 172.21.15.71:0/2117266106 >> v2:172.21.15.194:3300/0 conn(0x7fa0c00c9010 0x7fa0c006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 >> v1:172.21.15.194:6789/0 conn(0x7fa0c00adba0 legacy=0x7fa0c00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00cc160 con 0x7fa0c0158cd0 2023-07-06T01:10:29.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fa0b0001670 con 0x7fa0c0158cd0 2023-07-06T01:10:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 >> v1:172.21.15.71:6789/0 conn(0x7fa0c0158cd0 legacy=0x7fa0c00cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0a8003a00 0x7fa0a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0a80043f0 0x7fa0a80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.742+0000 7fa0be7fc700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80050b0 0x7fa0a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00cbf50 con 0x7fa0a80043f0 2023-07-06T01:10:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a800c000 con 0x7fa0a8003a00 2023-07-06T01:10:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a800c1c0 con 0x7fa0a80050b0 2023-07-06T01:10:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0a80043f0 0x7fa0a80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0bf7fe700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0a8003a00 0x7fa0a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0bffff700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80050b0 0x7fa0a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 -- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80050b0 msgr2=0x7fa0a800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80050b0 0x7fa0a800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 -- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0a8003a00 msgr2=0x7fa0a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0a8003a00 0x7fa0a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 -- 172.21.15.71:0/2117266106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a80035b0 con 0x7fa0a80043f0 2023-07-06T01:10:29.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0bffff700 1 -- 172.21.15.71:0/2117266106 reap_dead start 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.743+0000 7fa0beffd700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0a80043f0 0x7fa0a80048b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400bfc0 tx=0x7fa0a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6118c6643eb030bf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4010c30 con 0x7fa0a80043f0 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4011040 con 0x7fa0a80043f0 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0be7fc700 1 -- 172.21.15.71:0/2117266106 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4016480 con 0x7fa0a80043f0 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 -- 172.21.15.71:0/2117266106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0a80043f0 msgr2=0x7fa0a80048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0a80043f0 0x7fa0a80048b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400bfc0 tx=0x7fa0a8005880 comp rx=0 tx=0).stop 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 -- 172.21.15.71:0/2117266106 shutdown_connections 2023-07-06T01:10:29.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/2117266106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0a80043f0 0x7fa0a80048b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 -- 172.21.15.71:0/2117266106 >> 172.21.15.71:0/2117266106 conn(0x7fa0c00cb440 msgr2=0x7fa0c00cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 -- 172.21.15.71:0/2117266106 shutdown_connections 2023-07-06T01:10:29.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.744+0000 7fa0c5fff700 1 -- 172.21.15.71:0/2117266106 wait complete. 2023-07-06T01:10:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.746+0000 7fa0c5fff700 1 Processor -- start 2023-07-06T01:10:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.746+0000 7fa0c5fff700 1 -- start start 2023-07-06T01:10:29.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0c5fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80043f0 0x7fa0c01592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0c5fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0c00b4560 0x7fa0c0151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0c5fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 0x7fa0c01f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0c5fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c01f18c0 con 0x7fa0c01f0f10 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0c5fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c006c920 con 0x7fa0c00b4560 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0c5fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0152130 con 0x7fa0a80043f0 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.747+0000 7fa0bffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 0x7fa0c01f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 0x7fa0c01f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55262/0 (socket says 172.21.15.71:55262) 2023-07-06T01:10:29.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 -- 172.21.15.71:0/1472191809 learned_addr learned my addr 172.21.15.71:0/1472191809 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bf7fe700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80043f0 0x7fa0c01592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0beffd700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0c00b4560 0x7fa0c0151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 -- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80043f0 msgr2=0x7fa0c01592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80043f0 0x7fa0c01592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 -- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0c00b4560 msgr2=0x7fa0c0151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0c00b4560 0x7fa0c0151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 -- 172.21.15.71:0/1472191809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0159e70 con 0x7fa0c01f0f10 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0beffd700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0c00b4560 0x7fa0c0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0bffff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 0x7fa0c01f1380 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa0c006d2f0 tx=0x7fa0b800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8003c10 con 0x7fa0c01f0f10 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8003d90 con 0x7fa0c01f0f10 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800c930 con 0x7fa0c01f0f10 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.748+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c006c2d0 con 0x7fa0c01f0f10 2023-07-06T01:10:29.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.749+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c015a150 con 0x7fa0c01f0f10 2023-07-06T01:10:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.749+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c00008d0 con 0x7fa0c01f0f10 2023-07-06T01:10:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.751+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0b800ca90 con 0x7fa0c01f0f10 2023-07-06T01:10:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.751+0000 7fa0a7fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa0ac06ace0 0x7fa0ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.752+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0b8089510 con 0x7fa0c01f0f10 2023-07-06T01:10:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.752+0000 7fa0bf7fe700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa0ac06ace0 0x7fa0ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:29.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.753+0000 7fa0bf7fe700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa0ac06ace0 0x7fa0ac06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa0c01f0e70 tx=0x7fa0b0001590 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:29.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.756+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0b8054650 con 0x7fa0c01f0f10 2023-07-06T01:10:29.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.950+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0c00b4940 con 0x7fa0c01f0f10 2023-07-06T01:10:29.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.950+0000 7fa0a7fff700 1 -- 172.21.15.71:0/1472191809 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0b8057c70 con 0x7fa0c01f0f10 2023-07-06T01:10:29.953 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-07-06T01:10:29.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa0ac06ace0 msgr2=0x7fa0ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa0ac06ace0 0x7fa0ac06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa0c01f0e70 tx=0x7fa0b0001590 comp rx=0 tx=0).stop 2023-07-06T01:10:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 msgr2=0x7fa0c01f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:29.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 0x7fa0c01f1380 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa0c006d2f0 tx=0x7fa0b800ee90 comp rx=0 tx=0).stop 2023-07-06T01:10:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 shutdown_connections 2023-07-06T01:10:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa0ac06ace0 0x7fa0ac06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0c01f0f10 0x7fa0c01f1380 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0a80043f0 0x7fa0c01592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 --2- 172.21.15.71:0/1472191809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0c00b4560 0x7fa0c0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:29.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.952+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 >> 172.21.15.71:0/1472191809 conn(0x7fa0c00cb440 msgr2=0x7fa0c0154440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:29.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.953+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 shutdown_connections 2023-07-06T01:10:29.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:29.953+0000 7fa0c5fff700 1 -- 172.21.15.71:0/1472191809 wait complete. 2023-07-06T01:10:29.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T01:10:30.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.166+0000 7fcb16fff700 1 Processor -- start 2023-07-06T01:10:30.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.166+0000 7fcb16fff700 1 -- start start 2023-07-06T01:10:30.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb16fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb16fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcb1015dc80 0x7fcb100d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb16fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1006cb60 con 0x7fcb10160640 2023-07-06T01:10:30.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb16fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb101613a0 con 0x7fcb1015dc80 2023-07-06T01:10:30.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb16fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1006c230 con 0x7fcb1015d8b0 2023-07-06T01:10:30.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb1559c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcb10160640 0x7fcb10160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45976/0 (socket says 172.21.15.71:45976) 2023-07-06T01:10:30.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb1559c700 1 -- 172.21.15.71:0/1921180179 learned_addr learned my addr 172.21.15.71:0/1921180179 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:30.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb14d9b700 1 --2- 172.21.15.71:0/1921180179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb0ffff700 1 --2- 172.21.15.71:0/1921180179 >> v2:172.21.15.194:3300/0 conn(0x7fcb1015dc80 0x7fcb100d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb0f7fe700 1 -- 172.21.15.71:0/1921180179 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573584710 0 0) 0x7fcb1006cb60 con 0x7fcb10160640 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.168+0000 7fcb0f7fe700 1 -- 172.21.15.71:0/1921180179 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb000035b0 con 0x7fcb10160640 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb14d9b700 1 -- 172.21.15.71:0/1921180179 >> v2:172.21.15.194:3300/0 conn(0x7fcb1015dc80 msgr2=0x7fcb100d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb14d9b700 1 --2- 172.21.15.71:0/1921180179 >> v2:172.21.15.194:3300/0 conn(0x7fcb1015dc80 0x7fcb100d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb14d9b700 1 -- 172.21.15.71:0/1921180179 >> v1:172.21.15.71:6789/0 conn(0x7fcb10160640 legacy=0x7fcb10160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb14d9b700 1 -- 172.21.15.71:0/1921180179 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1006c510 con 0x7fcb1015d8b0 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb14d9b700 1 --2- 172.21.15.71:0/1921180179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100d0b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009840 tx=0x7fcb04009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb97a52a535d4b66 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb0f7fe700 1 -- 172.21.15.71:0/1921180179 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04011830 con 0x7fcb1015d8b0 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb0f7fe700 1 -- 172.21.15.71:0/1921180179 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04011990 con 0x7fcb1015d8b0 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.169+0000 7fcb0f7fe700 1 -- 172.21.15.71:0/1921180179 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04011d20 con 0x7fcb1015d8b0 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 -- 172.21.15.71:0/1921180179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 msgr2=0x7fcb100d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1921180179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100d0b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009840 tx=0x7fcb04009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:30.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 -- 172.21.15.71:0/1921180179 shutdown_connections 2023-07-06T01:10:30.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1921180179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100d0b40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1921180179 >> v2:172.21.15.194:3300/0 conn(0x7fcb1015dc80 0x7fcb100d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 -- 172.21.15.71:0/1921180179 >> 172.21.15.71:0/1921180179 conn(0x7fcb1006db20 msgr2=0x7fcb1006df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:30.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 -- 172.21.15.71:0/1921180179 shutdown_connections 2023-07-06T01:10:30.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.170+0000 7fcb16fff700 1 -- 172.21.15.71:0/1921180179 wait complete. 2023-07-06T01:10:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.171+0000 7fcb16fff700 1 Processor -- start 2023-07-06T01:10:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.172+0000 7fcb16fff700 1 -- start start 2023-07-06T01:10:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.172+0000 7fcb16fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb16fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 0x7fcb10142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb16fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb10152980 0x7fcb1015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb16fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100c7230 con 0x7fcb10160640 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb16fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10142850 con 0x7fcb10152980 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb16fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1013fb20 con 0x7fcb1015d8b0 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 0x7fcb10142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 0x7fcb10142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55274/0 (socket says 172.21.15.71:55274) 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 -- 172.21.15.71:0/1892342504 learned_addr learned my addr 172.21.15.71:0/1892342504 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb14d9b700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 -- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 msgr2=0x7fcb100c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 -- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb10152980 msgr2=0x7fcb1015f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb1559c700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb10152980 0x7fcb1015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb10152980 0x7fcb1015f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb0ffff700 1 -- 172.21.15.71:0/1892342504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040094a0 con 0x7fcb10160640 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.173+0000 7fcb1559c700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb10152980 0x7fcb1015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:30.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.174+0000 7fcb0ffff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 0x7fcb10142310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e9b0 tx=0x7fcafc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.174+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc009710 con 0x7fcb10160640 2023-07-06T01:10:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.174+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00c850 con 0x7fcb10160640 2023-07-06T01:10:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.174+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb1013fdc0 con 0x7fcb10160640 2023-07-06T01:10:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.174+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00cbc0 con 0x7fcb10160640 2023-07-06T01:10:30.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.174+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb10140380 con 0x7fcb10160640 2023-07-06T01:10:30.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.175+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb10140540 con 0x7fcb10160640 2023-07-06T01:10:30.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.176+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcafc00cd20 con 0x7fcb10160640 2023-07-06T01:10:30.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.178+0000 7fcb0d7fa700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcaf406ace0 0x7fcaf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.178+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcafc089590 con 0x7fcb10160640 2023-07-06T01:10:30.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.178+0000 7fcb14d9b700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcaf406ace0 0x7fcaf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.179+0000 7fcb14d9b700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcaf406ace0 0x7fcaf406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009fd0 tx=0x7fcb04008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:30.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.182+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcafc0580c0 con 0x7fcb10160640 2023-07-06T01:10:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.375+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb1006cfd0 con 0x7fcb10160640 2023-07-06T01:10:30.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.376+0000 7fcb0d7fa700 1 -- 172.21.15.71:0/1892342504 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb1006cfd0 con 0x7fcb10160640 2023-07-06T01:10:30.379 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-07-06T01:10:30.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcaf406ace0 msgr2=0x7fcaf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcaf406ace0 0x7fcaf406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009fd0 tx=0x7fcb04008030 comp rx=0 tx=0).stop 2023-07-06T01:10:30.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 msgr2=0x7fcb10142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 0x7fcb10142310 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e9b0 tx=0x7fcafc00ed70 comp rx=0 tx=0).stop 2023-07-06T01:10:30.381 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 shutdown_connections 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fcaf406ace0 0x7fcaf406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb10152980 0x7fcb1015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb1015d8b0 0x7fcb100c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 --2- 172.21.15.71:0/1892342504 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb10160640 0x7fcb10142310 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 >> 172.21.15.71:0/1892342504 conn(0x7fcb1006db20 msgr2=0x7fcb100ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 shutdown_connections 2023-07-06T01:10:30.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.378+0000 7fcb16fff700 1 -- 172.21.15.71:0/1892342504 wait complete. 2023-07-06T01:10:30.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T01:10:30.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.594+0000 7f6e385ff700 1 Processor -- start 2023-07-06T01:10:30.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.594+0000 7f6e385ff700 1 -- start start 2023-07-06T01:10:30.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.595+0000 7f6e385ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 0x7f6e300d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.595+0000 7f6e385ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6e300b60e0 0x7f6e300d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.595+0000 7f6e385ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e300cf780 con 0x7f6e3015fca0 2023-07-06T01:10:30.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.595+0000 7f6e385ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300cd490 con 0x7f6e300b60e0 2023-07-06T01:10:30.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.595+0000 7f6e385ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300cd770 con 0x7f6e300b5c90 2023-07-06T01:10:30.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 0x7f6e300d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 0x7f6e300d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:53534/0 (socket says 172.21.15.71:53534) 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 -- 172.21.15.71:0/367142466 learned_addr learned my addr 172.21.15.71:0/367142466 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e36b9c700 1 --2- 172.21.15.71:0/367142466 >> v2:172.21.15.194:3300/0 conn(0x7f6e300b60e0 0x7f6e300d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 -- 172.21.15.71:0/367142466 >> v2:172.21.15.194:3300/0 conn(0x7f6e300b60e0 msgr2=0x7f6e300d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 --2- 172.21.15.71:0/367142466 >> v2:172.21.15.194:3300/0 conn(0x7f6e300b60e0 0x7f6e300d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 -- 172.21.15.71:0/367142466 >> v1:172.21.15.194:6789/0 conn(0x7f6e3015fca0 legacy=0x7f6e300d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 -- 172.21.15.71:0/367142466 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300cda50 con 0x7f6e300b5c90 2023-07-06T01:10:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35399700 1 -- 172.21.15.71:0/367142466 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873079865 0 0) 0x7f6e300cf780 con 0x7f6e3015fca0 2023-07-06T01:10:30.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.596+0000 7f6e35b9a700 1 --2- 172.21.15.71:0/367142466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 0x7f6e300d2d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e200098f0 tx=0x7f6e20009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917093a1a618b1e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e35399700 1 -- 172.21.15.71:0/367142466 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20011830 con 0x7f6e300b5c90 2023-07-06T01:10:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e35399700 1 -- 172.21.15.71:0/367142466 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20011990 con 0x7f6e300b5c90 2023-07-06T01:10:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e35399700 1 -- 172.21.15.71:0/367142466 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20011d20 con 0x7f6e300b5c90 2023-07-06T01:10:30.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 -- 172.21.15.71:0/367142466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 msgr2=0x7f6e300d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 --2- 172.21.15.71:0/367142466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 0x7f6e300d2d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e200098f0 tx=0x7f6e20009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 -- 172.21.15.71:0/367142466 shutdown_connections 2023-07-06T01:10:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 --2- 172.21.15.71:0/367142466 >> v2:172.21.15.194:3300/0 conn(0x7f6e300b60e0 0x7f6e300d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 --2- 172.21.15.71:0/367142466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b5c90 0x7f6e300d2d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 -- 172.21.15.71:0/367142466 >> 172.21.15.71:0/367142466 conn(0x7f6e3006c150 msgr2=0x7f6e3006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:30.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.597+0000 7f6e385ff700 1 -- 172.21.15.71:0/367142466 shutdown_connections 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.598+0000 7f6e385ff700 1 -- 172.21.15.71:0/367142466 wait complete. 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.599+0000 7f6e385ff700 1 Processor -- start 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.599+0000 7f6e385ff700 1 -- start start 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e385ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 0x7f6e300b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e385ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b60e0 0x7f6e300a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e385ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e3015fca0 0x7f6e300a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e385ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e30149160 con 0x7f6e300b5c90 2023-07-06T01:10:30.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e385ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e30149ca0 con 0x7f6e3015fca0 2023-07-06T01:10:30.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e385ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e30149370 con 0x7f6e300b60e0 2023-07-06T01:10:30.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e3639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 0x7f6e300b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e3639b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 0x7f6e300b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55288/0 (socket says 172.21.15.71:55288) 2023-07-06T01:10:30.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.600+0000 7f6e3639b700 1 -- 172.21.15.71:0/1722707932 learned_addr learned my addr 172.21.15.71:0/1722707932 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:30.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e35b9a700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b60e0 0x7f6e300a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e36b9c700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e3015fca0 0x7f6e300a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e3639b700 1 -- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b60e0 msgr2=0x7f6e300a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e3639b700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b60e0 0x7f6e300a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e3639b700 1 -- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e3015fca0 msgr2=0x7f6e300a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e3639b700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e3015fca0 0x7f6e300a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e3639b700 1 -- 172.21.15.71:0/1722707932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009550 con 0x7f6e300b5c90 2023-07-06T01:10:30.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e3639b700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 0x7f6e300b2070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c550 tx=0x7f6e2c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:30.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c0054e0 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2c003680 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e30149650 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.601+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c003a30 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.602+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e300b25b0 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.603+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e300008d0 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.604+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e2c003b90 con 0x7f6e300b5c90 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.604+0000 7f6e26ffd700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e1406ace0 0x7f6e1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:30.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.605+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e2c0887c0 con 0x7f6e300b5c90 2023-07-06T01:10:30.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.605+0000 7f6e35b9a700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e1406ace0 0x7f6e1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:30.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.606+0000 7f6e35b9a700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e1406ace0 0x7f6e1406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009c40 tx=0x7f6e20008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:30.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.609+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e2c053870 con 0x7f6e300b5c90 2023-07-06T01:10:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.805+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e300cc3f0 con 0x7f6e300b5c90 2023-07-06T01:10:30.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.806+0000 7f6e26ffd700 1 -- 172.21.15.71:0/1722707932 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e2c056e90 con 0x7f6e300b5c90 2023-07-06T01:10:30.809 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-07-06T01:10:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e1406ace0 msgr2=0x7f6e1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e1406ace0 0x7f6e1406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009c40 tx=0x7f6e20008030 comp rx=0 tx=0).stop 2023-07-06T01:10:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 msgr2=0x7f6e300b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 0x7f6e300b2070 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c550 tx=0x7f6e2c00c860 comp rx=0 tx=0).stop 2023-07-06T01:10:30.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 shutdown_connections 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f6e1406ace0 0x7f6e1406d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e3015fca0 0x7f6e300a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e300b5c90 0x7f6e300b2070 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 --2- 172.21.15.71:0/1722707932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e300b60e0 0x7f6e300a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 >> 172.21.15.71:0/1722707932 conn(0x7f6e3006c150 msgr2=0x7f6e300cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.808+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 shutdown_connections 2023-07-06T01:10:30.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:30.809+0000 7f6e385ff700 1 -- 172.21.15.71:0/1722707932 wait complete. 2023-07-06T01:10:30.829 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T01:10:31.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.022+0000 7f34999ff700 1 Processor -- start 2023-07-06T01:10:31.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.022+0000 7f34999ff700 1 -- start start 2023-07-06T01:10:31.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.023+0000 7f34999ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f349415fca0 0x7f34940d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.023+0000 7f34999ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34940b6110 0x7f34940cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.023+0000 7f34999ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940cf780 con 0x7f34940b5c90 2023-07-06T01:10:31.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.023+0000 7f34999ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940cd490 con 0x7f34940b6110 2023-07-06T01:10:31.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.023+0000 7f34999ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940cd770 con 0x7f349415fca0 2023-07-06T01:10:31.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34937fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f34940b6110 0x7f34940cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34927fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f34940b5c90 0x7f34940d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45978/0 (socket says 172.21.15.71:45978) 2023-07-06T01:10:31.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34927fc700 1 -- 172.21.15.71:0/1251124000 learned_addr learned my addr 172.21.15.71:0/1251124000 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:31.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f3492ffd700 1 --2- 172.21.15.71:0/1251124000 >> v2:172.21.15.194:3300/0 conn(0x7f349415fca0 0x7f34940d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34937fe700 1 -- 172.21.15.71:0/1251124000 >> v2:172.21.15.194:3300/0 conn(0x7f349415fca0 msgr2=0x7f34940d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:31.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34937fe700 1 --2- 172.21.15.71:0/1251124000 >> v2:172.21.15.194:3300/0 conn(0x7f349415fca0 0x7f34940d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34937fe700 1 -- 172.21.15.71:0/1251124000 >> v1:172.21.15.71:6789/0 conn(0x7f34940b5c90 legacy=0x7f34940d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34937fe700 1 -- 172.21.15.71:0/1251124000 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940cda50 con 0x7f34940b6110 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.024+0000 7f34937fe700 1 --2- 172.21.15.71:0/1251124000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34940b6110 0x7f34940cfc10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34940d0930 tx=0x7f348c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138055a54eecc7ff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f3491ffb700 1 -- 172.21.15.71:0/1251124000 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00e070 con 0x7f34940b6110 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f3491ffb700 1 -- 172.21.15.71:0/1251124000 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00bbd0 con 0x7f34940b6110 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f3491ffb700 1 -- 172.21.15.71:0/1251124000 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c012430 con 0x7f34940b6110 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 -- 172.21.15.71:0/1251124000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34940b6110 msgr2=0x7f34940cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 --2- 172.21.15.71:0/1251124000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34940b6110 0x7f34940cfc10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f34940d0930 tx=0x7f348c00b330 comp rx=0 tx=0).stop 2023-07-06T01:10:31.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 -- 172.21.15.71:0/1251124000 shutdown_connections 2023-07-06T01:10:31.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 --2- 172.21.15.71:0/1251124000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34940b6110 0x7f34940cfc10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 --2- 172.21.15.71:0/1251124000 >> v2:172.21.15.194:3300/0 conn(0x7f349415fca0 0x7f34940d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 -- 172.21.15.71:0/1251124000 >> 172.21.15.71:0/1251124000 conn(0x7f349406c150 msgr2=0x7f349406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:31.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 -- 172.21.15.71:0/1251124000 shutdown_connections 2023-07-06T01:10:31.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.025+0000 7f34999ff700 1 -- 172.21.15.71:0/1251124000 wait complete. 2023-07-06T01:10:31.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.027+0000 7f34999ff700 1 Processor -- start 2023-07-06T01:10:31.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.027+0000 7f34999ff700 1 -- start start 2023-07-06T01:10:31.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34999ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34940b5c90 0x7f3494157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34999ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34940b6110 0x7f3494157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34999ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 0x7f349415da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34999ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3494157960 con 0x7f349415fca0 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34999ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940caec0 con 0x7f34940b5c90 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34999ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940ca2b0 con 0x7f34940b6110 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34937fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 0x7f349415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34937fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 0x7f349415da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55300/0 (socket says 172.21.15.71:55300) 2023-07-06T01:10:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.028+0000 7f34937fe700 1 -- 172.21.15.71:0/3371303517 learned_addr learned my addr 172.21.15.71:0/3371303517 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34927fc700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34940b6110 0x7f3494157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34937fe700 1 -- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34940b6110 msgr2=0x7f3494157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f3492ffd700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34940b5c90 0x7f3494157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34937fe700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34940b6110 0x7f3494157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34937fe700 1 -- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34940b5c90 msgr2=0x7f3494157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34937fe700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34940b5c90 0x7f3494157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34937fe700 1 -- 172.21.15.71:0/3371303517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c009a70 con 0x7f349415fca0 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34927fc700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34940b6110 0x7f3494157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f3492ffd700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34940b5c90 0x7f3494157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34937fe700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 0x7f349415da10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f348c014040 tx=0x7f348c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c012430 con 0x7f349415fca0 2023-07-06T01:10:31.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c020070 con 0x7f349415fca0 2023-07-06T01:10:31.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c004280 con 0x7f349415fca0 2023-07-06T01:10:31.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.029+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34940ca590 con 0x7f349415fca0 2023-07-06T01:10:31.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.030+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940cab50 con 0x7f349415fca0 2023-07-06T01:10:31.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.031+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34940cad10 con 0x7f349415fca0 2023-07-06T01:10:31.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.031+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f348c0043e0 con 0x7f349415fca0 2023-07-06T01:10:31.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.032+0000 7f347bfff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f348006ace0 0x7f348006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.032+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f348c022070 con 0x7f349415fca0 2023-07-06T01:10:31.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.033+0000 7f3492ffd700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f348006ace0 0x7f348006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.034+0000 7f3492ffd700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f348006ace0 0x7f348006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f349415ad00 tx=0x7f3484008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.037+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f348c056360 con 0x7f349415fca0 2023-07-06T01:10:31.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.230+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34940cb140 con 0x7f349415fca0 2023-07-06T01:10:31.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.231+0000 7f347bfff700 1 -- 172.21.15.71:0/3371303517 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34940cb140 con 0x7f349415fca0 2023-07-06T01:10:31.234 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-07-06T01:10:31.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f348006ace0 msgr2=0x7f348006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f348006ace0 0x7f348006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f349415ad00 tx=0x7f3484008040 comp rx=0 tx=0).stop 2023-07-06T01:10:31.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 msgr2=0x7f349415da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 0x7f349415da10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f348c014040 tx=0x7f348c004ad0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 shutdown_connections 2023-07-06T01:10:31.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f348006ace0 0x7f348006d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f349415fca0 0x7f349415da10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34940b5c90 0x7f3494157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 --2- 172.21.15.71:0/3371303517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34940b6110 0x7f3494157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 >> 172.21.15.71:0/3371303517 conn(0x7f349406c150 msgr2=0x7f349415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 shutdown_connections 2023-07-06T01:10:31.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.233+0000 7f34999ff700 1 -- 172.21.15.71:0/3371303517 wait complete. 2023-07-06T01:10:31.253 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:10:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.444+0000 7fadb71ff700 1 Processor -- start 2023-07-06T01:10:31.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.444+0000 7fadb71ff700 1 -- start start 2023-07-06T01:10:31.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.445+0000 7fadb71ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fadb00b5c90 0x7fadb00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.445+0000 7fadb71ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fadb00b6110 0x7fadb00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.445+0000 7fadb71ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb00cf780 con 0x7fadb015fca0 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.445+0000 7fadb71ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb00cd490 con 0x7fadb00b5c90 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.445+0000 7fadb71ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb00cd770 con 0x7fadb00b6110 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fadb00b5c90 0x7fadb00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadb4f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fadb015fca0 0x7fadb00d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:45994/0 (socket says 172.21.15.71:45994) 2023-07-06T01:10:31.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadb4f9b700 1 -- 172.21.15.71:0/654546789 learned_addr learned my addr 172.21.15.71:0/654546789 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadb579c700 1 --2- 172.21.15.71:0/654546789 >> v2:172.21.15.194:3300/0 conn(0x7fadb00b6110 0x7fadb00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaffff700 1 -- 172.21.15.71:0/654546789 >> v2:172.21.15.194:3300/0 conn(0x7fadb00b6110 msgr2=0x7fadb00d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:31.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaffff700 1 --2- 172.21.15.71:0/654546789 >> v2:172.21.15.194:3300/0 conn(0x7fadb00b6110 0x7fadb00d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaffff700 1 -- 172.21.15.71:0/654546789 >> v1:172.21.15.71:6789/0 conn(0x7fadb015fca0 legacy=0x7fadb00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaffff700 1 -- 172.21.15.71:0/654546789 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb00cda50 con 0x7fadb00b5c90 2023-07-06T01:10:31.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaf7fe700 1 -- 172.21.15.71:0/654546789 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988991772 0 0) 0x7fadb00cf780 con 0x7fadb015fca0 2023-07-06T01:10:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.446+0000 7fadaffff700 1 --2- 172.21.15.71:0/654546789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb00b5c90 0x7fadb00d2d40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fadb00cd410 tx=0x7fad9c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874dea1e7b559ea6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadaf7fe700 1 -- 172.21.15.71:0/654546789 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c011830 con 0x7fadb00b5c90 2023-07-06T01:10:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadaf7fe700 1 -- 172.21.15.71:0/654546789 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c011990 con 0x7fadb00b5c90 2023-07-06T01:10:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadaf7fe700 1 -- 172.21.15.71:0/654546789 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c011d20 con 0x7fadb00b5c90 2023-07-06T01:10:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 -- 172.21.15.71:0/654546789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb00b5c90 msgr2=0x7fadb00d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 --2- 172.21.15.71:0/654546789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb00b5c90 0x7fadb00d2d40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fadb00cd410 tx=0x7fad9c009b20 comp rx=0 tx=0).stop 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 -- 172.21.15.71:0/654546789 shutdown_connections 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 --2- 172.21.15.71:0/654546789 >> v2:172.21.15.194:3300/0 conn(0x7fadb00b6110 0x7fadb00d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 --2- 172.21.15.71:0/654546789 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb00b5c90 0x7fadb00d2d40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 -- 172.21.15.71:0/654546789 >> 172.21.15.71:0/654546789 conn(0x7fadb006c150 msgr2=0x7fadb006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 -- 172.21.15.71:0/654546789 shutdown_connections 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.447+0000 7fadb71ff700 1 -- 172.21.15.71:0/654546789 wait complete. 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.449+0000 7fadb71ff700 1 Processor -- start 2023-07-06T01:10:31.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.449+0000 7fadb71ff700 1 -- start start 2023-07-06T01:10:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb71ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fadb00b5c90 0x7fadb00cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb71ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadb00b6110 0x7fadb00c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb71ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 0x7fadb00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb71ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb00c6170 con 0x7fadb015fca0 2023-07-06T01:10:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb71ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb00cb830 con 0x7fadb00b6110 2023-07-06T01:10:31.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb71ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb00cbb10 con 0x7fadb00b5c90 2023-07-06T01:10:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb579c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 0x7fadb00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb579c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 0x7fadb00ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55320/0 (socket says 172.21.15.71:55320) 2023-07-06T01:10:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb579c700 1 -- 172.21.15.71:0/3731533937 learned_addr learned my addr 172.21.15.71:0/3731533937 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.450+0000 7fadb4f9b700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fadb00b5c90 0x7fadb00cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadaffff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadb00b6110 0x7fadb00c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb579c700 1 -- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fadb00b5c90 msgr2=0x7fadb00cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb579c700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fadb00b5c90 0x7fadb00cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb579c700 1 -- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadb00b6110 msgr2=0x7fadb00c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb579c700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadb00b6110 0x7fadb00c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb579c700 1 -- 172.21.15.71:0/3731533937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0094a0 con 0x7fadb015fca0 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb579c700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 0x7fadb00ca8e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fada8007e40 tx=0x7fada800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800ed30 con 0x7fadb015fca0 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8014420 con 0x7fadb015fca0 2023-07-06T01:10:31.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb00cbdf0 con 0x7fadb015fca0 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.451+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80147d0 con 0x7fadb015fca0 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.452+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb00cc3b0 con 0x7fadb015fca0 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.452+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb00008d0 con 0x7fadb015fca0 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.453+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fada8014930 con 0x7fadb015fca0 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.454+0000 7fadad7fa700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad9406ace0 0x7fad9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.454+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fada8089c10 con 0x7fadb015fca0 2023-07-06T01:10:31.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.455+0000 7fadb4f9b700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad9406ace0 0x7fad9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.455+0000 7fadb4f9b700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad9406ace0 0x7fad9406d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fada4000f60 tx=0x7fada4007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.458+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fada8054cd0 con 0x7fadb015fca0 2023-07-06T01:10:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.698+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadb00d06b0 con 0x7fadb015fca0 2023-07-06T01:10:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.699+0000 7fadad7fa700 1 -- 172.21.15.71:0/3731533937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fada80582f0 con 0x7fadb015fca0 2023-07-06T01:10:31.702 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:31.702 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:10:07.271274+0000","modified":"2023-07-06T01:10:10.810493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6835/783929387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":783929387},{"type":"v1","addr":"172.21.15.71:6835","nonce":783929387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T01:10:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.701+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad9406ace0 msgr2=0x7fad9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.701+0000 7fadb71ff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad9406ace0 0x7fad9406d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fada4000f60 tx=0x7fada4007e70 comp rx=0 tx=0).stop 2023-07-06T01:10:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.701+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 msgr2=0x7fadb00ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.701+0000 7fadb71ff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 0x7fadb00ca8e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fada8007e40 tx=0x7fada800e3c0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 shutdown_connections 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fad9406ace0 0x7fad9406d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadb015fca0 0x7fadb00ca8e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fadb00b5c90 0x7fadb00cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 --2- 172.21.15.71:0/3731533937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fadb00b6110 0x7fadb00c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 >> 172.21.15.71:0/3731533937 conn(0x7fadb006c150 msgr2=0x7fadb00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 shutdown_connections 2023-07-06T01:10:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.702+0000 7fadb71ff700 1 -- 172.21.15.71:0/3731533937 wait complete. 2023-07-06T01:10:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 16 2023-07-06T01:10:31.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:31.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.917+0000 7fbb63dff700 1 Processor -- start 2023-07-06T01:10:31.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.917+0000 7fbb63dff700 1 -- start start 2023-07-06T01:10:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.918+0000 7fbb63dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb5c0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.918+0000 7fbb63dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c06cb60 con 0x7fbb5c160d50 2023-07-06T01:10:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb63dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c1613a0 con 0x7fbb5c15dc80 2023-07-06T01:10:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb63dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c06c230 con 0x7fbb5c15d8b0 2023-07-06T01:10:31.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb6239c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbb5c160d50 0x7fbb5c0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46004/0 (socket says 172.21.15.71:46004) 2023-07-06T01:10:31.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb6239c700 1 -- 172.21.15.71:0/3346003647 learned_addr learned my addr 172.21.15.71:0/3346003647 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:31.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb5c0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441016770 0 0) 0x7fbb5c06cb60 con 0x7fbb5c160d50 2023-07-06T01:10:31.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb480035b0 con 0x7fbb5c160d50 2023-07-06T01:10:31.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3644229152 0 0) 0x7fbb480035b0 con 0x7fbb5c160d50 2023-07-06T01:10:31.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 msgr2=0x7fbb5c0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:31.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb5c0d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 >> v1:172.21.15.194:6789/0 conn(0x7fbb5c15dc80 legacy=0x7fbb5c160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.919+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c06c510 con 0x7fbb5c160d50 2023-07-06T01:10:31.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fbb540019f0 con 0x7fbb5c160d50 2023-07-06T01:10:31.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 >> v1:172.21.15.71:6789/0 conn(0x7fbb5c160d50 legacy=0x7fbb5c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb48003a30 0x7fbb48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb48004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48004d90 0x7fbb48005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c06c230 con 0x7fbb48003a30 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4800ba10 con 0x7fbb48004d90 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4800bba0 con 0x7fbb5c15d8b0 2023-07-06T01:10:31.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb48003a30 0x7fbb48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb6239c700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48004d90 0x7fbb48005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb6139a700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb48004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb61b9b700 1 -- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 msgr2=0x7fbb48004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb48004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb61b9b700 1 -- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48004d90 msgr2=0x7fbb48005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48004d90 0x7fbb48005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb61b9b700 1 -- 172.21.15.71:0/3346003647 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480035b0 con 0x7fbb48003a30 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.920+0000 7fbb6139a700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c15d8b0 0x7fbb48004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb48003a30 0x7fbb48003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009b60 tx=0x7fbb48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4597c91649c7b057 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800e6c0 con 0x7fbb48003a30 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800e820 con 0x7fbb48003a30 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb60b99700 1 -- 172.21.15.71:0/3346003647 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800eb90 con 0x7fbb48003a30 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb63dff700 1 -- 172.21.15.71:0/3346003647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb48003a30 msgr2=0x7fbb48003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb63dff700 1 --2- 172.21.15.71:0/3346003647 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb48003a30 0x7fbb48003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009b60 tx=0x7fbb48005880 comp rx=0 tx=0).stop 2023-07-06T01:10:31.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb6239c700 1 -- 172.21.15.71:0/3346003647 reap_dead start 2023-07-06T01:10:31.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb63dff700 1 -- 172.21.15.71:0/3346003647 shutdown_connections 2023-07-06T01:10:31.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb63dff700 1 -- 172.21.15.71:0/3346003647 >> 172.21.15.71:0/3346003647 conn(0x7fbb5c06db20 msgr2=0x7fbb5c06df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:31.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.921+0000 7fbb63dff700 1 -- 172.21.15.71:0/3346003647 shutdown_connections 2023-07-06T01:10:31.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.922+0000 7fbb63dff700 1 -- 172.21.15.71:0/3346003647 wait complete. 2023-07-06T01:10:31.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.923+0000 7fbb63dff700 1 Processor -- start 2023-07-06T01:10:31.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.923+0000 7fbb63dff700 1 -- start start 2023-07-06T01:10:31.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb63dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48003a30 0x7fbb5c0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb63dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c0c46e0 0x7fbb5c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb63dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 0x7fbb5c142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb63dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0c5090 con 0x7fbb5c1429b0 2023-07-06T01:10:31.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb63dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0b5f10 con 0x7fbb48003a30 2023-07-06T01:10:31.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb63dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0b5300 con 0x7fbb5c0c46e0 2023-07-06T01:10:31.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb6239c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 0x7fbb5c142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb6239c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 0x7fbb5c142e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55336/0 (socket says 172.21.15.71:55336) 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.924+0000 7fbb6239c700 1 -- 172.21.15.71:0/1433458379 learned_addr learned my addr 172.21.15.71:0/1433458379 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48003a30 0x7fbb5c0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6139a700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c0c46e0 0x7fbb5c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6239c700 1 -- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c0c46e0 msgr2=0x7fbb5c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6239c700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c0c46e0 0x7fbb5c0c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6239c700 1 -- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48003a30 msgr2=0x7fbb5c0b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6239c700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48003a30 0x7fbb5c0b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6239c700 1 -- 172.21.15.71:0/1433458379 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0b55e0 con 0x7fbb5c1429b0 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48003a30 0x7fbb5c0b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb6239c700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 0x7fbb5c142e20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c161120 tx=0x7fbb5400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400ae10 con 0x7fbb5c1429b0 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540133f0 con 0x7fbb5c1429b0 2023-07-06T01:10:31.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540137a0 con 0x7fbb5c1429b0 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.925+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c0b58c0 con 0x7fbb5c1429b0 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.926+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c0b68e0 con 0x7fbb5c1429b0 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.926+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c04eb90 con 0x7fbb5c1429b0 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.928+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb54013900 con 0x7fbb5c1429b0 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.928+0000 7fbb527fc700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbb4006ace0 0x7fbb4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.929+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fbb5408a020 con 0x7fbb5c1429b0 2023-07-06T01:10:31.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.929+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbb4006ace0 0x7fbb4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:31.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.930+0000 7fbb61b9b700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbb4006ace0 0x7fbb4006d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb580090b0 tx=0x7fbb58008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:31.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:31.933+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb54055140 con 0x7fbb5c1429b0 2023-07-06T01:10:32.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.127+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb5c0008d0 con 0x7fbb5c1429b0 2023-07-06T01:10:32.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.128+0000 7fbb527fc700 1 -- 172.21.15.71:0/1433458379 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18320 (secure 0 0 0) 0x7fbb54017020 con 0x7fbb5c1429b0 2023-07-06T01:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:32.131 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":37,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:31.572786+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:32.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbb4006ace0 msgr2=0x7fbb4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbb4006ace0 0x7fbb4006d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb580090b0 tx=0x7fbb58008030 comp rx=0 tx=0).stop 2023-07-06T01:10:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 msgr2=0x7fbb5c142e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 0x7fbb5c142e20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c161120 tx=0x7fbb5400a640 comp rx=0 tx=0).stop 2023-07-06T01:10:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 shutdown_connections 2023-07-06T01:10:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fbb4006ace0 0x7fbb4006d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb5c1429b0 0x7fbb5c142e20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb48003a30 0x7fbb5c0b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 --2- 172.21.15.71:0/1433458379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb5c0c46e0 0x7fbb5c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 >> 172.21.15.71:0/1433458379 conn(0x7fbb5c06db20 msgr2=0x7fbb5c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 shutdown_connections 2023-07-06T01:10:32.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.131+0000 7fbb63dff700 1 -- 172.21.15.71:0/1433458379 wait complete. 2023-07-06T01:10:32.151 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T01:10:32.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:10:32.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.344+0000 7f0b635ff700 1 Processor -- start 2023-07-06T01:10:32.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.344+0000 7f0b635ff700 1 -- start start 2023-07-06T01:10:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.345+0000 7f0b635ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0b5c15fca0 0x7f0b5c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b635ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b5c0b6110 0x7f0b5c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b635ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0cf780 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b635ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0cd490 con 0x7f0b5c15fca0 2023-07-06T01:10:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b635ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0cd770 con 0x7f0b5c0b6110 2023-07-06T01:10:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0b5c15fca0 0x7f0b5c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0b5c15fca0 0x7f0b5c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55350/0 (socket says 172.21.15.71:55350) 2023-07-06T01:10:32.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 -- 172.21.15.71:0/3786373264 learned_addr learned my addr 172.21.15.71:0/3786373264 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 -- 172.21.15.71:0/3786373264 >> v2:172.21.15.194:3300/0 conn(0x7f0b5c0b6110 msgr2=0x7f0b5c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:32.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 --2- 172.21.15.71:0/3786373264 >> v2:172.21.15.194:3300/0 conn(0x7f0b5c0b6110 0x7f0b5c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 -- 172.21.15.71:0/3786373264 >> v1:172.21.15.71:6789/0 conn(0x7f0b5c0b5c90 legacy=0x7f0b5c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b6139b700 1 -- 172.21.15.71:0/3786373264 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0cda50 con 0x7f0b5c15fca0 2023-07-06T01:10:32.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.346+0000 7f0b53fff700 1 -- 172.21.15.71:0/3786373264 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287212743 0 0) 0x7f0b5c0cf780 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b6139b700 1 --2- 172.21.15.71:0/3786373264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c15fca0 0x7f0b5c0d1420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0cd410 tx=0x7f0b58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645dca348196ffdf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:32.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b53fff700 1 -- 172.21.15.71:0/3786373264 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800b870 con 0x7f0b5c15fca0 2023-07-06T01:10:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b53fff700 1 -- 172.21.15.71:0/3786373264 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5800b9d0 con 0x7f0b5c15fca0 2023-07-06T01:10:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b53fff700 1 -- 172.21.15.71:0/3786373264 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5800bd60 con 0x7f0b5c15fca0 2023-07-06T01:10:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 -- 172.21.15.71:0/3786373264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c15fca0 msgr2=0x7f0b5c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 --2- 172.21.15.71:0/3786373264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c15fca0 0x7f0b5c0d1420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0cd410 tx=0x7f0b58009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 -- 172.21.15.71:0/3786373264 shutdown_connections 2023-07-06T01:10:32.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 --2- 172.21.15.71:0/3786373264 >> v2:172.21.15.194:3300/0 conn(0x7f0b5c0b6110 0x7f0b5c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 --2- 172.21.15.71:0/3786373264 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c15fca0 0x7f0b5c0d1420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 -- 172.21.15.71:0/3786373264 >> 172.21.15.71:0/3786373264 conn(0x7f0b5c06c150 msgr2=0x7f0b5c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:32.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 -- 172.21.15.71:0/3786373264 shutdown_connections 2023-07-06T01:10:32.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.347+0000 7f0b635ff700 1 -- 172.21.15.71:0/3786373264 wait complete. 2023-07-06T01:10:32.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.349+0000 7f0b635ff700 1 Processor -- start 2023-07-06T01:10:32.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.349+0000 7f0b635ff700 1 -- start start 2023-07-06T01:10:32.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b635ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 0x7f0b5c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b635ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b5c0b6110 0x7f0b5c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b635ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b5c15fca0 0x7f0b5c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b635ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0d3680 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b635ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c88a0 con 0x7f0b5c0b6110 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b635ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c9850 con 0x7f0b5c15fca0 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.350+0000 7f0b6139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 0x7f0b5c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 0x7f0b5c0cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55362/0 (socket says 172.21.15.71:55362) 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 -- 172.21.15.71:0/108527454 learned_addr learned my addr 172.21.15.71:0/108527454 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:32.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b60b9a700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b5c0b6110 0x7f0b5c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b61b9c700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b5c15fca0 0x7f0b5c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 -- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b5c15fca0 msgr2=0x7f0b5c0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b5c15fca0 0x7f0b5c0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 -- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b5c0b6110 msgr2=0x7f0b5c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b5c0b6110 0x7f0b5c0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 -- 172.21.15.71:0/108527454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58009550 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b60b9a700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b5c0b6110 0x7f0b5c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b61b9c700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b5c15fca0 0x7f0b5c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b6139b700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 0x7f0b5c0cc170 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009130 tx=0x7f0b58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580129c0 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5801e070 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58012d20 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.351+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0c93c0 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.352+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0c8d70 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.353+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c0008d0 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.353+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b5802d450 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.354+0000 7f0b51ffb700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0b4006ace0 0x7f0b4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.354+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f0b5808a6e0 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.355+0000 7f0b60b9a700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0b4006ace0 0x7f0b4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.355+0000 7f0b60b9a700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0b4006ace0 0x7f0b4006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c158c50 tx=0x7f0b4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:32.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.358+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b58055760 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.593+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b5c0ca1c0 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.593+0000 7f0b51ffb700 1 -- 172.21.15.71:0/108527454 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f0b58058d80 con 0x7f0b5c0b5c90 2023-07-06T01:10:32.596 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:32.596 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:10:07.271274+0000","modified":"2023-07-06T01:10:10.810493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6835/783929387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":783929387},{"type":"v1","addr":"172.21.15.71:6835","nonce":783929387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T01:10:32.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0b4006ace0 msgr2=0x7f0b4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0b4006ace0 0x7f0b4006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c158c50 tx=0x7f0b4c009040 comp rx=0 tx=0).stop 2023-07-06T01:10:32.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 msgr2=0x7f0b5c0cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 0x7f0b5c0cc170 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009130 tx=0x7f0b58004750 comp rx=0 tx=0).stop 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 shutdown_connections 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0b4006ace0 0x7f0b4006d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b5c15fca0 0x7f0b5c0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b5c0b5c90 0x7f0b5c0cc170 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 --2- 172.21.15.71:0/108527454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b5c0b6110 0x7f0b5c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 >> 172.21.15.71:0/108527454 conn(0x7f0b5c06c150 msgr2=0x7f0b5c0d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:32.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 shutdown_connections 2023-07-06T01:10:32.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.596+0000 7f0b635ff700 1 -- 172.21.15.71:0/108527454 wait complete. 2023-07-06T01:10:32.600 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 16 2023-07-06T01:10:32.616 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:10:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.807+0000 7f034abff700 1 Processor -- start 2023-07-06T01:10:32.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.807+0000 7f034abff700 1 -- start start 2023-07-06T01:10:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.808+0000 7f034abff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f03440b0440 0x7f0344143900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.808+0000 7f034abff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f034415df60 0x7f03440b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.808+0000 7f034abff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03441441f0 con 0x7f034415b0e0 2023-07-06T01:10:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f034abff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034415e3e0 con 0x7f034415df60 2023-07-06T01:10:32.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f034abff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034415a930 con 0x7f03440b0440 2023-07-06T01:10:32.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f034415df60 0x7f03440b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f034415df60 0x7f03440b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55368/0 (socket says 172.21.15.71:55368) 2023-07-06T01:10:32.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f034919c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f034415b0e0 0x7f0344070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:46032/0 (socket says 172.21.15.71:46032) 2023-07-06T01:10:32.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 -- 172.21.15.71:0/2928557253 learned_addr learned my addr 172.21.15.71:0/2928557253 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:32.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f034899b700 1 --2- 172.21.15.71:0/2928557253 >> v2:172.21.15.194:3300/0 conn(0x7f03440b0440 0x7f0344143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 -- 172.21.15.71:0/2928557253 >> v2:172.21.15.194:3300/0 conn(0x7f03440b0440 msgr2=0x7f0344143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 --2- 172.21.15.71:0/2928557253 >> v2:172.21.15.194:3300/0 conn(0x7f03440b0440 0x7f0344143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 -- 172.21.15.71:0/2928557253 >> v1:172.21.15.71:6789/0 conn(0x7f034415b0e0 legacy=0x7f0344070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 -- 172.21.15.71:0/2928557253 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03440b0d50 con 0x7f034415df60 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f034899b700 1 --2- 172.21.15.71:0/2928557253 >> v2:172.21.15.194:3300/0 conn(0x7f03440b0440 0x7f0344143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.809+0000 7f0343fff700 1 --2- 172.21.15.71:0/2928557253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440b0810 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f034406eba0 tx=0x7f0330009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e69843ca92c8604 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:32.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f03437fe700 1 -- 172.21.15.71:0/2928557253 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033000b870 con 0x7f034415df60 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f03437fe700 1 -- 172.21.15.71:0/2928557253 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033000b9d0 con 0x7f034415df60 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f03437fe700 1 -- 172.21.15.71:0/2928557253 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033000bd60 con 0x7f034415df60 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 -- 172.21.15.71:0/2928557253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 msgr2=0x7f03440b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 --2- 172.21.15.71:0/2928557253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440b0810 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f034406eba0 tx=0x7f0330009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 -- 172.21.15.71:0/2928557253 shutdown_connections 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 --2- 172.21.15.71:0/2928557253 >> v2:172.21.15.194:3300/0 conn(0x7f03440b0440 0x7f0344143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 --2- 172.21.15.71:0/2928557253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440b0810 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 -- 172.21.15.71:0/2928557253 >> 172.21.15.71:0/2928557253 conn(0x7f03440cb440 msgr2=0x7f03440cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:32.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 -- 172.21.15.71:0/2928557253 shutdown_connections 2023-07-06T01:10:32.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.810+0000 7f034abff700 1 -- 172.21.15.71:0/2928557253 wait complete. 2023-07-06T01:10:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.812+0000 7f034abff700 1 Processor -- start 2023-07-06T01:10:32.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.812+0000 7f034abff700 1 -- start start 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034abff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440b0440 0x7f03440ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034abff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034415b0e0 0x7f03440c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034abff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034abff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b3e00 con 0x7f034415df60 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034abff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0344143760 con 0x7f03440b0440 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034abff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b4010 con 0x7f034415b0e0 2023-07-06T01:10:32.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.813+0000 7f034919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55376/0 (socket says 172.21.15.71:55376) 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 -- 172.21.15.71:0/399506070 learned_addr learned my addr 172.21.15.71:0/399506070 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f0343fff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034415b0e0 0x7f03440c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034899b700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440b0440 0x7f03440ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 -- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034415b0e0 msgr2=0x7f03440c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034415b0e0 0x7f03440c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 -- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440b0440 msgr2=0x7f03440ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:32.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440b0440 0x7f03440ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 -- 172.21.15.71:0/399506070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330009550 con 0x7f034415df60 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034899b700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440b0440 0x7f03440ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f0343fff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034415b0e0 0x7f03440c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034919c700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440ac880 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f033c00cbc0 tx=0x7f033c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00ab50 con 0x7f034415df60 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00acb0 con 0x7f034415df60 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03440b42f0 con 0x7f034415df60 2023-07-06T01:10:32.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.814+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c007270 con 0x7f034415df60 2023-07-06T01:10:32.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.815+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0344143a20 con 0x7f034415df60 2023-07-06T01:10:32.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.816+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034406fa50 con 0x7f034415df60 2023-07-06T01:10:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.817+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f033c0073d0 con 0x7f034415df60 2023-07-06T01:10:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.818+0000 7f03417fa700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f032806ace0 0x7f032806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.818+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f033c0891f0 con 0x7f034415df60 2023-07-06T01:10:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.818+0000 7f034899b700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f032806ace0 0x7f032806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.819+0000 7f034899b700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f032806ace0 0x7f032806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0338009960 tx=0x7f0338008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:32.822+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f033c054320 con 0x7f034415df60 2023-07-06T01:10:33.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.055+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03440cb0d0 con 0x7f034415df60 2023-07-06T01:10:33.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.056+0000 7f03417fa700 1 -- 172.21.15.71:0/399506070 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f033c017090 con 0x7f034415df60 2023-07-06T01:10:33.058 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:33.058 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T01:10:07.271274+0000","modified":"2023-07-06T01:10:10.810493+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5145":{"gid":5145,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6835/783929387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":783929387},{"type":"v1","addr":"172.21.15.71:6835","nonce":783929387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T01:10:33.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f032806ace0 msgr2=0x7f032806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f032806ace0 0x7f032806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0338009960 tx=0x7f0338008040 comp rx=0 tx=0).stop 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 msgr2=0x7f03440ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440ac880 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f033c00cbc0 tx=0x7f033c00cf80 comp rx=0 tx=0).stop 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 shutdown_connections 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f032806ace0 0x7f032806d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034415df60 0x7f03440ac880 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03440b0440 0x7f03440ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 --2- 172.21.15.71:0/399506070 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034415b0e0 0x7f03440c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 >> 172.21.15.71:0/399506070 conn(0x7f03440cb440 msgr2=0x7f034406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:33.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 shutdown_connections 2023-07-06T01:10:33.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.058+0000 7f034abff700 1 -- 172.21.15.71:0/399506070 wait complete. 2023-07-06T01:10:33.062 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 16 2023-07-06T01:10:33.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.269+0000 7f7fbb9ff700 1 Processor -- start 2023-07-06T01:10:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.269+0000 7f7fbb9ff700 1 -- start start 2023-07-06T01:10:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.270+0000 7f7fbb9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7fb40b8610 0x7f7fb40b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.270+0000 7f7fbb9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fb40ceed0 0x7f7fb40cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.270+0000 7f7fbb9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40cfcb0 0x7f7fb4160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.270+0000 7f7fbb9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40d0130 con 0x7f7fb40ceed0 2023-07-06T01:10:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.270+0000 7f7fbb9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40d1370 con 0x7f7fb40b8610 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.270+0000 7f7fbb9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40d1650 con 0x7f7fb40cfcb0 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fb40ceed0 0x7f7fb40cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7fb40ceed0 0x7f7fb40cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54106/0 (socket says 172.21.15.71:54106) 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 -- 172.21.15.71:0/2274581332 learned_addr learned my addr 172.21.15.71:0/2274581332 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb9f9c700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40cfcb0 0x7f7fb4160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 -- 172.21.15.71:0/2274581332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40cfcb0 msgr2=0x7f7fb4160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb979b700 1 --2- 172.21.15.71:0/2274581332 >> v2:172.21.15.194:3300/0 conn(0x7f7fb40b8610 0x7f7fb40b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40cfcb0 0x7f7fb4160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 -- 172.21.15.71:0/2274581332 >> v2:172.21.15.194:3300/0 conn(0x7f7fb40b8610 msgr2=0x7f7fb40b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 --2- 172.21.15.71:0/2274581332 >> v2:172.21.15.194:3300/0 conn(0x7f7fb40b8610 0x7f7fb40b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 -- 172.21.15.71:0/2274581332 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40b8cd0 con 0x7f7fb40ceed0 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb9f9c700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40cfcb0 0x7f7fb4160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb979b700 1 --2- 172.21.15.71:0/2274581332 >> v2:172.21.15.194:3300/0 conn(0x7f7fb40b8610 0x7f7fb40b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.271+0000 7f7fb8f9a700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40ceed0 0x7f7fb40cf770 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40b4c80 tx=0x7f7fa4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df9e3044967afac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fabfff700 1 -- 172.21.15.71:0/2274581332 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400b870 con 0x7f7fb40ceed0 2023-07-06T01:10:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fabfff700 1 -- 172.21.15.71:0/2274581332 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400b9d0 con 0x7f7fb40ceed0 2023-07-06T01:10:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fabfff700 1 -- 172.21.15.71:0/2274581332 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400bd60 con 0x7f7fb40ceed0 2023-07-06T01:10:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2274581332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40ceed0 msgr2=0x7f7fb40cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40ceed0 0x7f7fb40cf770 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40b4c80 tx=0x7f7fa4009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2274581332 shutdown_connections 2023-07-06T01:10:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40cfcb0 0x7f7fb4160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2274581332 >> v2:172.21.15.194:3300/0 conn(0x7f7fb40b8610 0x7f7fb40b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2274581332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40ceed0 0x7f7fb40cf770 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2274581332 >> 172.21.15.71:0/2274581332 conn(0x7f7fb4071690 msgr2=0x7f7fb4071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2274581332 shutdown_connections 2023-07-06T01:10:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.272+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2274581332 wait complete. 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.274+0000 7f7fbb9ff700 1 Processor -- start 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.274+0000 7f7fbb9ff700 1 -- start start 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fbb9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 0x7f7fb41487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fbb9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40ceed0 0x7f7fb41f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fbb9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fb40cfcb0 0x7f7fb41eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fbb9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40ccaf0 con 0x7f7fb40b8610 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fbb9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40cbee0 con 0x7f7fb40cfcb0 2023-07-06T01:10:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fbb9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40cc1c0 con 0x7f7fb40ceed0 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fb979b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 0x7f7fb41487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fb979b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 0x7f7fb41487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54120/0 (socket says 172.21.15.71:54120) 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.275+0000 7f7fb979b700 1 -- 172.21.15.71:0/2558210785 learned_addr learned my addr 172.21.15.71:0/2558210785 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb8f9a700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40ceed0 0x7f7fb41f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb9f9c700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fb40cfcb0 0x7f7fb41eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb979b700 1 -- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40ceed0 msgr2=0x7f7fb41f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb979b700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40ceed0 0x7f7fb41f57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb979b700 1 -- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fb40cfcb0 msgr2=0x7f7fb41eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb979b700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fb40cfcb0 0x7f7fb41eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb979b700 1 -- 172.21.15.71:0/2558210785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009550 con 0x7f7fb40b8610 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb9f9c700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fb40cfcb0 0x7f7fb41eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fb979b700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 0x7f7fb41487a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c7f0 tx=0x7f7fb000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0011800 con 0x7f7fb40b8610 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0011960 con 0x7f7fb40b8610 2023-07-06T01:10:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb40cc4a0 con 0x7f7fb40b8610 2023-07-06T01:10:33.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0011d10 con 0x7f7fb40b8610 2023-07-06T01:10:33.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.276+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb41f6240 con 0x7f7fb40b8610 2023-07-06T01:10:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.277+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb40008d0 con 0x7f7fb40b8610 2023-07-06T01:10:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.278+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7fb0018360 con 0x7f7fb40b8610 2023-07-06T01:10:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.279+0000 7f7fa9ffb700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7f9806ace0 0x7f7f9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.279+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7fb0089520 con 0x7f7fb40b8610 2023-07-06T01:10:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.280+0000 7f7fb8f9a700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7f9806ace0 0x7f7f9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.280+0000 7f7fb8f9a700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7f9806ace0 0x7f7f9806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009840 tx=0x7f7fa4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:33.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.283+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7fb0054520 con 0x7f7fb40b8610 2023-07-06T01:10:33.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.481+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fb40b5120 con 0x7f7fb40b8610 2023-07-06T01:10:33.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.482+0000 7f7fa9ffb700 1 -- 172.21.15.71:0/2558210785 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18320 (secure 0 0 0) 0x7f7fb0057b40 con 0x7f7fb40b8610 2023-07-06T01:10:33.486 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:33.486 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":38,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:32.578132+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-06T01:10:05.447038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-06T01:10:06.255735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.36","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:33.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7f9806ace0 msgr2=0x7f7f9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7f9806ace0 0x7f7f9806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009840 tx=0x7f7fa4008030 comp rx=0 tx=0).stop 2023-07-06T01:10:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 msgr2=0x7f7fb41487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 0x7f7fb41487a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000c7f0 tx=0x7f7fb000cbb0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 shutdown_connections 2023-07-06T01:10:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f7f9806ace0 0x7f7f9806d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fb40cfcb0 0x7f7fb41eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fb40b8610 0x7f7fb41487a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 --2- 172.21.15.71:0/2558210785 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fb40ceed0 0x7f7fb41f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 >> 172.21.15.71:0/2558210785 conn(0x7f7fb4071690 msgr2=0x7f7fb40b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:33.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 shutdown_connections 2023-07-06T01:10:33.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.485+0000 7f7fbb9ff700 1 -- 172.21.15.71:0/2558210785 wait complete. 2023-07-06T01:10:33.505 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T01:10:33.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.701+0000 7f6294dff700 1 Processor -- start 2023-07-06T01:10:33.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.701+0000 7f6294dff700 1 -- start start 2023-07-06T01:10:33.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f6294dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f629015fca0 0x7f62900d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f6294dff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62900cf780 con 0x7f62900b6110 2023-07-06T01:10:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f6294dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62900cd490 con 0x7f62900b5c90 2023-07-06T01:10:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f6294dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900cd770 con 0x7f629015fca0 2023-07-06T01:10:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f628e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f629015fca0 0x7f62900d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f628ed9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f62900b6110 0x7f62900cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56678/0 (socket says 172.21.15.71:56678) 2023-07-06T01:10:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f628ed9d700 1 -- 172.21.15.71:0/3647468731 learned_addr learned my addr 172.21.15.71:0/3647468731 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:33.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f628e59c700 1 -- 172.21.15.71:0/3647468731 >> v1:172.21.15.194:6789/0 conn(0x7f62900b5c90 legacy=0x7f62900d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f628e59c700 1 -- 172.21.15.71:0/3647468731 >> v1:172.21.15.71:6789/0 conn(0x7f62900b6110 legacy=0x7f62900cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.703+0000 7f628e59c700 1 -- 172.21.15.71:0/3647468731 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900cda50 con 0x7f629015fca0 2023-07-06T01:10:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f628e59c700 1 --2- 172.21.15.71:0/3647468731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015fca0 0x7f62900d1420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6280009840 tx=0x7f6280009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e27d7a5fae0a558 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f628dd9b700 1 -- 172.21.15.71:0/3647468731 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280011830 con 0x7f629015fca0 2023-07-06T01:10:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f628dd9b700 1 -- 172.21.15.71:0/3647468731 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280011990 con 0x7f629015fca0 2023-07-06T01:10:33.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f628dd9b700 1 -- 172.21.15.71:0/3647468731 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6280011d20 con 0x7f629015fca0 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f6294dff700 1 -- 172.21.15.71:0/3647468731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015fca0 msgr2=0x7f62900d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f6294dff700 1 --2- 172.21.15.71:0/3647468731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015fca0 0x7f62900d1420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6280009840 tx=0x7f6280009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f6294dff700 1 -- 172.21.15.71:0/3647468731 shutdown_connections 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f6294dff700 1 --2- 172.21.15.71:0/3647468731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629015fca0 0x7f62900d1420 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.704+0000 7f6294dff700 1 -- 172.21.15.71:0/3647468731 >> 172.21.15.71:0/3647468731 conn(0x7f629006c150 msgr2=0x7f629006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.705+0000 7f6294dff700 1 -- 172.21.15.71:0/3647468731 shutdown_connections 2023-07-06T01:10:33.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.705+0000 7f6294dff700 1 -- 172.21.15.71:0/3647468731 wait complete. 2023-07-06T01:10:33.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.707+0000 7f6294dff700 1 Processor -- start 2023-07-06T01:10:33.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.707+0000 7f6294dff700 1 -- start start 2023-07-06T01:10:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.708+0000 7f6294dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62900b5c90 0x7f629014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.708+0000 7f6294dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 0x7f62900cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.708+0000 7f6294dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f629015fca0 0x7f62900c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.708+0000 7f6294dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629015c570 con 0x7f62900b6110 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.708+0000 7f6294dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62900cadb0 con 0x7f629015fca0 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.708+0000 7f6294dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900cb090 con 0x7f62900b5c90 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 0x7f62900cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 0x7f62900cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54142/0 (socket says 172.21.15.71:54142) 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 -- 172.21.15.71:0/3042443204 learned_addr learned my addr 172.21.15.71:0/3042443204 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:33.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f628ed9d700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f629015fca0 0x7f62900c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 -- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62900b5c90 msgr2=0x7f629014d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f628e59c700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62900b5c90 0x7f629014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62900b5c90 0x7f629014d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 -- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f629015fca0 msgr2=0x7f62900c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f629015fca0 0x7f62900c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 -- 172.21.15.71:0/3042443204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800094a0 con 0x7f62900b6110 2023-07-06T01:10:33.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f628ed9d700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f629015fca0 0x7f62900c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:33.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f628e59c700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62900b5c90 0x7f629014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:33.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6287fff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 0x7f62900cc320 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f627800c4e0 tx=0x7f627800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:33.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780052d0 con 0x7f62900b6110 2023-07-06T01:10:33.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278005430 con 0x7f62900b6110 2023-07-06T01:10:33.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.709+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62900cb370 con 0x7f62900b6110 2023-07-06T01:10:33.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.710+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780038c0 con 0x7f62900b6110 2023-07-06T01:10:33.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.710+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629014d730 con 0x7f62900b6110 2023-07-06T01:10:33.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.710+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629015c770 con 0x7f62900b6110 2023-07-06T01:10:33.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.712+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6278003a20 con 0x7f62900b6110 2023-07-06T01:10:33.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.713+0000 7f6286ffd700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f627006ace0 0x7f627006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:33.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.713+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f6278088a60 con 0x7f62900b6110 2023-07-06T01:10:33.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.714+0000 7f628e59c700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f627006ace0 0x7f627006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:33.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.714+0000 7f628e59c700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f627006ace0 0x7f627006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62800090b0 tx=0x7f6280008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:33.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.718+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f629015c770 con 0x7f62900b6110 2023-07-06T01:10:33.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.954+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f62900008d0 con 0x7f62900b6110 2023-07-06T01:10:33.957 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-07-06T01:10:33.955+0000 7f38d51f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T01:10:33.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.960+0000 7f6286ffd700 1 -- 172.21.15.71:0/3042443204 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6278053a50 con 0x7f62900b6110 2023-07-06T01:10:33.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f627006ace0 msgr2=0x7f627006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f627006ace0 0x7f627006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62800090b0 tx=0x7f6280008030 comp rx=0 tx=0).stop 2023-07-06T01:10:33.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 msgr2=0x7f62900cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 0x7f62900cc320 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f627800c4e0 tx=0x7f627800c8a0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 shutdown_connections 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f627006ace0 0x7f627006d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f629015fca0 0x7f62900c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f62900b5c90 0x7f629014d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 --2- 172.21.15.71:0/3042443204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62900b6110 0x7f62900cc320 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:33.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 >> 172.21.15.71:0/3042443204 conn(0x7f629006c150 msgr2=0x7f62900d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 shutdown_connections 2023-07-06T01:10:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:33.963+0000 7f6294dff700 1 -- 172.21.15.71:0/3042443204 wait complete. 2023-07-06T01:10:33.968 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T01:10:33.970 INFO:tasks.ceph.mds.c.smithi071.stderr: -4051> 2023-07-06T01:10:10.693+0000 7f472cff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T01:10:33.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T01:10:34.022 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-07-06T01:10:34.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.182+0000 7feb4edff700 1 Processor -- start 2023-07-06T01:10:34.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.182+0000 7feb4edff700 1 -- start start 2023-07-06T01:10:34.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.183+0000 7feb4edff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb480b6110 0x7feb480cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.183+0000 7feb4edff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480cf780 con 0x7feb480b5c90 2023-07-06T01:10:34.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.183+0000 7feb4edff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480cd490 con 0x7feb4815fca0 2023-07-06T01:10:34.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.183+0000 7feb4edff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb480cd770 con 0x7feb480b6110 2023-07-06T01:10:34.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.183+0000 7feb47fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feb480b5c90 0x7feb480d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56696/0 (socket says 172.21.15.71:56696) 2023-07-06T01:10:34.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.183+0000 7feb47fff700 1 -- 172.21.15.71:0/2199664108 learned_addr learned my addr 172.21.15.71:0/2199664108 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:34.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb4d39c700 1 --2- 172.21.15.71:0/2199664108 >> v2:172.21.15.194:3300/0 conn(0x7feb480b6110 0x7feb480cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412489863 0 0) 0x7feb480cf780 con 0x7feb480b5c90 2023-07-06T01:10:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb380035b0 con 0x7feb480b5c90 2023-07-06T01:10:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168027301 0 0) 0x7feb480cd490 con 0x7feb4815fca0 2023-07-06T01:10:34.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb480cf780 con 0x7feb4815fca0 2023-07-06T01:10:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431144287 0 0) 0x7feb380035b0 con 0x7feb480b5c90 2023-07-06T01:10:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 >> v2:172.21.15.194:3300/0 conn(0x7feb480b6110 msgr2=0x7feb480cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:34.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 --2- 172.21.15.71:0/2199664108 >> v2:172.21.15.194:3300/0 conn(0x7feb480b6110 0x7feb480cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 >> v1:172.21.15.194:6789/0 conn(0x7feb4815fca0 legacy=0x7feb480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480cda50 con 0x7feb480b5c90 2023-07-06T01:10:34.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7feb34001670 con 0x7feb480b5c90 2023-07-06T01:10:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 >> v1:172.21.15.71:6789/0 conn(0x7feb480b5c90 legacy=0x7feb480d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38003b90 0x7feb38003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb38004850 0x7feb38004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480cd770 con 0x7feb38005200 2023-07-06T01:10:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3800c060 con 0x7feb38003b90 2023-07-06T01:10:34.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.184+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3800c220 con 0x7feb38004850 2023-07-06T01:10:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4cb9b700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38003b90 0x7feb38003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb47fff700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb38004850 0x7feb38004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:34.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 -- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb38004850 msgr2=0x7feb38004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb38004850 0x7feb38004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 -- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38003b90 msgr2=0x7feb38003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:34.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38003b90 0x7feb38003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 -- 172.21.15.71:0/2199664108 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380035b0 con 0x7feb38005200 2023-07-06T01:10:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 -- 172.21.15.71:0/2199664108 reap_dead start 2023-07-06T01:10:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb4d39c700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb3800ba10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7feb40009fc0 tx=0x7feb38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5f924cef8081b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40003a20 con 0x7feb38005200 2023-07-06T01:10:34.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4000f040 con 0x7feb38005200 2023-07-06T01:10:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.185+0000 7feb477fe700 1 -- 172.21.15.71:0/2199664108 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40003de0 con 0x7feb38005200 2023-07-06T01:10:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 -- 172.21.15.71:0/2199664108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 msgr2=0x7feb3800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb3800ba10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7feb40009fc0 tx=0x7feb38005880 comp rx=0 tx=0).stop 2023-07-06T01:10:34.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 -- 172.21.15.71:0/2199664108 shutdown_connections 2023-07-06T01:10:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 --2- 172.21.15.71:0/2199664108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb3800ba10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 -- 172.21.15.71:0/2199664108 >> 172.21.15.71:0/2199664108 conn(0x7feb4806c150 msgr2=0x7feb4806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:34.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 -- 172.21.15.71:0/2199664108 shutdown_connections 2023-07-06T01:10:34.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.186+0000 7feb4edff700 1 -- 172.21.15.71:0/2199664108 wait complete. 2023-07-06T01:10:34.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.188+0000 7feb4edff700 1 Processor -- start 2023-07-06T01:10:34.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.188+0000 7feb4edff700 1 -- start start 2023-07-06T01:10:34.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4edff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb480c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4edff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb48159320 0x7feb480cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4edff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb480cb920 0x7feb481f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4edff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4815cf10 con 0x7feb38005200 2023-07-06T01:10:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4edff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c7120 con 0x7feb480cb920 2023-07-06T01:10:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4edff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480cbd90 con 0x7feb48159320 2023-07-06T01:10:34.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4cb9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb480c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4cb9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb480c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54182/0 (socket says 172.21.15.71:54182) 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.189+0000 7feb4cb9b700 1 -- 172.21.15.71:0/1052561507 learned_addr learned my addr 172.21.15.71:0/1052561507 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4cb9b700 1 -- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb48159320 msgr2=0x7feb480cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4cb9b700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb48159320 0x7feb480cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4cb9b700 1 -- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb480cb920 msgr2=0x7feb481f55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4cb9b700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb480cb920 0x7feb481f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4cb9b700 1 -- 172.21.15.71:0/1052561507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb481f64d0 con 0x7feb38005200 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4cb9b700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb480c7540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00f7d0 tx=0x7feb3c00fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c005320 con 0x7feb38005200 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0054a0 con 0x7feb38005200 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4815bab0 con 0x7feb38005200 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c006aa0 con 0x7feb38005200 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.190+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb480c6a60 con 0x7feb38005200 2023-07-06T01:10:34.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.191+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb480b2730 con 0x7feb38005200 2023-07-06T01:10:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.192+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb3c006c00 con 0x7feb38005200 2023-07-06T01:10:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.193+0000 7feb457fa700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb2c06ace0 0x7feb2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.193+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6177+0+0 (secure 0 0 0) 0x7feb3c088a10 con 0x7feb38005200 2023-07-06T01:10:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.194+0000 7feb47fff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb2c06ace0 0x7feb2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.194+0000 7feb47fff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb2c06ace0 0x7feb2c06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feb34001200 tx=0x7feb34000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:34.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.197+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb3c053a30 con 0x7feb38005200 2023-07-06T01:10:34.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.435+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feb480c7260 con 0x7feb38005200 2023-07-06T01:10:34.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.961+0000 7feb457fa700 1 -- 172.21.15.71:0/1052561507 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7feb480c7260 con 0x7feb38005200 2023-07-06T01:10:34.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb2c06ace0 msgr2=0x7feb2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb2c06ace0 0x7feb2c06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feb34001200 tx=0x7feb34000ed0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 msgr2=0x7feb480c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb480c7540 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00f7d0 tx=0x7feb3c00fb90 comp rx=0 tx=0).stop 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 shutdown_connections 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb2c06ace0 0x7feb2c06d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb480cb920 0x7feb481f55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb38005200 0x7feb480c7540 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 --2- 172.21.15.71:0/1052561507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb48159320 0x7feb480cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:34.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.964+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 >> 172.21.15.71:0/1052561507 conn(0x7feb4806c150 msgr2=0x7feb480b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:34.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.965+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 shutdown_connections 2023-07-06T01:10:34.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:34.965+0000 7feb4edff700 1 -- 172.21.15.71:0/1052561507 wait complete. 2023-07-06T01:10:34.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T01:10:35.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.226+0000 7f6875bff700 1 Processor -- start 2023-07-06T01:10:35.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.226+0000 7f6875bff700 1 -- start start 2023-07-06T01:10:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6875bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68700b87c0 0x7f687006acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6875bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f68700d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6875bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6870161100 con 0x7f68700cf100 2023-07-06T01:10:35.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6875bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700cf5a0 con 0x7f68700b87c0 2023-07-06T01:10:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6875bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700cd9a0 con 0x7f68700d3100 2023-07-06T01:10:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6867fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f68700cf100 0x7f68700d29f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56706/0 (socket says 172.21.15.71:56706) 2023-07-06T01:10:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.227+0000 7f6867fff700 1 -- 172.21.15.71:0/1110959490 learned_addr learned my addr 172.21.15.71:0/1110959490 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:35.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916249797 0 0) 0x7f6858001110 con 0x7f68700cf100 2023-07-06T01:10:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f685c0035b0 con 0x7f68700cf100 2023-07-06T01:10:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1110959490 >> v2:172.21.15.194:3300/0 conn(0x7f68700b87c0 0x7f687006acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686ffff700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f68700d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3160077987 0 0) 0x7f685c0035b0 con 0x7f68700cf100 2023-07-06T01:10:35.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 msgr2=0x7f68700d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f68700d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 >> v2:172.21.15.194:3300/0 conn(0x7f68700b87c0 msgr2=0x7f687006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 --2- 172.21.15.71:0/1110959490 >> v2:172.21.15.194:3300/0 conn(0x7f68700b87c0 0x7f687006acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870160b80 con 0x7f68700cf100 2023-07-06T01:10:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f6858001800 con 0x7f68700cf100 2023-07-06T01:10:35.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 >> v1:172.21.15.71:6789/0 conn(0x7f68700cf100 legacy=0x7f68700d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f685c003a00 0x7f685c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c004850 0x7f685c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f685c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700cf5a0 con 0x7f685c003a00 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700cd9a0 con 0x7f685c004850 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c00ba10 con 0x7f68700d3100 2023-07-06T01:10:35.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.228+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f685c003a00 0x7f685c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686ffff700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f685c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f6867fff700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c004850 0x7f685c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686f7fe700 1 -- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 msgr2=0x7f685c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f685c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686f7fe700 1 -- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c004850 msgr2=0x7f685c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c004850 0x7f685c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686f7fe700 1 -- 172.21.15.71:0/1110959490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0035b0 con 0x7f685c003a00 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686ffff700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d3100 0x7f685c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f685c003a00 0x7f685c003e10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6860009b90 tx=0x7f685c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef28972ee71c880a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000e6c0 con 0x7f685c003a00 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000e820 con 0x7f685c003a00 2023-07-06T01:10:35.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.229+0000 7f686effd700 1 -- 172.21.15.71:0/1110959490 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000eb90 con 0x7f685c003a00 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f6875bff700 1 -- 172.21.15.71:0/1110959490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f685c003a00 msgr2=0x7f685c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f6875bff700 1 --2- 172.21.15.71:0/1110959490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f685c003a00 0x7f685c003e10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6860009b90 tx=0x7f685c005880 comp rx=0 tx=0).stop 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f686ffff700 1 -- 172.21.15.71:0/1110959490 reap_dead start 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f6875bff700 1 -- 172.21.15.71:0/1110959490 shutdown_connections 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f6875bff700 1 -- 172.21.15.71:0/1110959490 >> 172.21.15.71:0/1110959490 conn(0x7f687006c150 msgr2=0x7f687006c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f6875bff700 1 -- 172.21.15.71:0/1110959490 shutdown_connections 2023-07-06T01:10:35.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.230+0000 7f6875bff700 1 -- 172.21.15.71:0/1110959490 wait complete. 2023-07-06T01:10:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.232+0000 7f6875bff700 1 Processor -- start 2023-07-06T01:10:35.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.232+0000 7f6875bff700 1 -- start start 2023-07-06T01:10:35.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6875bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c003a00 0x7f68700c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6875bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 0x7f68700b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6875bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68701591b0 0x7f6870159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6875bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700ca920 con 0x7f6870159d60 2023-07-06T01:10:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6875bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870159b70 con 0x7f685c003a00 2023-07-06T01:10:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6875bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700ca450 con 0x7f68701591b0 2023-07-06T01:10:35.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 0x7f68700b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 0x7f68700b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54194/0 (socket says 172.21.15.71:54194) 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 -- 172.21.15.71:0/1307931767 learned_addr learned my addr 172.21.15.71:0/1307931767 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f686ffff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68701591b0 0x7f6870159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c003a00 0x7f68700c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 -- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68701591b0 msgr2=0x7f6870159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68701591b0 0x7f6870159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 -- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c003a00 msgr2=0x7f68700c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c003a00 0x7f68700c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.233+0000 7f6867fff700 1 -- 172.21.15.71:0/1307931767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700cab70 con 0x7f6870159d60 2023-07-06T01:10:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.234+0000 7f6867fff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 0x7f68700b31b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f685800e790 tx=0x7f685800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.234+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858010510 con 0x7f6870159d60 2023-07-06T01:10:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.234+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858010690 con 0x7f6870159d60 2023-07-06T01:10:35.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.234+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68700cae50 con 0x7f6870159d60 2023-07-06T01:10:35.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.234+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858010a40 con 0x7f6870159d60 2023-07-06T01:10:35.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.234+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68700cb130 con 0x7f6870159d60 2023-07-06T01:10:35.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.235+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870067b00 con 0x7f6870159d60 2023-07-06T01:10:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.236+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6858010ba0 con 0x7f6870159d60 2023-07-06T01:10:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.237+0000 7f686cff9700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f685006ace0 0x7f685006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:35.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.237+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f6858088c50 con 0x7f6870159d60 2023-07-06T01:10:35.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.237+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f685006ace0 0x7f685006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:35.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.238+0000 7f686f7fe700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f685006ace0 0x7f685006d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68600090b0 tx=0x7f686001f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:35.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.241+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6858053c70 con 0x7f6870159d60 2023-07-06T01:10:35.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.436+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6870161100 con 0x7f6870159d60 2023-07-06T01:10:35.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.964+0000 7f686cff9700 1 -- 172.21.15.71:0/1307931767 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6870161100 con 0x7f6870159d60 2023-07-06T01:10:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.967+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f685006ace0 msgr2=0x7f685006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.967+0000 7f6875bff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f685006ace0 0x7f685006d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68600090b0 tx=0x7f686001f040 comp rx=0 tx=0).stop 2023-07-06T01:10:35.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.967+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 msgr2=0x7f68700b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.967+0000 7f6875bff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 0x7f68700b31b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f685800e790 tx=0x7f685800eaa0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 shutdown_connections 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f685006ace0 0x7f685006d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68701591b0 0x7f6870159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f685c003a00 0x7f68700c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 --2- 172.21.15.71:0/1307931767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6870159d60 0x7f68700b31b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:35.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 >> 172.21.15.71:0/1307931767 conn(0x7f687006c150 msgr2=0x7f68700b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.968+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 shutdown_connections 2023-07-06T01:10:35.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:35.969+0000 7f6875bff700 1 -- 172.21.15.71:0/1307931767 wait complete. 2023-07-06T01:10:35.973 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-07-06T01:10:35.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T01:10:36.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.186+0000 7f37d99ff700 1 Processor -- start 2023-07-06T01:10:36.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.186+0000 7f37d99ff700 1 -- start start 2023-07-06T01:10:36.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d99ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f37d40cfe40 0x7f37d40cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d99ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 0x7f37d40d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d99ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d4160cc0 con 0x7f37d40b8440 2023-07-06T01:10:36.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d99ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d4160ae0 con 0x7f37d40cfe40 2023-07-06T01:10:36.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d99ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4160f80 con 0x7f37d40b2180 2023-07-06T01:10:36.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d2ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f37d40b8440 0x7f37d40cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56712/0 (socket says 172.21.15.71:56712) 2023-07-06T01:10:36.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.187+0000 7f37d2ffd700 1 -- 172.21.15.71:0/2635143501 learned_addr learned my addr 172.21.15.71:0/2635143501 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:36.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597961012 0 0) 0x7f37d4160cc0 con 0x7f37d40b8440 2023-07-06T01:10:36.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c00035b0 con 0x7f37d40b8440 2023-07-06T01:10:36.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d37fe700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 0x7f37d40d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37cbfff700 1 --2- 172.21.15.71:0/2635143501 >> v2:172.21.15.194:3300/0 conn(0x7f37d40cfe40 0x7f37d40cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756111787 0 0) 0x7f37c00035b0 con 0x7f37d40b8440 2023-07-06T01:10:36.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 msgr2=0x7f37d40d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:36.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 0x7f37d40d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 >> v2:172.21.15.194:3300/0 conn(0x7f37d40cfe40 msgr2=0x7f37d40cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:36.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 --2- 172.21.15.71:0/2635143501 >> v2:172.21.15.194:3300/0 conn(0x7f37d40cfe40 0x7f37d40cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40cf0e0 con 0x7f37d40b8440 2023-07-06T01:10:36.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f37c4001670 con 0x7f37d40b8440 2023-07-06T01:10:36.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 >> v1:172.21.15.71:6789/0 conn(0x7f37d40b8440 legacy=0x7f37d40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:36.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37c0003a00 0x7f37c0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 0x7f37c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0004d90 0x7f37c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4160ae0 con 0x7f37c0003a00 2023-07-06T01:10:36.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4160f80 con 0x7f37c0004d90 2023-07-06T01:10:36.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c000ba40 con 0x7f37d40b2180 2023-07-06T01:10:36.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37cbfff700 1 --2- 172.21.15.71:0/2635143501 >> v2:172.21.15.194:3300/0 conn(0x7f37d40cfe40 0x7f37d40cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:36.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.188+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37c0003a00 0x7f37c0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37cbfff700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 0x7f37c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d37fe700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0004d90 0x7f37c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d2ffd700 1 -- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 msgr2=0x7f37c0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:36.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d40b2180 0x7f37c0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d2ffd700 1 -- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0004d90 msgr2=0x7f37c0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:36.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0004d90 0x7f37c0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d2ffd700 1 -- 172.21.15.71:0/2635143501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00035b0 con 0x7f37c0003a00 2023-07-06T01:10:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37c0003a00 0x7f37c0003e10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c190 tx=0x7f37c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4cb39e981863cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4007b70 con 0x7f37c0003a00 2023-07-06T01:10:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c400ccd0 con 0x7f37c0003a00 2023-07-06T01:10:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.189+0000 7f37d27fc700 1 -- 172.21.15.71:0/2635143501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c4005ba0 con 0x7f37c0003a00 2023-07-06T01:10:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d99ff700 1 -- 172.21.15.71:0/2635143501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37c0003a00 msgr2=0x7f37c0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:36.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d99ff700 1 --2- 172.21.15.71:0/2635143501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37c0003a00 0x7f37c0003e10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c190 tx=0x7f37c0005880 comp rx=0 tx=0).stop 2023-07-06T01:10:36.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d37fe700 1 -- 172.21.15.71:0/2635143501 reap_dead start 2023-07-06T01:10:36.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d99ff700 1 -- 172.21.15.71:0/2635143501 shutdown_connections 2023-07-06T01:10:36.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d99ff700 1 -- 172.21.15.71:0/2635143501 >> 172.21.15.71:0/2635143501 conn(0x7f37d406be10 msgr2=0x7f37d4071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:36.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d99ff700 1 -- 172.21.15.71:0/2635143501 shutdown_connections 2023-07-06T01:10:36.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.190+0000 7f37d99ff700 1 -- 172.21.15.71:0/2635143501 wait complete. 2023-07-06T01:10:36.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.192+0000 7f37d99ff700 1 Processor -- start 2023-07-06T01:10:36.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.192+0000 7f37d99ff700 1 -- start start 2023-07-06T01:10:36.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d99ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0003a00 0x7f37d40c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d99ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d415dbc0 0x7f37d4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d99ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 0x7f37d4148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d99ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40c61c0 con 0x7f37d415e030 2023-07-06T01:10:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d99ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d4159090 con 0x7f37c0003a00 2023-07-06T01:10:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d99ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d40c73b0 con 0x7f37d415dbc0 2023-07-06T01:10:36.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 0x7f37d4148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 0x7f37d4148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54220/0 (socket says 172.21.15.71:54220) 2023-07-06T01:10:36.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 -- 172.21.15.71:0/3847419514 learned_addr learned my addr 172.21.15.71:0/3847419514 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:36.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37cbfff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d415dbc0 0x7f37d4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0003a00 0x7f37d40c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 -- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d415dbc0 msgr2=0x7f37d4147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:36.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d415dbc0 0x7f37d4147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 -- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0003a00 msgr2=0x7f37d40c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0003a00 0x7f37d40c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.193+0000 7f37d37fe700 1 -- 172.21.15.71:0/3847419514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4148a30 con 0x7f37d415e030 2023-07-06T01:10:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.194+0000 7f37d37fe700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 0x7f37d4148420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f37d40cec60 tx=0x7f37cc0111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:36.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.194+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00e070 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.194+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc003cf0 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.194+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d4148d10 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.194+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0117a0 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.194+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d4158980 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.195+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d4159370 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.196+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37cc011900 con 0x7f37d415e030 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.197+0000 7f37d0ff9700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f37b406ace0 0x7f37b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:36.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.197+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f37cc089700 con 0x7f37d415e030 2023-07-06T01:10:36.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.198+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f37b406ace0 0x7f37b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:36.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.199+0000 7f37d2ffd700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f37b406ace0 0x7f37b406d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f37c4015040 tx=0x7f37c400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:36.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.202+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37cc054850 con 0x7f37d415e030 2023-07-06T01:10:36.400 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.398+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37d41591d0 con 0x7f37d415e030 2023-07-06T01:10:36.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.966+0000 7f37d0ff9700 1 -- 172.21.15.71:0/3847419514 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f37d41591d0 con 0x7f37d415e030 2023-07-06T01:10:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f37b406ace0 msgr2=0x7f37b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f37b406ace0 0x7f37b406d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f37c4015040 tx=0x7f37c400a000 comp rx=0 tx=0).stop 2023-07-06T01:10:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 msgr2=0x7f37d4148420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 0x7f37d4148420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f37d40cec60 tx=0x7f37cc0111d0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 shutdown_connections 2023-07-06T01:10:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f37b406ace0 0x7f37b406d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37d415e030 0x7f37d4148420 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37c0003a00 0x7f37d40c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 --2- 172.21.15.71:0/3847419514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f37d415dbc0 0x7f37d4147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 >> 172.21.15.71:0/3847419514 conn(0x7f37d406be10 msgr2=0x7f37d40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:36.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 shutdown_connections 2023-07-06T01:10:36.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:36.969+0000 7f37d99ff700 1 -- 172.21.15.71:0/3847419514 wait complete. 2023-07-06T01:10:36.974 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-07-06T01:10:36.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-06T01:10:37.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.185+0000 7f9a147ff700 1 Processor -- start 2023-07-06T01:10:37.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.186+0000 7f9a147ff700 1 -- start start 2023-07-06T01:10:37.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.187+0000 7f9a147ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 0x7f9a0c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.187+0000 7f9a147ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9a0c0b6100 0x7f9a0c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.187+0000 7f9a147ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0cf780 con 0x7f9a0c0b5c90 2023-07-06T01:10:37.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.187+0000 7f9a147ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0cd490 con 0x7f9a0c0b6100 2023-07-06T01:10:37.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.187+0000 7f9a147ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0cd770 con 0x7f9a0c15fca0 2023-07-06T01:10:37.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 0x7f9a0c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a12d9c700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9a0c0b6100 0x7f9a0c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 0x7f9a0c0d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:40322/0 (socket says 172.21.15.71:40322) 2023-07-06T01:10:37.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 -- 172.21.15.71:0/670450922 learned_addr learned my addr 172.21.15.71:0/670450922 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:37.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a11d9a700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9a0c0b5c90 0x7f9a0c0d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:50430/0 (socket says 172.21.15.71:50430) 2023-07-06T01:10:37.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a11599700 1 -- 172.21.15.71:0/670450922 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760108758 0 0) 0x7f9a0c0cf780 con 0x7f9a0c0b5c90 2023-07-06T01:10:37.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a11599700 1 -- 172.21.15.71:0/670450922 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f80035b0 con 0x7f9a0c0b5c90 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 -- 172.21.15.71:0/670450922 >> v2:172.21.15.194:3300/0 conn(0x7f9a0c0b6100 msgr2=0x7f9a0c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 --2- 172.21.15.71:0/670450922 >> v2:172.21.15.194:3300/0 conn(0x7f9a0c0b6100 0x7f9a0c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 -- 172.21.15.71:0/670450922 >> v1:172.21.15.194:6789/0 conn(0x7f9a0c0b5c90 legacy=0x7f9a0c0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a1259b700 1 -- 172.21.15.71:0/670450922 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0cda50 con 0x7f9a0c15fca0 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.188+0000 7f9a12d9c700 1 --2- 172.21.15.71:0/670450922 >> v2:172.21.15.194:3300/0 conn(0x7f9a0c0b6100 0x7f9a0c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.189+0000 7f9a1259b700 1 --2- 172.21.15.71:0/670450922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 0x7f9a0c0d1420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098f0 tx=0x7f9a08009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0b8e71f93bd303 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.189+0000 7f9a11599700 1 -- 172.21.15.71:0/670450922 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08011830 con 0x7f9a0c15fca0 2023-07-06T01:10:37.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.189+0000 7f9a11599700 1 -- 172.21.15.71:0/670450922 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08011990 con 0x7f9a0c15fca0 2023-07-06T01:10:37.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.189+0000 7f9a11599700 1 -- 172.21.15.71:0/670450922 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08011d20 con 0x7f9a0c15fca0 2023-07-06T01:10:37.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 -- 172.21.15.71:0/670450922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 msgr2=0x7f9a0c0d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 --2- 172.21.15.71:0/670450922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 0x7f9a0c0d1420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a080098f0 tx=0x7f9a08009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:37.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 -- 172.21.15.71:0/670450922 shutdown_connections 2023-07-06T01:10:37.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 --2- 172.21.15.71:0/670450922 >> v2:172.21.15.194:3300/0 conn(0x7f9a0c0b6100 0x7f9a0c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 --2- 172.21.15.71:0/670450922 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c15fca0 0x7f9a0c0d1420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 -- 172.21.15.71:0/670450922 >> 172.21.15.71:0/670450922 conn(0x7f9a0c06c150 msgr2=0x7f9a0c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:37.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 -- 172.21.15.71:0/670450922 shutdown_connections 2023-07-06T01:10:37.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.190+0000 7f9a147ff700 1 -- 172.21.15.71:0/670450922 wait complete. 2023-07-06T01:10:37.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.192+0000 7f9a147ff700 1 Processor -- start 2023-07-06T01:10:37.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.193+0000 7f9a147ff700 1 -- start start 2023-07-06T01:10:37.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a147ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c0b5c90 0x7f9a0c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a147ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 0x7f9a0c0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a147ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0c15fca0 0x7f9a0c0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a147ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1571f0 con 0x7f9a0c0b6100 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a147ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0b4330 con 0x7f9a0c15fca0 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a147ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0b2d50 con 0x7f9a0c0b5c90 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 0x7f9a0c0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 0x7f9a0c0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54232/0 (socket says 172.21.15.71:54232) 2023-07-06T01:10:37.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a1259b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c0b5c90 0x7f9a0c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 -- 172.21.15.71:0/2433784440 learned_addr learned my addr 172.21.15.71:0/2433784440 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a12d9c700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0c15fca0 0x7f9a0c0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 -- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c0b5c90 msgr2=0x7f9a0c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c0b5c90 0x7f9a0c156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 -- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0c15fca0 msgr2=0x7f9a0c0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0c15fca0 0x7f9a0c0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.194+0000 7f9a11d9a700 1 -- 172.21.15.71:0/2433784440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009a70 con 0x7f9a0c0b6100 2023-07-06T01:10:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.195+0000 7f9a11d9a700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 0x7f9a0c0b3df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c700 tx=0x7f99fc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.195+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc005cb0 con 0x7f9a0c0b6100 2023-07-06T01:10:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.195+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc005e10 con 0x7f9a0c0b6100 2023-07-06T01:10:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.195+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0072d0 con 0x7f9a0c0b6100 2023-07-06T01:10:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.195+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08009550 con 0x7f9a0c0b6100 2023-07-06T01:10:37.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.195+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c0b30e0 con 0x7f9a0c0b6100 2023-07-06T01:10:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.196+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c0008d0 con 0x7f9a0c0b6100 2023-07-06T01:10:37.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.197+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99fc007430 con 0x7f9a0c0b6100 2023-07-06T01:10:37.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.198+0000 7f9a02ffd700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f99f006ace0 0x7f99f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.198+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f99fc0884b0 con 0x7f9a0c0b6100 2023-07-06T01:10:37.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.199+0000 7f9a1259b700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f99f006ace0 0x7f99f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.199+0000 7f9a1259b700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f99f006ace0 0x7f99f006d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009c40 tx=0x7f9a08008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:37.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.202+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99fc053910 con 0x7f9a0c0b6100 2023-07-06T01:10:37.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.396+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9a0c0d2630 con 0x7f9a0c0b6100 2023-07-06T01:10:37.402 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.400+0000 7f9a02ffd700 1 -- 172.21.15.71:0/2433784440 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f99fc056f30 con 0x7f9a0c0b6100 2023-07-06T01:10:37.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.402+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f99f006ace0 msgr2=0x7f99f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f99f006ace0 0x7f99f006d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009c40 tx=0x7f9a08008030 comp rx=0 tx=0).stop 2023-07-06T01:10:37.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 msgr2=0x7f9a0c0b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 0x7f9a0c0b3df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c700 tx=0x7f99fc00ca10 comp rx=0 tx=0).stop 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 shutdown_connections 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f99f006ace0 0x7f99f006d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0c15fca0 0x7f9a0c0b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a0c0b5c90 0x7f9a0c156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 --2- 172.21.15.71:0/2433784440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a0c0b6100 0x7f9a0c0b3df0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 >> 172.21.15.71:0/2433784440 conn(0x7f9a0c06c150 msgr2=0x7f9a0c0b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:37.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 shutdown_connections 2023-07-06T01:10:37.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.403+0000 7f9a147ff700 1 -- 172.21.15.71:0/2433784440 wait complete. 2023-07-06T01:10:37.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-07-06T01:10:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.615+0000 7f66d2dff700 1 Processor -- start 2023-07-06T01:10:37.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.615+0000 7f66d2dff700 1 -- start start 2023-07-06T01:10:37.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.616+0000 7f66d2dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66cc158cd0 0x7f66cc0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.616+0000 7f66d2dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.616+0000 7f66d2dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc0cd370 con 0x7f66cc0c9010 2023-07-06T01:10:37.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.616+0000 7f66d2dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc0cbf50 con 0x7f66cc158cd0 2023-07-06T01:10:37.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.616+0000 7f66d2dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0cd7b0 con 0x7f66cc0ce420 2023-07-06T01:10:37.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66cc158cd0 0x7f66cc0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f66cc158cd0 0x7f66cc0cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54242/0 (socket says 172.21.15.71:54242) 2023-07-06T01:10:37.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 -- 172.21.15.71:0/19442823 learned_addr learned my addr 172.21.15.71:0/19442823 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:37.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d139c700 1 --2- 172.21.15.71:0/19442823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 -- 172.21.15.71:0/19442823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 msgr2=0x7f66cc0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:37.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 --2- 172.21.15.71:0/19442823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 -- 172.21.15.71:0/19442823 >> v1:172.21.15.194:6789/0 conn(0x7f66cc0c9010 legacy=0x7f66cc06b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:37.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 -- 172.21.15.71:0/19442823 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0ad7f0 con 0x7f66cc158cd0 2023-07-06T01:10:37.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.617+0000 7f66d0b9b700 1 --2- 172.21.15.71:0/19442823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc0cdee0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f66c00098f0 tx=0x7f66c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a3478018cb910f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:37.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66cb7fe700 1 -- 172.21.15.71:0/19442823 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0004230 con 0x7f66cc158cd0 2023-07-06T01:10:37.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66cb7fe700 1 -- 172.21.15.71:0/19442823 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0004390 con 0x7f66cc158cd0 2023-07-06T01:10:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66cb7fe700 1 -- 172.21.15.71:0/19442823 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00036a0 con 0x7f66cc158cd0 2023-07-06T01:10:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 -- 172.21.15.71:0/19442823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 msgr2=0x7f66cc0cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 --2- 172.21.15.71:0/19442823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc0cdee0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f66c00098f0 tx=0x7f66c0009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:37.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 -- 172.21.15.71:0/19442823 shutdown_connections 2023-07-06T01:10:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 --2- 172.21.15.71:0/19442823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 --2- 172.21.15.71:0/19442823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc0cdee0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 -- 172.21.15.71:0/19442823 >> 172.21.15.71:0/19442823 conn(0x7f66cc0cb440 msgr2=0x7f66cc0cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:37.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 -- 172.21.15.71:0/19442823 shutdown_connections 2023-07-06T01:10:37.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.618+0000 7f66d2dff700 1 -- 172.21.15.71:0/19442823 wait complete. 2023-07-06T01:10:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.620+0000 7f66d2dff700 1 Processor -- start 2023-07-06T01:10:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.620+0000 7f66d2dff700 1 -- start start 2023-07-06T01:10:37.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d2dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc0c9010 0x7f66cc0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d2dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d2dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d2dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc0b2ae0 con 0x7f66cc158cd0 2023-07-06T01:10:37.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d2dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc15b260 con 0x7f66cc0c9010 2023-07-06T01:10:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d2dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc15a3d0 con 0x7f66cc0ce420 2023-07-06T01:10:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d139c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54254/0 (socket says 172.21.15.71:54254) 2023-07-06T01:10:37.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.621+0000 7f66d139c700 1 -- 172.21.15.71:0/212851210 learned_addr learned my addr 172.21.15.71:0/212851210 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d0b9b700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc0c9010 0x7f66cc0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66cbfff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d139c700 1 -- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 msgr2=0x7f66cc159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d139c700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d139c700 1 -- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc0c9010 msgr2=0x7f66cc0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d139c700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc0c9010 0x7f66cc0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d139c700 1 -- 172.21.15.71:0/212851210 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009550 con 0x7f66cc158cd0 2023-07-06T01:10:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d139c700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc1561f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66c400cc60 tx=0x7f66c400a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c400ce60 con 0x7f66cc158cd0 2023-07-06T01:10:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400acf0 con 0x7f66cc158cd0 2023-07-06T01:10:37.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4003c40 con 0x7f66cc158cd0 2023-07-06T01:10:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc15a650 con 0x7f66cc158cd0 2023-07-06T01:10:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.622+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc15ac10 con 0x7f66cc158cd0 2023-07-06T01:10:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.623+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc0008d0 con 0x7f66cc158cd0 2023-07-06T01:10:37.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.624+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66c400f3f0 con 0x7f66cc158cd0 2023-07-06T01:10:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.626+0000 7f66c97fa700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f66b006ad10 0x7f66b006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.626+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f66c4089360 con 0x7f66cc158cd0 2023-07-06T01:10:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.627+0000 7f66d0b9b700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f66b006ad10 0x7f66b006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:37.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.627+0000 7f66d0b9b700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f66b006ad10 0x7f66b006d1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009840 tx=0x7f66c0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:37.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.630+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f66c4054690 con 0x7f66cc158cd0 2023-07-06T01:10:37.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.916+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f66cc0cb8b0 con 0x7f66cc158cd0 2023-07-06T01:10:37.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.967+0000 7f66c97fa700 1 -- 172.21.15.71:0/212851210 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v122) v1 ==== 160+0+0 (secure 0 0 0) 0x7f66c400ae60 con 0x7f66cc158cd0 2023-07-06T01:10:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f66b006ad10 msgr2=0x7f66b006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f66b006ad10 0x7f66b006d1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009840 tx=0x7f66c0008030 comp rx=0 tx=0).stop 2023-07-06T01:10:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 msgr2=0x7f66cc1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc1561f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66c400cc60 tx=0x7f66c400a4d0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 shutdown_connections 2023-07-06T01:10:37.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f66b006ad10 0x7f66b006d1c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f66cc158cd0 0x7f66cc1561f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc0c9010 0x7f66cc0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 --2- 172.21.15.71:0/212851210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66cc0ce420 0x7f66cc159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:37.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 >> 172.21.15.71:0/212851210 conn(0x7f66cc0cb440 msgr2=0x7f66cc06f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:37.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 shutdown_connections 2023-07-06T01:10:37.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:37.969+0000 7f66d2dff700 1 -- 172.21.15.71:0/212851210 wait complete. 2023-07-06T01:10:37.989 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) ... ERROR 2023-07-06T01:10:37.990 INFO:tasks.cephfs_test_runner: 2023-07-06T01:10:37.990 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-06T01:10:37.991 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-07-06T01:10:37.991 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T01:10:37.991 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-06T01:10:37.991 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values 2023-07-06T01:10:37.991 INFO:tasks.cephfs_test_runner: self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K") 2023-07-06T01:10:37.992 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/mount.py", line 1488, in setfattr 2023-07-06T01:10:37.992 INFO:tasks.cephfs_test_runner: self.run_shell(**kwargs) 2023-07-06T01:10:37.992 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-07-06T01:10:37.992 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-07-06T01:10:37.993 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 522, in run 2023-07-06T01:10:37.993 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-06T01:10:37.993 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 455, in run 2023-07-06T01:10:37.993 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-06T01:10:37.993 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 161, in wait 2023-07-06T01:10:37.993 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-06T01:10:37.994 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-06T01:10:37.994 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-06T01:10:37.994 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi071 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)' 2023-07-06T01:10:37.994 INFO:tasks.cephfs_test_runner: 2023-07-06T01:10:37.994 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T01:10:37.995 INFO:tasks.cephfs_test_runner:Ran 1 test in 61.652s 2023-07-06T01:10:37.995 INFO:tasks.cephfs_test_runner: 2023-07-06T01:10:37.995 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-07-06T01:10:37.995 INFO:tasks.cephfs_test_runner: 2023-07-06T01:10:37.995 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-06T01:10:37.996 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-07-06T01:10:37.996 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-06T01:10:37.996 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-06T01:10:37.996 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values 2023-07-06T01:10:37.997 INFO:tasks.cephfs_test_runner: self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K") 2023-07-06T01:10:37.997 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/mount.py", line 1488, in setfattr 2023-07-06T01:10:37.997 INFO:tasks.cephfs_test_runner: self.run_shell(**kwargs) 2023-07-06T01:10:37.997 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-07-06T01:10:37.997 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-07-06T01:10:37.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 522, in run 2023-07-06T01:10:37.998 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-07-06T01:10:37.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 455, in run 2023-07-06T01:10:37.998 INFO:tasks.cephfs_test_runner: r.wait() 2023-07-06T01:10:37.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 161, in wait 2023-07-06T01:10:37.999 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-07-06T01:10:37.999 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-07-06T01:10:37.999 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-07-06T01:10:37.999 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi071 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)' 2023-07-06T01:10:37.999 INFO:tasks.cephfs_test_runner: 2023-07-06T01:10:38.000 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-07-06T01:10:38.076 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2bc9edb05b9c4ecba6064bbe068519ba Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-07-06T01:10:38.079 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-06T01:10:38.088 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-06T01:10:38.214 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-06T01:10:38.215 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:10:38.217 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:38.278 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-06T01:10:38.279 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-07-06T01:10:38.279 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:38.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345640k,nr_inodes=4086410,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-07-06T01:10:38.364 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:10:38.364 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:38.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345700k,nr_inodes=4086425,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T01:10:38.416 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-07-06T01:10:38.416 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T01:10:38.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345700k,nr_inodes=4086425,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-06T01:10:38.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.465 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:10:38.510 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T01:10:38.511 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T01:10:38.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T01:10:38.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T01:10:38.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-07-06T01:10:38.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.804 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-07-06T01:10:38.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-07-06T01:10:38.927 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2023-07-06T01:10:38.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:10:38.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.931 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:10:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-06T01:10:38.980 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T01:10:38.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:38.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T01:10:39.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:39.054 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T01:10:39.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:39.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-07-06T01:10:39.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:39.252 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-07-06T01:10:39.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T01:10:39.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-07-06T01:10:39.375 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2023-07-06T01:10:39.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:10:39.378 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-06T01:10:39.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-06T01:10:39.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:39.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.587+0000 7f195c7ff700 1 Processor -- start 2023-07-06T01:10:39.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.587+0000 7f195c7ff700 1 -- start start 2023-07-06T01:10:39.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.588+0000 7f195c7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19540cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:39.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.588+0000 7f195c7ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f19540c9010 0x7f195406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:39.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.588+0000 7f195c7ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540cd370 con 0x7f19540ce420 2023-07-06T01:10:39.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.588+0000 7f195c7ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540cbf50 con 0x7f19540c9010 2023-07-06T01:10:39.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.588+0000 7f195c7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540cd7b0 con 0x7f1954158cd0 2023-07-06T01:10:39.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195a59b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19540cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:39.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f1959d9a700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f19540c9010 0x7f195406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:39.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195ad9c700 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f19540ce420 0x7f19540cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.71:50450/0 (socket says 172.21.15.71:50450) 2023-07-06T01:10:39.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195a59b700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19540cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:40352/0 (socket says 172.21.15.71:40352) 2023-07-06T01:10:39.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195ad9c700 1 -- 172.21.15.71:0/2097559027 learned_addr learned my addr 172.21.15.71:0/2097559027 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:39.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195a59b700 1 -- 172.21.15.71:0/2097559027 >> v2:172.21.15.194:3300/0 conn(0x7f19540c9010 msgr2=0x7f195406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:39.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195a59b700 1 --2- 172.21.15.71:0/2097559027 >> v2:172.21.15.194:3300/0 conn(0x7f19540c9010 0x7f195406b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195a59b700 1 -- 172.21.15.71:0/2097559027 >> v1:172.21.15.194:6789/0 conn(0x7f19540ce420 legacy=0x7f19540cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:39.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f195a59b700 1 -- 172.21.15.71:0/2097559027 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540ad7f0 con 0x7f1954158cd0 2023-07-06T01:10:39.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.589+0000 7f1959d9a700 1 --2- 172.21.15.71:0/2097559027 >> v2:172.21.15.194:3300/0 conn(0x7f19540c9010 0x7f195406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.590+0000 7f195a59b700 1 --2- 172.21.15.71:0/2097559027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19540cdee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f195000b8f0 tx=0x7f195000bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7adf78cbdf6b1540 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.590+0000 7f1959599700 1 -- 172.21.15.71:0/2097559027 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000c9f0 con 0x7f1954158cd0 2023-07-06T01:10:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.590+0000 7f1959599700 1 -- 172.21.15.71:0/2097559027 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195000cb50 con 0x7f1954158cd0 2023-07-06T01:10:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.590+0000 7f1959599700 1 -- 172.21.15.71:0/2097559027 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000f460 con 0x7f1954158cd0 2023-07-06T01:10:39.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 -- 172.21.15.71:0/2097559027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 msgr2=0x7f19540cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2097559027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19540cdee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f195000b8f0 tx=0x7f195000bc00 comp rx=0 tx=0).stop 2023-07-06T01:10:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 -- 172.21.15.71:0/2097559027 shutdown_connections 2023-07-06T01:10:39.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2097559027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19540cdee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2097559027 >> v2:172.21.15.194:3300/0 conn(0x7f19540c9010 0x7f195406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 -- 172.21.15.71:0/2097559027 >> 172.21.15.71:0/2097559027 conn(0x7f19540cb440 msgr2=0x7f19540cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:39.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 -- 172.21.15.71:0/2097559027 shutdown_connections 2023-07-06T01:10:39.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.591+0000 7f195c7ff700 1 -- 172.21.15.71:0/2097559027 wait complete. 2023-07-06T01:10:39.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.592+0000 7f195c7ff700 1 Processor -- start 2023-07-06T01:10:39.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 -- start start 2023-07-06T01:10:39.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19540c9010 0x7f195415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:39.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 0x7f19540c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:39.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19541f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:39.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1954147900 con 0x7f19540ce420 2023-07-06T01:10:39.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195415ade0 con 0x7f19540c9010 2023-07-06T01:10:39.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.593+0000 7f195c7ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195415b0c0 con 0x7f1954158cd0 2023-07-06T01:10:39.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 0x7f19540c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:39.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 0x7f19540c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54258/0 (socket says 172.21.15.71:54258) 2023-07-06T01:10:39.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 -- 172.21.15.71:0/2475231396 learned_addr learned my addr 172.21.15.71:0/2475231396 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:39.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f195a59b700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19540c9010 0x7f195415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:39.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f195ad9c700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19541f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:39.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 -- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 msgr2=0x7f19541f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:39.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19541f13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 -- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19540c9010 msgr2=0x7f195415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19540c9010 0x7f195415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 -- 172.21.15.71:0/2475231396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194400d940 con 0x7f19540ce420 2023-07-06T01:10:39.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f195a59b700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19540c9010 0x7f195415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.594+0000 7f1959d9a700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 0x7f19540c24f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1944012fc0 tx=0x7f19440103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.595+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944010b00 con 0x7f19540ce420 2023-07-06T01:10:39.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.595+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944013040 con 0x7f19540ce420 2023-07-06T01:10:39.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.595+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944010e80 con 0x7f19540ce420 2023-07-06T01:10:39.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.595+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195000b550 con 0x7f19540ce420 2023-07-06T01:10:39.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.595+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195415b680 con 0x7f19540ce420 2023-07-06T01:10:39.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.596+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19540008d0 con 0x7f19540ce420 2023-07-06T01:10:39.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.597+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1944018480 con 0x7f19540ce420 2023-07-06T01:10:39.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.598+0000 7f194affd700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f193806ace0 0x7f193806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:39.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.598+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f194408d0c0 con 0x7f19540ce420 2023-07-06T01:10:39.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.598+0000 7f195a59b700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f193806ace0 0x7f193806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:39.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.599+0000 7f195a59b700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f193806ace0 0x7f193806d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19500090b0 tx=0x7f1950019040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:39.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.602+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1944058500 con 0x7f19540ce420 2023-07-06T01:10:39.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.792+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f195415b230 con 0x7f193806ace0 2023-07-06T01:10:39.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.796+0000 7f194affd700 1 -- 172.21.15.71:0/2475231396 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72118 (secure 0 0 0) 0x7f195415b230 con 0x7f193806ace0 2023-07-06T01:10:39.800 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:39.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f193806ace0 msgr2=0x7f193806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:39.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f193806ace0 0x7f193806d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19500090b0 tx=0x7f1950019040 comp rx=0 tx=0).stop 2023-07-06T01:10:39.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 msgr2=0x7f19540c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:39.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 0x7f19540c24f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1944012fc0 tx=0x7f19440103a0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 shutdown_connections 2023-07-06T01:10:39.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f193806ace0 0x7f193806d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1954158cd0 0x7f19541f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19540c9010 0x7f195415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 --2- 172.21.15.71:0/2475231396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19540ce420 0x7f19540c24f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:39.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 >> 172.21.15.71:0/2475231396 conn(0x7f19540cb440 msgr2=0x7f195406f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:39.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 shutdown_connections 2023-07-06T01:10:39.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:39.798+0000 7f195c7ff700 1 -- 172.21.15.71:0/2475231396 wait complete. 2023-07-06T01:10:39.806 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:39.819 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-07-06T01:10:38.857444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4845568,"data_stored":2714798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8401,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099512+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:34.099512+0000","last_peered":"2023-07-06T01:10:34.099512+0000","last_clean":"2023-07-06T01:10:34.099512+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:34.099512+0000","last_undegraded":"2023-07-06T01:10:34.099512+0000","last_fullsized":"2023-07-06T01:10:34.099512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:34:13.021149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101078+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:34.101078+0000","last_peered":"2023-07-06T01:10:34.101078+0000","last_clean":"2023-07-06T01:10:34.101078+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:34.101078+0000","last_undegraded":"2023-07-06T01:10:34.101078+0000","last_fullsized":"2023-07-06T01:10:34.101078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:51.573052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099245+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:34.099245+0000","last_peered":"2023-07-06T01:10:34.099245+0000","last_clean":"2023-07-06T01:10:34.099245+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:34.099245+0000","last_undegraded":"2023-07-06T01:10:34.099245+0000","last_fullsized":"2023-07-06T01:10:34.099245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:34.582273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101882+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:34.101882+0000","last_peered":"2023-07-06T01:10:34.101882+0000","last_clean":"2023-07-06T01:10:34.101882+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:34.101882+0000","last_undegraded":"2023-07-06T01:10:34.101882+0000","last_fullsized":"2023-07-06T01:10:34.101882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:06.121024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100101+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:34.100101+0000","last_peered":"2023-07-06T01:10:34.100101+0000","last_clean":"2023-07-06T01:10:34.100101+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:34.100101+0000","last_undegraded":"2023-07-06T01:10:34.100101+0000","last_fullsized":"2023-07-06T01:10:34.100101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:44.528852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100240+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:34.100240+0000","last_peered":"2023-07-06T01:10:34.100240+0000","last_clean":"2023-07-06T01:10:34.100240+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:34.100240+0000","last_undegraded":"2023-07-06T01:10:34.100240+0000","last_fullsized":"2023-07-06T01:10:34.100240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T13:06:24.549664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101652+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:34.101652+0000","last_peered":"2023-07-06T01:10:34.101652+0000","last_clean":"2023-07-06T01:10:34.101652+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:34.101652+0000","last_undegraded":"2023-07-06T01:10:34.101652+0000","last_fullsized":"2023-07-06T01:10:34.101652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:06:35.529354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099646+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:34.099646+0000","last_peered":"2023-07-06T01:10:34.099646+0000","last_clean":"2023-07-06T01:10:34.099646+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:34.099646+0000","last_undegraded":"2023-07-06T01:10:34.099646+0000","last_fullsized":"2023-07-06T01:10:34.099646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:54:29.055439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100547+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:34.100547+0000","last_peered":"2023-07-06T01:10:34.100547+0000","last_clean":"2023-07-06T01:10:34.100547+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:34.100547+0000","last_undegraded":"2023-07-06T01:10:34.100547+0000","last_fullsized":"2023-07-06T01:10:34.100547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:56.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.626},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.749}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":189442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.748}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.627}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":188950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.497},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.96099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":785642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.84999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":188930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.628},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":196497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":189464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.747}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.874}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.499}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.62},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":188972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:39.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:40.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.016+0000 7fb3d9bff700 1 Processor -- start 2023-07-06T01:10:40.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.016+0000 7fb3d9bff700 1 -- start start 2023-07-06T01:10:40.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.017+0000 7fb3d9bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.017+0000 7fb3d9bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3d40b5c90 0x7fb3d40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.017+0000 7fb3d9bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d40cf780 con 0x7fb3d40b6100 2023-07-06T01:10:40.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.017+0000 7fb3d9bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40cd490 con 0x7fb3d40b5c90 2023-07-06T01:10:40.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.017+0000 7fb3d9bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40cd770 con 0x7fb3d415fca0 2023-07-06T01:10:40.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d40d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:40372/0 (socket says 172.21.15.71:40372) 2023-07-06T01:10:40.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 -- 172.21.15.71:0/3663728410 learned_addr learned my addr 172.21.15.71:0/3663728410 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:40.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d2ffd700 1 --2- 172.21.15.71:0/3663728410 >> v2:172.21.15.194:3300/0 conn(0x7fb3d40b5c90 0x7fb3d40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 -- 172.21.15.71:0/3663728410 >> v2:172.21.15.194:3300/0 conn(0x7fb3d40b5c90 msgr2=0x7fb3d40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:40.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 --2- 172.21.15.71:0/3663728410 >> v2:172.21.15.194:3300/0 conn(0x7fb3d40b5c90 0x7fb3d40d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 -- 172.21.15.71:0/3663728410 >> v1:172.21.15.194:6789/0 conn(0x7fb3d40b6100 legacy=0x7fb3d40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 -- 172.21.15.71:0/3663728410 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40cda50 con 0x7fb3d415fca0 2023-07-06T01:10:40.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.018+0000 7fb3d37fe700 1 --2- 172.21.15.71:0/3663728410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d40d1420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40098f0 tx=0x7fb3c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf6a124bdc3a5ce server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d27fc700 1 -- 172.21.15.71:0/3663728410 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011830 con 0x7fb3d415fca0 2023-07-06T01:10:40.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d27fc700 1 -- 172.21.15.71:0/3663728410 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c4011990 con 0x7fb3d415fca0 2023-07-06T01:10:40.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d27fc700 1 -- 172.21.15.71:0/3663728410 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011d20 con 0x7fb3d415fca0 2023-07-06T01:10:40.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 -- 172.21.15.71:0/3663728410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 msgr2=0x7fb3d40d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/3663728410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d40d1420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40098f0 tx=0x7fb3c4009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:40.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 -- 172.21.15.71:0/3663728410 shutdown_connections 2023-07-06T01:10:40.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/3663728410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d40d1420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/3663728410 >> v2:172.21.15.194:3300/0 conn(0x7fb3d40b5c90 0x7fb3d40d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 -- 172.21.15.71:0/3663728410 >> 172.21.15.71:0/3663728410 conn(0x7fb3d406c150 msgr2=0x7fb3d406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:40.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 -- 172.21.15.71:0/3663728410 shutdown_connections 2023-07-06T01:10:40.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.019+0000 7fb3d9bff700 1 -- 172.21.15.71:0/3663728410 wait complete. 2023-07-06T01:10:40.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.021+0000 7fb3d9bff700 1 Processor -- start 2023-07-06T01:10:40.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.021+0000 7fb3d9bff700 1 -- start start 2023-07-06T01:10:40.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d9bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 0x7fb3d40b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d9bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d40b6100 0x7fb3d41f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d9bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d41f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d9bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41e5fe0 con 0x7fb3d40b5c90 2023-07-06T01:10:40.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d9bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41f6380 con 0x7fb3d40b6100 2023-07-06T01:10:40.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d9bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40b4e10 con 0x7fb3d415fca0 2023-07-06T01:10:40.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 0x7fb3d40b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 0x7fb3d40b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54274/0 (socket says 172.21.15.71:54274) 2023-07-06T01:10:40.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d37fe700 1 -- 172.21.15.71:0/776290109 learned_addr learned my addr 172.21.15.71:0/776290109 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:40.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d2ffd700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d40b6100 0x7fb3d41f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.022+0000 7fb3d3fff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d41f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d37fe700 1 -- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 msgr2=0x7fb3d41f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d37fe700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d41f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d37fe700 1 -- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d40b6100 msgr2=0x7fb3d41f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d37fe700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d40b6100 0x7fb3d41f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d37fe700 1 -- 172.21.15.71:0/776290109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4009550 con 0x7fb3d40b5c90 2023-07-06T01:10:40.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d3fff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d41f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:40.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d37fe700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 0x7fb3d40b47e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4014040 tx=0x7fb3c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4004480 con 0x7fb3d40b5c90 2023-07-06T01:10:40.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c401f070 con 0x7fb3d40b5c90 2023-07-06T01:10:40.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d40b50f0 con 0x7fb3d40b5c90 2023-07-06T01:10:40.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.023+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40038e0 con 0x7fb3d40b5c90 2023-07-06T01:10:40.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.024+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d40b56b0 con 0x7fb3d40b5c90 2023-07-06T01:10:40.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.025+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d40008d0 con 0x7fb3d40b5c90 2023-07-06T01:10:40.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.025+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3c4021030 con 0x7fb3d40b5c90 2023-07-06T01:10:40.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.026+0000 7fb3bbfff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb3c006ace0 0x7fb3c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.026+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb3c408a530 con 0x7fb3d40b5c90 2023-07-06T01:10:40.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.027+0000 7fb3d2ffd700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb3c006ace0 0x7fb3c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.028+0000 7fb3d2ffd700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb3c006ace0 0x7fb3c006d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4073670 tx=0x7fb3c8009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.031+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3c4055a90 con 0x7fb3d40b5c90 2023-07-06T01:10:40.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.219+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3d406ae40 con 0x7fb3c006ace0 2023-07-06T01:10:40.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.223+0000 7fb3bbfff700 1 -- 172.21.15.71:0/776290109 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72118 (secure 0 0 0) 0x7fb3c8011860 con 0x7fb3c006ace0 2023-07-06T01:10:40.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:40.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb3c006ace0 msgr2=0x7fb3c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb3c006ace0 0x7fb3c006d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4073670 tx=0x7fb3c8009210 comp rx=0 tx=0).stop 2023-07-06T01:10:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 msgr2=0x7fb3d40b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 0x7fb3d40b47e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4014040 tx=0x7fb3c4004750 comp rx=0 tx=0).stop 2023-07-06T01:10:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 shutdown_connections 2023-07-06T01:10:40.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb3c006ace0 0x7fb3c006d190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3d415fca0 0x7fb3d41f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb3d40b5c90 0x7fb3d40b47e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 --2- 172.21.15.71:0/776290109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3d40b6100 0x7fb3d41f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 >> 172.21.15.71:0/776290109 conn(0x7fb3d406c150 msgr2=0x7fb3d40d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:40.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 shutdown_connections 2023-07-06T01:10:40.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.225+0000 7fb3d9bff700 1 -- 172.21.15.71:0/776290109 wait complete. 2023-07-06T01:10:40.230 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:40.245 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-07-06T01:10:38.857444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4845568,"data_stored":2714798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8401,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099512+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:34.099512+0000","last_peered":"2023-07-06T01:10:34.099512+0000","last_clean":"2023-07-06T01:10:34.099512+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:34.099512+0000","last_undegraded":"2023-07-06T01:10:34.099512+0000","last_fullsized":"2023-07-06T01:10:34.099512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:34:13.021149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101078+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:34.101078+0000","last_peered":"2023-07-06T01:10:34.101078+0000","last_clean":"2023-07-06T01:10:34.101078+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:34.101078+0000","last_undegraded":"2023-07-06T01:10:34.101078+0000","last_fullsized":"2023-07-06T01:10:34.101078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:51.573052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099245+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:34.099245+0000","last_peered":"2023-07-06T01:10:34.099245+0000","last_clean":"2023-07-06T01:10:34.099245+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:34.099245+0000","last_undegraded":"2023-07-06T01:10:34.099245+0000","last_fullsized":"2023-07-06T01:10:34.099245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:34.582273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101882+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:34.101882+0000","last_peered":"2023-07-06T01:10:34.101882+0000","last_clean":"2023-07-06T01:10:34.101882+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:34.101882+0000","last_undegraded":"2023-07-06T01:10:34.101882+0000","last_fullsized":"2023-07-06T01:10:34.101882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:06.121024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100101+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:34.100101+0000","last_peered":"2023-07-06T01:10:34.100101+0000","last_clean":"2023-07-06T01:10:34.100101+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:34.100101+0000","last_undegraded":"2023-07-06T01:10:34.100101+0000","last_fullsized":"2023-07-06T01:10:34.100101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:44.528852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100240+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:34.100240+0000","last_peered":"2023-07-06T01:10:34.100240+0000","last_clean":"2023-07-06T01:10:34.100240+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:34.100240+0000","last_undegraded":"2023-07-06T01:10:34.100240+0000","last_fullsized":"2023-07-06T01:10:34.100240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T13:06:24.549664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101652+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:34.101652+0000","last_peered":"2023-07-06T01:10:34.101652+0000","last_clean":"2023-07-06T01:10:34.101652+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:34.101652+0000","last_undegraded":"2023-07-06T01:10:34.101652+0000","last_fullsized":"2023-07-06T01:10:34.101652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:06:35.529354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099646+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:34.099646+0000","last_peered":"2023-07-06T01:10:34.099646+0000","last_clean":"2023-07-06T01:10:34.099646+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:34.099646+0000","last_undegraded":"2023-07-06T01:10:34.099646+0000","last_fullsized":"2023-07-06T01:10:34.099646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:54:29.055439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100547+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:34.100547+0000","last_peered":"2023-07-06T01:10:34.100547+0000","last_clean":"2023-07-06T01:10:34.100547+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:34.100547+0000","last_undegraded":"2023-07-06T01:10:34.100547+0000","last_fullsized":"2023-07-06T01:10:34.100547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:56.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.626},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.749}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":189442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.748}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.627}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":188950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.497},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.96099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":785642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.84999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":188930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.628},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":196497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":189464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.747}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.874}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.499}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.62},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":188972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:40.248 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-06T01:10:40.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:40.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.439+0000 7f13fd3ff700 1 Processor -- start 2023-07-06T01:10:40.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.439+0000 7f13fd3ff700 1 -- start start 2023-07-06T01:10:40.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13fd3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13f815dc80 0x7f13f8160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13fd3ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f13f80d1250 0x7f13f8160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13fd3ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f806cb60 con 0x7f13f815d8b0 2023-07-06T01:10:40.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13fd3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f81613a0 con 0x7f13f815dc80 2023-07-06T01:10:40.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13fd3ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f806c230 con 0x7f13f80d1250 2023-07-06T01:10:40.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13f815dc80 0x7f13f8160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f13f815dc80 0x7f13f8160640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54278/0 (socket says 172.21.15.71:54278) 2023-07-06T01:10:40.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 -- 172.21.15.71:0/4060611626 learned_addr learned my addr 172.21.15.71:0/4060611626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:40.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13f77fe700 1 --2- 172.21.15.71:0/4060611626 >> v2:172.21.15.194:3300/0 conn(0x7f13f80d1250 0x7f13f8160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 -- 172.21.15.71:0/4060611626 >> v2:172.21.15.194:3300/0 conn(0x7f13f80d1250 msgr2=0x7f13f8160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:40.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 --2- 172.21.15.71:0/4060611626 >> v2:172.21.15.194:3300/0 conn(0x7f13f80d1250 0x7f13f8160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 -- 172.21.15.71:0/4060611626 >> v1:172.21.15.194:6789/0 conn(0x7f13f815d8b0 legacy=0x7f13f80d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.441+0000 7f13effff700 1 -- 172.21.15.71:0/4060611626 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f806c510 con 0x7f13f815dc80 2023-07-06T01:10:40.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13effff700 1 --2- 172.21.15.71:0/4060611626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815dc80 0x7f13f8160640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098f0 tx=0x7f13e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cba5b3d2a914496 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13f67fc700 1 -- 172.21.15.71:0/4060611626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e000b860 con 0x7f13f815dc80 2023-07-06T01:10:40.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13f67fc700 1 -- 172.21.15.71:0/4060611626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e000b9c0 con 0x7f13f815dc80 2023-07-06T01:10:40.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13f67fc700 1 -- 172.21.15.71:0/4060611626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e000bd50 con 0x7f13f815dc80 2023-07-06T01:10:40.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13fd3ff700 1 -- 172.21.15.71:0/4060611626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815dc80 msgr2=0x7f13f8160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/4060611626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815dc80 0x7f13f8160640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098f0 tx=0x7f13e0009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13fd3ff700 1 -- 172.21.15.71:0/4060611626 shutdown_connections 2023-07-06T01:10:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.442+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/4060611626 >> v2:172.21.15.194:3300/0 conn(0x7f13f80d1250 0x7f13f8160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.443+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/4060611626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815dc80 0x7f13f8160640 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.443+0000 7f13fd3ff700 1 -- 172.21.15.71:0/4060611626 >> 172.21.15.71:0/4060611626 conn(0x7f13f806db20 msgr2=0x7f13f806df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.443+0000 7f13fd3ff700 1 -- 172.21.15.71:0/4060611626 shutdown_connections 2023-07-06T01:10:40.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.443+0000 7f13fd3ff700 1 -- 172.21.15.71:0/4060611626 wait complete. 2023-07-06T01:10:40.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.444+0000 7f13fd3ff700 1 Processor -- start 2023-07-06T01:10:40.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.444+0000 7f13fd3ff700 1 -- start start 2023-07-06T01:10:40.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.445+0000 7f13fd3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13f80d1250 0x7f13f80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.445+0000 7f13fd3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 0x7f13f8141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.445+0000 7f13fd3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f80acdc0 0x7f13f8142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.445+0000 7f13fd3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80c6e30 con 0x7f13f815d8b0 2023-07-06T01:10:40.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.445+0000 7f13fd3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80c61b0 con 0x7f13f80acdc0 2023-07-06T01:10:40.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.445+0000 7f13fd3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80c6490 con 0x7f13f80d1250 2023-07-06T01:10:40.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 0x7f13f8141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 0x7f13f8141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54282/0 (socket says 172.21.15.71:54282) 2023-07-06T01:10:40.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 -- 172.21.15.71:0/1467569943 learned_addr learned my addr 172.21.15.71:0/1467569943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:40.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13f6ffd700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13f80d1250 0x7f13f80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13f77fe700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f80acdc0 0x7f13f8142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 -- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13f80d1250 msgr2=0x7f13f80ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13f80d1250 0x7f13f80ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 -- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f80acdc0 msgr2=0x7f13f8142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f80acdc0 0x7f13f8142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 -- 172.21.15.71:0/1467569943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0009550 con 0x7f13f815d8b0 2023-07-06T01:10:40.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13effff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 0x7f13f8141b20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f13e0014040 tx=0x7f13e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.446+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e0004300 con 0x7f13f815d8b0 2023-07-06T01:10:40.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.447+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e001f070 con 0x7f13f815d8b0 2023-07-06T01:10:40.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.447+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80c6770 con 0x7f13f815d8b0 2023-07-06T01:10:40.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.447+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e00036a0 con 0x7f13f815d8b0 2023-07-06T01:10:40.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.447+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f81532a0 con 0x7f13f815d8b0 2023-07-06T01:10:40.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.448+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f80c6f70 con 0x7f13f815d8b0 2023-07-06T01:10:40.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.449+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13e0021030 con 0x7f13f815d8b0 2023-07-06T01:10:40.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.450+0000 7f13ef7fe700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f13d806ace0 0x7f13d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.450+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f13e008a4a0 con 0x7f13f815d8b0 2023-07-06T01:10:40.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.450+0000 7f13f6ffd700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f13d806ace0 0x7f13d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.451+0000 7f13f6ffd700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f13d806ace0 0x7f13d806d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f13e8007fd0 tx=0x7f13e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.454+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f13f80c6f70 con 0x7f13f815d8b0 2023-07-06T01:10:40.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.650+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13f81610c0 con 0x7f13d806ace0 2023-07-06T01:10:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.654+0000 7f13ef7fe700 1 -- 172.21.15.71:0/1467569943 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72118 (secure 0 0 0) 0x7f13e8001560 con 0x7f13d806ace0 2023-07-06T01:10:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f13d806ace0 msgr2=0x7f13d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f13d806ace0 0x7f13d806d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f13e8007fd0 tx=0x7f13e8009040 comp rx=0 tx=0).stop 2023-07-06T01:10:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 msgr2=0x7f13f8141b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 0x7f13f8141b20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f13e0014040 tx=0x7f13e0004750 comp rx=0 tx=0).stop 2023-07-06T01:10:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 shutdown_connections 2023-07-06T01:10:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f13d806ace0 0x7f13d806d190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13f80acdc0 0x7f13f8142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13f80d1250 0x7f13f80ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 --2- 172.21.15.71:0/1467569943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13f815d8b0 0x7f13f8141b20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 >> 172.21.15.71:0/1467569943 conn(0x7f13f806db20 msgr2=0x7f13f80cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:40.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 shutdown_connections 2023-07-06T01:10:40.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.656+0000 7f13fd3ff700 1 -- 172.21.15.71:0/1467569943 wait complete. 2023-07-06T01:10:40.663 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:40.676 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-07-06T01:10:38.857444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4732,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4845568,"data_stored":2714798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8401,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-56,"num_write_kb":-27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099512+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:34.099512+0000","last_peered":"2023-07-06T01:10:34.099512+0000","last_clean":"2023-07-06T01:10:34.099512+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:34.099512+0000","last_undegraded":"2023-07-06T01:10:34.099512+0000","last_fullsized":"2023-07-06T01:10:34.099512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:34:13.021149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101078+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:34.101078+0000","last_peered":"2023-07-06T01:10:34.101078+0000","last_clean":"2023-07-06T01:10:34.101078+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:34.101078+0000","last_undegraded":"2023-07-06T01:10:34.101078+0000","last_fullsized":"2023-07-06T01:10:34.101078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:51.573052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099245+0000","last_change":"2023-07-06T01:08:45.777028+0000","last_active":"2023-07-06T01:10:34.099245+0000","last_peered":"2023-07-06T01:10:34.099245+0000","last_clean":"2023-07-06T01:10:34.099245+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:34.099245+0000","last_undegraded":"2023-07-06T01:10:34.099245+0000","last_fullsized":"2023-07-06T01:10:34.099245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:22:34.582273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101882+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:34.101882+0000","last_peered":"2023-07-06T01:10:34.101882+0000","last_clean":"2023-07-06T01:10:34.101882+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:34.101882+0000","last_undegraded":"2023-07-06T01:10:34.101882+0000","last_fullsized":"2023-07-06T01:10:34.101882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:58:06.121024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100101+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:34.100101+0000","last_peered":"2023-07-06T01:10:34.100101+0000","last_clean":"2023-07-06T01:10:34.100101+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:34.100101+0000","last_undegraded":"2023-07-06T01:10:34.100101+0000","last_fullsized":"2023-07-06T01:10:34.100101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T02:43:44.528852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100240+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:34.100240+0000","last_peered":"2023-07-06T01:10:34.100240+0000","last_clean":"2023-07-06T01:10:34.100240+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:34.100240+0000","last_undegraded":"2023-07-06T01:10:34.100240+0000","last_fullsized":"2023-07-06T01:10:34.100240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T13:06:24.549664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.101652+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:34.101652+0000","last_peered":"2023-07-06T01:10:34.101652+0000","last_clean":"2023-07-06T01:10:34.101652+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:34.101652+0000","last_undegraded":"2023-07-06T01:10:34.101652+0000","last_fullsized":"2023-07-06T01:10:34.101652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:06:35.529354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.099646+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:34.099646+0000","last_peered":"2023-07-06T01:10:34.099646+0000","last_clean":"2023-07-06T01:10:34.099646+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:34.099646+0000","last_undegraded":"2023-07-06T01:10:34.099646+0000","last_fullsized":"2023-07-06T01:10:34.099646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:54:29.055439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T01:10:34.100547+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:34.100547+0000","last_peered":"2023-07-06T01:10:34.100547+0000","last_clean":"2023-07-06T01:10:34.100547+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:34.100547+0000","last_undegraded":"2023-07-06T01:10:34.100547+0000","last_fullsized":"2023-07-06T01:10:34.100547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:22:56.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.7329999999999997,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.6909999999999998,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.626},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.9290000000000003,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":4.3259999999999996,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.749}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":189442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":10.696,"5min":10.696,"15min":10.696},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.534000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.748}]},{"osd":3,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.627}]},{"osd":4,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:09:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":188950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.497},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79500000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.96099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":1056768,"data_stored":785642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.499}]},{"osd":4,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.851,"5min":2.851,"15min":2.851},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88400000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:09:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.84999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":188930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.0810000000000004,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":22.029,"5min":22.029,"15min":22.029},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":22.059000000000001,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.7970000000000002,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":21.965,"5min":21.965,"15min":21.965},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":21.917000000000002,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.628},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":21.998999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":196497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":189464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.992,"5min":3.992,"15min":3.992},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":9.1739999999999995,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.747}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":9.0370000000000008,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.0129999999999999,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.915,"5min":4.915,"15min":4.915},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":10.91,"5min":10.91,"15min":10.91},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":9.3510000000000009,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.874}]},{"osd":5,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.499}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.62},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":188972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:09:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:40.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T01:10:40.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.873+0000 7fb9985ff700 1 Processor -- start 2023-07-06T01:10:40.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.873+0000 7fb9985ff700 1 -- start start 2023-07-06T01:10:40.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.874+0000 7fb9985ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb99006a670 0x7fb9900cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.874+0000 7fb9985ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb9900d0220 0x7fb9900cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.874+0000 7fb9985ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900d0660 con 0x7fb99015c790 2023-07-06T01:10:40.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.874+0000 7fb9985ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9900ca500 con 0x7fb9900d0220 2023-07-06T01:10:40.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.874+0000 7fb9985ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900cf920 con 0x7fb99006a670 2023-07-06T01:10:40.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb9900d0220 0x7fb9900cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb9900d0220 0x7fb9900cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54290/0 (socket says 172.21.15.71:54290) 2023-07-06T01:10:40.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 -- 172.21.15.71:0/2749361679 learned_addr learned my addr 172.21.15.71:0/2749361679 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:40.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb995b9a700 1 --2- 172.21.15.71:0/2749361679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb99006a670 0x7fb9900cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 -- 172.21.15.71:0/2749361679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb99006a670 msgr2=0x7fb9900cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:40.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 --2- 172.21.15.71:0/2749361679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb99006a670 0x7fb9900cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 -- 172.21.15.71:0/2749361679 >> v1:172.21.15.71:6789/0 conn(0x7fb99015c790 legacy=0x7fb990069f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 -- 172.21.15.71:0/2749361679 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990070a50 con 0x7fb9900d0220 2023-07-06T01:10:40.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb995399700 1 -- 172.21.15.71:0/2749361679 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630257990 0 0) 0x7fb98c001110 con 0x7fb99015c790 2023-07-06T01:10:40.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb996b9c700 1 --2- 172.21.15.71:0/2749361679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9900d0220 0x7fb9900cd6e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb988009e50 tx=0x7fb98800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00bcf7fee9c435d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb995399700 1 -- 172.21.15.71:0/2749361679 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800e070 con 0x7fb9900d0220 2023-07-06T01:10:40.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb995399700 1 -- 172.21.15.71:0/2749361679 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98800b9c0 con 0x7fb9900d0220 2023-07-06T01:10:40.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.875+0000 7fb995399700 1 -- 172.21.15.71:0/2749361679 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98800bd70 con 0x7fb9900d0220 2023-07-06T01:10:40.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 -- 172.21.15.71:0/2749361679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9900d0220 msgr2=0x7fb9900cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2749361679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9900d0220 0x7fb9900cd6e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb988009e50 tx=0x7fb98800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:40.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 -- 172.21.15.71:0/2749361679 shutdown_connections 2023-07-06T01:10:40.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2749361679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb9900d0220 0x7fb9900cd6e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2749361679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb99006a670 0x7fb9900cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 -- 172.21.15.71:0/2749361679 >> 172.21.15.71:0/2749361679 conn(0x7fb9900b22f0 msgr2=0x7fb9900cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:40.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 -- 172.21.15.71:0/2749361679 shutdown_connections 2023-07-06T01:10:40.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.876+0000 7fb9985ff700 1 -- 172.21.15.71:0/2749361679 wait complete. 2023-07-06T01:10:40.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.878+0000 7fb9985ff700 1 Processor -- start 2023-07-06T01:10:40.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.878+0000 7fb9985ff700 1 -- start start 2023-07-06T01:10:40.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb9985ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb99006a670 0x7fb990150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb9985ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9900d0220 0x7fb9900c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb9985ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 0x7fb9900c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.887 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb9985ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900c7120 con 0x7fb99015c790 2023-07-06T01:10:40.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb9985ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900b58e0 con 0x7fb99006a670 2023-07-06T01:10:40.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb9985ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900c8910 con 0x7fb9900d0220 2023-07-06T01:10:40.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 0x7fb9900c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 0x7fb9900c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54296/0 (socket says 172.21.15.71:54296) 2023-07-06T01:10:40.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 -- 172.21.15.71:0/2110962630 learned_addr learned my addr 172.21.15.71:0/2110962630 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:40.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb99639b700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb99006a670 0x7fb990150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb995b9a700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9900d0220 0x7fb9900c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 -- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9900d0220 msgr2=0x7fb9900c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9900d0220 0x7fb9900c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 -- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb99006a670 msgr2=0x7fb990150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:40.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb99006a670 0x7fb990150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:40.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb996b9c700 1 -- 172.21.15.71:0/2110962630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb988009b30 con 0x7fb99015c790 2023-07-06T01:10:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.879+0000 7fb995b9a700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9900d0220 0x7fb9900c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.880+0000 7fb996b9c700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 0x7fb9900c83d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb988004270 tx=0x7fb988004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.880+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9880099b0 con 0x7fb99015c790 2023-07-06T01:10:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.880+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988004950 con 0x7fb99015c790 2023-07-06T01:10:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.880+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98801c680 con 0x7fb99015c790 2023-07-06T01:10:40.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.880+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9900c7330 con 0x7fb99015c790 2023-07-06T01:10:40.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.880+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9900c78f0 con 0x7fb99015c790 2023-07-06T01:10:40.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.881+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9900008d0 con 0x7fb99015c790 2023-07-06T01:10:40.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.882+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb98801c7e0 con 0x7fb99015c790 2023-07-06T01:10:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.883+0000 7fb986ffd700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb97406ace0 0x7fb97406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.883+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb98808ad70 con 0x7fb99015c790 2023-07-06T01:10:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.884+0000 7fb99639b700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb97406ace0 0x7fb97406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.884+0000 7fb99639b700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb97406ace0 0x7fb97406d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb98c000f60 tx=0x7fb98c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:40.887+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb9880561b0 con 0x7fb99015c790 2023-07-06T01:10:41.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.082+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb990071b90 con 0x7fb99015c790 2023-07-06T01:10:41.086 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.083+0000 7fb986ffd700 1 -- 172.21.15.71:0/2110962630 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14742 (secure 0 0 0) 0x7fb9880597d0 con 0x7fb99015c790 2023-07-06T01:10:41.086 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:41.087 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"fsid":"2e134b12-52b2-40d1-8145-7c2e3ab16f64","created":"2023-07-06T01:08:23.598643+0000","modified":"2023-07-06T01:10:36.962565+0000","last_up_change":"2023-07-06T01:08:35.880235+0000","last_in_change":"2023-07-06T01:08:27.048735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T01:08:36.877828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T01:08:43.496374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53f4df9c-8198-4bce-b372-8c7b7e613b15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6801","nonce":945460712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6803","nonce":945460712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6807","nonce":945460712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":945460712},{"type":"v1","addr":"172.21.15.71:6805","nonce":945460712}]},"public_addr":"172.21.15.71:6801/945460712","cluster_addr":"172.21.15.71:6803/945460712","heartbeat_back_addr":"172.21.15.71:6807/945460712","heartbeat_front_addr":"172.21.15.71:6805/945460712","state":["exists","up"]},{"osd":1,"uuid":"fb64ec9d-673e-4daa-a510-42432ecb7b89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6817","nonce":714374974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6819","nonce":714374974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6823","nonce":714374974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":714374974},{"type":"v1","addr":"172.21.15.71:6821","nonce":714374974}]},"public_addr":"172.21.15.71:6817/714374974","cluster_addr":"172.21.15.71:6819/714374974","heartbeat_back_addr":"172.21.15.71:6823/714374974","heartbeat_front_addr":"172.21.15.71:6821/714374974","state":["exists","up"]},{"osd":2,"uuid":"9f221492-7c03-48aa-bb9e-36ee71725cc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6809","nonce":2164673014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6811","nonce":2164673014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6815","nonce":2164673014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2164673014},{"type":"v1","addr":"172.21.15.71:6813","nonce":2164673014}]},"public_addr":"172.21.15.71:6809/2164673014","cluster_addr":"172.21.15.71:6811/2164673014","heartbeat_back_addr":"172.21.15.71:6815/2164673014","heartbeat_front_addr":"172.21.15.71:6813/2164673014","state":["exists","up"]},{"osd":3,"uuid":"eafdad02-28ed-4625-a6c8-28434bd7494d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6825","nonce":1769601539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6827","nonce":1769601539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6831","nonce":1769601539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":1769601539},{"type":"v1","addr":"172.21.15.71:6829","nonce":1769601539}]},"public_addr":"172.21.15.71:6825/1769601539","cluster_addr":"172.21.15.71:6827/1769601539","heartbeat_back_addr":"172.21.15.71:6831/1769601539","heartbeat_front_addr":"172.21.15.71:6829/1769601539","state":["exists","up"]},{"osd":4,"uuid":"2dd5a1ec-5015-4f41-8377-986626f511f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6801","nonce":654779018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6803","nonce":654779018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6807","nonce":654779018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":654779018},{"type":"v1","addr":"172.21.15.194:6805","nonce":654779018}]},"public_addr":"172.21.15.194:6801/654779018","cluster_addr":"172.21.15.194:6803/654779018","heartbeat_back_addr":"172.21.15.194:6807/654779018","heartbeat_front_addr":"172.21.15.194:6805/654779018","state":["exists","up"]},{"osd":5,"uuid":"b4c52b0f-894b-4178-9c5d-0b6dfe7f416f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6809","nonce":2313076380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6811","nonce":2313076380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6815","nonce":2313076380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2313076380},{"type":"v1","addr":"172.21.15.194:6813","nonce":2313076380}]},"public_addr":"172.21.15.194:6809/2313076380","cluster_addr":"172.21.15.194:6811/2313076380","heartbeat_back_addr":"172.21.15.194:6815/2313076380","heartbeat_front_addr":"172.21.15.194:6813/2313076380","state":["exists","up"]},{"osd":6,"uuid":"982e7e97-484b-49c7-8121-de950b464b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6817","nonce":3534579584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6819","nonce":3534579584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6826","nonce":3534579584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":3534579584},{"type":"v1","addr":"172.21.15.194:6823","nonce":3534579584}]},"public_addr":"172.21.15.194:6817/3534579584","cluster_addr":"172.21.15.194:6819/3534579584","heartbeat_back_addr":"172.21.15.194:6826/3534579584","heartbeat_front_addr":"172.21.15.194:6823/3534579584","state":["exists","up"]},{"osd":7,"uuid":"186dbc3c-5805-4845-9f0f-d06777576354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6822","nonce":1393064559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6827","nonce":1393064559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6831","nonce":1393064559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1393064559},{"type":"v1","addr":"172.21.15.194:6829","nonce":1393064559}]},"public_addr":"172.21.15.194:6822/1393064559","cluster_addr":"172.21.15.194:6827/1393064559","heartbeat_back_addr":"172.21.15.194:6831/1393064559","heartbeat_front_addr":"172.21.15.194:6829/1393064559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.369954+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.418224+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.386361+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.662225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.560013+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.316996+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.450459+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T01:08:32.646237+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6835/783929387":"2023-07-07T01:10:33.956509+0000","172.21.15.71:6833/783929387":"2023-07-07T01:10:33.956509+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T01:10:41.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb97406ace0 msgr2=0x7fb97406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb97406ace0 0x7fb97406d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb98c000f60 tx=0x7fb98c009040 comp rx=0 tx=0).stop 2023-07-06T01:10:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 msgr2=0x7fb9900c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 0x7fb9900c83d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb988004270 tx=0x7fb988004ad0 comp rx=0 tx=0).stop 2023-07-06T01:10:41.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 shutdown_connections 2023-07-06T01:10:41.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fb97406ace0 0x7fb97406d190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:41.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb99015c790 0x7fb9900c83d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:41.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb99006a670 0x7fb990150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:41.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 --2- 172.21.15.71:0/2110962630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9900d0220 0x7fb9900c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:41.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 >> 172.21.15.71:0/2110962630 conn(0x7fb9900b22f0 msgr2=0x7fb9900cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:41.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 shutdown_connections 2023-07-06T01:10:41.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:41.086+0000 7fb9985ff700 1 -- 172.21.15.71:0/2110962630 wait complete. 2023-07-06T01:10:42.107 INFO:tasks.ceph:Scrubbing osd.0 2023-07-06T01:10:42.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:42.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.313+0000 7febac9ff700 1 Processor -- start 2023-07-06T01:10:42.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.313+0000 7febac9ff700 1 -- start start 2023-07-06T01:10:42.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.314+0000 7febac9ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feba80d2d90 0x7feba80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.314+0000 7febac9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80b61d0 con 0x7feba80cfb10 2023-07-06T01:10:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.314+0000 7febac9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80cf090 con 0x7feba80d3160 2023-07-06T01:10:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.314+0000 7febac9ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80cd490 con 0x7feba80d2d90 2023-07-06T01:10:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.314+0000 7feba6d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feba80cfb10 0x7feba80cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56738/0 (socket says 172.21.15.71:56738) 2023-07-06T01:10:42.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.314+0000 7feba6d9d700 1 -- 172.21.15.71:0/1511675654 learned_addr learned my addr 172.21.15.71:0/1511675654 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba659c700 1 --2- 172.21.15.71:0/1511675654 >> v2:172.21.15.194:3300/0 conn(0x7feba80d2d90 0x7feba80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314997826 0 0) 0x7feba80b61d0 con 0x7feba80cfb10 2023-07-06T01:10:42.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb900035b0 con 0x7feba80cfb10 2023-07-06T01:10:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515320573 0 0) 0x7feb900035b0 con 0x7feba80cfb10 2023-07-06T01:10:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 >> v2:172.21.15.194:3300/0 conn(0x7feba80d2d90 msgr2=0x7feba80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 --2- 172.21.15.71:0/1511675654 >> v2:172.21.15.194:3300/0 conn(0x7feba80d2d90 0x7feba80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 >> v1:172.21.15.194:6789/0 conn(0x7feba80d3160 legacy=0x7feba80d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80cdc30 con 0x7feba80cfb10 2023-07-06T01:10:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7feba00019f0 con 0x7feba80cfb10 2023-07-06T01:10:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 >> v1:172.21.15.71:6789/0 conn(0x7feba80cfb10 legacy=0x7feba80cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb90003a00 0x7feb90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb90004850 0x7feb90004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90005200 0x7feb9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cd490 con 0x7feb90004850 2023-07-06T01:10:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000c080 con 0x7feb90005200 2023-07-06T01:10:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000c240 con 0x7feb90003a00 2023-07-06T01:10:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.315+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb90004850 0x7feb90004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba6d9d700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90005200 0x7feb9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba659c700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb90003a00 0x7feb90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba5d9b700 1 -- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb90003a00 msgr2=0x7feb90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb90003a00 0x7feb90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba5d9b700 1 -- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90005200 msgr2=0x7feb9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:42.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90005200 0x7feb9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba5d9b700 1 -- 172.21.15.71:0/1511675654 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900035b0 con 0x7feb90004850 2023-07-06T01:10:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba6d9d700 1 -- 172.21.15.71:0/1511675654 reap_dead start 2023-07-06T01:10:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb90004850 0x7feb90004cc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0017c0 tx=0x7feb90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15a0414f41f023e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0052d0 con 0x7feb90004850 2023-07-06T01:10:42.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c005450 con 0x7feb90004850 2023-07-06T01:10:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.316+0000 7feba559a700 1 -- 172.21.15.71:0/1511675654 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0038c0 con 0x7feb90004850 2023-07-06T01:10:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 -- 172.21.15.71:0/1511675654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb90004850 msgr2=0x7feb90004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb90004850 0x7feb90004cc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0017c0 tx=0x7feb90005880 comp rx=0 tx=0).stop 2023-07-06T01:10:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 -- 172.21.15.71:0/1511675654 shutdown_connections 2023-07-06T01:10:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 --2- 172.21.15.71:0/1511675654 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb90004850 0x7feb90004cc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 -- 172.21.15.71:0/1511675654 >> 172.21.15.71:0/1511675654 conn(0x7feba806c150 msgr2=0x7feba806c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 -- 172.21.15.71:0/1511675654 shutdown_connections 2023-07-06T01:10:42.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.317+0000 7febac9ff700 1 -- 172.21.15.71:0/1511675654 wait complete. 2023-07-06T01:10:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.319+0000 7febac9ff700 1 Processor -- start 2023-07-06T01:10:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.319+0000 7febac9ff700 1 -- start start 2023-07-06T01:10:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7febac9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90004850 0x7feba80c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7febac9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba815eae0 0x7feba80cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7febac9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815ef50 0x7feba80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7febac9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80cf6f0 con 0x7feba815eae0 2023-07-06T01:10:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7febac9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba81f2100 con 0x7feb90004850 2023-07-06T01:10:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7febac9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba815da40 con 0x7feba815ef50 2023-07-06T01:10:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba815eae0 0x7feba80cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba815eae0 0x7feba80cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54316/0 (socket says 172.21.15.71:54316) 2023-07-06T01:10:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 -- 172.21.15.71:0/1540050291 learned_addr learned my addr 172.21.15.71:0/1540050291 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba659c700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90004850 0x7feba80c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba6d9d700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815ef50 0x7feba80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 -- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815ef50 msgr2=0x7feba80cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feba815ef50 0x7feba80cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 -- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90004850 msgr2=0x7feba80c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb90004850 0x7feba80c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.320+0000 7feba5d9b700 1 -- 172.21.15.71:0/1540050291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba815dd20 con 0x7feba815eae0 2023-07-06T01:10:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.321+0000 7feba5d9b700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba815eae0 0x7feba80cc930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feb9c000c00 tx=0x7feb9c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.321+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c001290 con 0x7feba815eae0 2023-07-06T01:10:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.321+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c000ed0 con 0x7feba815eae0 2023-07-06T01:10:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.321+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c007240 con 0x7feba815eae0 2023-07-06T01:10:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.321+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba815e000 con 0x7feba815eae0 2023-07-06T01:10:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.321+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba815e5c0 con 0x7feba815eae0 2023-07-06T01:10:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.322+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feba80cd950 con 0x7feba815eae0 2023-07-06T01:10:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.323+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb9c0073a0 con 0x7feba815eae0 2023-07-06T01:10:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feb96ffd700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8806ad10 0x7feb8806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7feb9c089f50 con 0x7feba815eae0 2023-07-06T01:10:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feb96ffd700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7feb88071180 0x7feb88073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 --> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb88073c60 con 0x7feb88071180 2023-07-06T01:10:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb9c08a2c0 con 0x7feba815eae0 2023-07-06T01:10:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feba659c700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8806ad10 0x7feb8806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.324+0000 7feba6d9d700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7feb88071180 0x7feb88073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.325+0000 7feba6d9d700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7feb88071180 0x7feb88073590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.325+0000 7feba659c700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8806ad10 0x7feb8806d1c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feb98009c60 tx=0x7feb98009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.326+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== osd.0 v2:172.21.15.71:6800/945460712 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7feb88073c60 con 0x7feb88071180 2023-07-06T01:10:42.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.340+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 --> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feba80cd670 con 0x7feb88071180 2023-07-06T01:10:42.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.340+0000 7feb96ffd700 1 -- 172.21.15.71:0/1540050291 <== osd.0 v2:172.21.15.71:6800/945460712 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7feba0007140 con 0x7feb88071180 2023-07-06T01:10:42.343 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:42.344 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:42.344 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:42.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7feb88071180 msgr2=0x7feb88073590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:6800/945460712,v1:172.21.15.71:6801/945460712] conn(0x7feb88071180 0x7feb88073590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8806ad10 msgr2=0x7feb8806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7feb8806ad10 0x7feb8806d1c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feb98009c60 tx=0x7feb98009210 comp rx=0 tx=0).stop 2023-07-06T01:10:42.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba815eae0 msgr2=0x7feba80cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 --2- 172.21.15.71:0/1540050291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feba815eae0 0x7feba80cc930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feb9c000c00 tx=0x7feb9c001120 comp rx=0 tx=0).stop 2023-07-06T01:10:42.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7feba6d9d700 1 -- 172.21.15.71:0/1540050291 reap_dead start 2023-07-06T01:10:42.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 shutdown_connections 2023-07-06T01:10:42.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 >> 172.21.15.71:0/1540050291 conn(0x7feba806c150 msgr2=0x7feba80b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:42.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 shutdown_connections 2023-07-06T01:10:42.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.341+0000 7febac9ff700 1 -- 172.21.15.71:0/1540050291 wait complete. 2023-07-06T01:10:42.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-06T01:10:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.552+0000 7f0f97fff700 1 Processor -- start 2023-07-06T01:10:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.553+0000 7f0f97fff700 1 -- start start 2023-07-06T01:10:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f97fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f9015fca0 0x7f0f900d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f97fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f900b5c90 0x7f0f900d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f97fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900cf780 con 0x7f0f900b6100 2023-07-06T01:10:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f97fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900cd490 con 0x7f0f900b5c90 2023-07-06T01:10:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f97fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900cd770 con 0x7f0f9015fca0 2023-07-06T01:10:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f9659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0f900b6100 0x7f0f900cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56754/0 (socket says 172.21.15.71:56754) 2023-07-06T01:10:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f9659c700 1 -- 172.21.15.71:0/2790735372 learned_addr learned my addr 172.21.15.71:0/2790735372 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f9559a700 1 --2- 172.21.15.71:0/2790735372 >> v2:172.21.15.194:3300/0 conn(0x7f0f900b5c90 0x7f0f900d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f95d9b700 1 --2- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f9015fca0 0x7f0f900d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f94d99700 1 -- 172.21.15.71:0/2790735372 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920525627 0 0) 0x7f0f900cf780 con 0x7f0f900b6100 2023-07-06T01:10:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.554+0000 7f0f94d99700 1 -- 172.21.15.71:0/2790735372 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f7c0035b0 con 0x7f0f900b6100 2023-07-06T01:10:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f94d99700 1 -- 172.21.15.71:0/2790735372 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374385801 0 0) 0x7f0f7c0035b0 con 0x7f0f900b6100 2023-07-06T01:10:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f9559a700 1 -- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f9015fca0 msgr2=0x7f0f900d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f9559a700 1 --2- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f9015fca0 0x7f0f900d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f9559a700 1 -- 172.21.15.71:0/2790735372 >> v1:172.21.15.71:6789/0 conn(0x7f0f900b6100 legacy=0x7f0f900cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f9559a700 1 -- 172.21.15.71:0/2790735372 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900cda50 con 0x7f0f900b5c90 2023-07-06T01:10:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f9559a700 1 --2- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f900b5c90 0x7f0f900d2d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009840 tx=0x7f0f80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87cae7b6153b7371 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f94d99700 1 -- 172.21.15.71:0/2790735372 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880019f0 con 0x7f0f900b5c90 2023-07-06T01:10:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f94d99700 1 -- 172.21.15.71:0/2790735372 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80004030 con 0x7f0f900b5c90 2023-07-06T01:10:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.555+0000 7f0f94d99700 1 -- 172.21.15.71:0/2790735372 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800043c0 con 0x7f0f900b5c90 2023-07-06T01:10:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 -- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f900b5c90 msgr2=0x7f0f900d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 --2- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f900b5c90 0x7f0f900d2d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009840 tx=0x7f0f80009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 -- 172.21.15.71:0/2790735372 shutdown_connections 2023-07-06T01:10:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 --2- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f9015fca0 0x7f0f900d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 --2- 172.21.15.71:0/2790735372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f900b5c90 0x7f0f900d2d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 -- 172.21.15.71:0/2790735372 >> 172.21.15.71:0/2790735372 conn(0x7f0f9006c150 msgr2=0x7f0f9006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 -- 172.21.15.71:0/2790735372 shutdown_connections 2023-07-06T01:10:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.556+0000 7f0f97fff700 1 -- 172.21.15.71:0/2790735372 wait complete. 2023-07-06T01:10:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.558+0000 7f0f97fff700 1 Processor -- start 2023-07-06T01:10:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.558+0000 7f0f97fff700 1 -- start start 2023-07-06T01:10:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f97fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f900b5c90 0x7f0f901494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f97fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 0x7f0f901f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f97fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f9015fca0 0x7f0f900b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f97fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90149a10 con 0x7f0f900b6100 2023-07-06T01:10:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f97fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9015bb60 con 0x7f0f9015fca0 2023-07-06T01:10:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f97fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9015be40 con 0x7f0f900b5c90 2023-07-06T01:10:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f9559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 0x7f0f901f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f9559a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 0x7f0f901f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54332/0 (socket says 172.21.15.71:54332) 2023-07-06T01:10:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f9559a700 1 -- 172.21.15.71:0/735859753 learned_addr learned my addr 172.21.15.71:0/735859753 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f95d9b700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f900b5c90 0x7f0f901494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.559+0000 7f0f9659c700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f9015fca0 0x7f0f900b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f9559a700 1 -- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f900b5c90 msgr2=0x7f0f901494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f9559a700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f900b5c90 0x7f0f901494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f9559a700 1 -- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f9015fca0 msgr2=0x7f0f900b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f9559a700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f9015fca0 0x7f0f900b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f9559a700 1 -- 172.21.15.71:0/735859753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f800094a0 con 0x7f0f900b6100 2023-07-06T01:10:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f9559a700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 0x7f0f901f16f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f800090b0 tx=0x7f0f80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80003cf0 con 0x7f0f900b6100 2023-07-06T01:10:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8001f070 con 0x7f0f900b6100 2023-07-06T01:10:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80011870 con 0x7f0f900b6100 2023-07-06T01:10:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9015c120 con 0x7f0f900b6100 2023-07-06T01:10:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.560+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9015c6e0 con 0x7f0f900b6100 2023-07-06T01:10:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.561+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9015c8d0 con 0x7f0f900b6100 2023-07-06T01:10:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.562+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f800119d0 con 0x7f0f900b6100 2023-07-06T01:10:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.564+0000 7f0f867fc700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.564+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0f80021070 con 0x7f0f900b6100 2023-07-06T01:10:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.564+0000 7f0f95d9b700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.565+0000 7f0f95d9b700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f7406ace0 0x7f0f7406d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009b40 tx=0x7f0f8c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.568+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f80055d60 con 0x7f0f900b6100 2023-07-06T01:10:42.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.763+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f9006ae40 con 0x7f0f7406ace0 2023-07-06T01:10:42.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.765+0000 7f0f867fc700 1 -- 172.21.15.71:0/735859753 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0f8c004020 con 0x7f0f7406ace0 2023-07-06T01:10:42.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f7406ace0 msgr2=0x7f0f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f7406ace0 0x7f0f7406d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009b40 tx=0x7f0f8c009210 comp rx=0 tx=0).stop 2023-07-06T01:10:42.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 msgr2=0x7f0f901f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 0x7f0f901f16f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f800090b0 tx=0x7f0f80004750 comp rx=0 tx=0).stop 2023-07-06T01:10:42.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 shutdown_connections 2023-07-06T01:10:42.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f9015fca0 0x7f0f900b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f900b5c90 0x7f0f901494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 --2- 172.21.15.71:0/735859753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f900b6100 0x7f0f901f16f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 >> 172.21.15.71:0/735859753 conn(0x7f0f9006c150 msgr2=0x7f0f900d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:42.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 shutdown_connections 2023-07-06T01:10:42.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.766+0000 7f0f97fff700 1 -- 172.21.15.71:0/735859753 wait complete. 2023-07-06T01:10:42.772 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2023-07-06T01:10:42.787 INFO:tasks.ceph:Scrubbing osd.1 2023-07-06T01:10:42.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:42.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.985+0000 7f15ff9ff700 1 Processor -- start 2023-07-06T01:10:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.985+0000 7f15ff9ff700 1 -- start start 2023-07-06T01:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.986+0000 7f15ff9ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f15f80b2180 0x7f15f80cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.986+0000 7f15ff9ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f8160cc0 con 0x7f15f80b8440 2023-07-06T01:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.986+0000 7f15ff9ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f8160f80 con 0x7f15f80cfe40 2023-07-06T01:10:42.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.986+0000 7f15ff9ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f8160ae0 con 0x7f15f80b2180 2023-07-06T01:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fd79b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f15f80b8440 0x7f15f80cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:56760/0 (socket says 172.21.15.71:56760) 2023-07-06T01:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fdf9c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f15f80b2180 0x7f15f80cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:42.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fd79b700 1 -- 172.21.15.71:0/63422762 learned_addr learned my addr 172.21.15.71:0/63422762 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fdf9c700 1 -- 172.21.15.71:0/63422762 >> v1:172.21.15.194:6789/0 conn(0x7f15f80cfe40 legacy=0x7f15f80d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fdf9c700 1 -- 172.21.15.71:0/63422762 >> v1:172.21.15.71:6789/0 conn(0x7f15f80b8440 legacy=0x7f15f80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fdf9c700 1 -- 172.21.15.71:0/63422762 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f80cf0e0 con 0x7f15f80b2180 2023-07-06T01:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15effff700 1 -- 172.21.15.71:0/63422762 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273262798 0 0) 0x7f15f8160cc0 con 0x7f15f80b8440 2023-07-06T01:10:42.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.987+0000 7f15fdf9c700 1 --2- 172.21.15.71:0/63422762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b2180 0x7f15f80cd530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009d90 tx=0x7f15f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203f55ac3b266c18 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15effff700 1 -- 172.21.15.71:0/63422762 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f000e070 con 0x7f15f80b2180 2023-07-06T01:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15effff700 1 -- 172.21.15.71:0/63422762 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f000bbd0 con 0x7f15f80b2180 2023-07-06T01:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15effff700 1 -- 172.21.15.71:0/63422762 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0012430 con 0x7f15f80b2180 2023-07-06T01:10:42.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 -- 172.21.15.71:0/63422762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b2180 msgr2=0x7f15f80cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 --2- 172.21.15.71:0/63422762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b2180 0x7f15f80cd530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f15f0009d90 tx=0x7f15f000b330 comp rx=0 tx=0).stop 2023-07-06T01:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 -- 172.21.15.71:0/63422762 shutdown_connections 2023-07-06T01:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 --2- 172.21.15.71:0/63422762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b2180 0x7f15f80cd530 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 -- 172.21.15.71:0/63422762 >> 172.21.15.71:0/63422762 conn(0x7f15f806be10 msgr2=0x7f15f8071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 -- 172.21.15.71:0/63422762 shutdown_connections 2023-07-06T01:10:42.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.988+0000 7f15ff9ff700 1 -- 172.21.15.71:0/63422762 wait complete. 2023-07-06T01:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.990+0000 7f15ff9ff700 1 Processor -- start 2023-07-06T01:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.990+0000 7f15ff9ff700 1 -- start start 2023-07-06T01:10:42.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15ff9ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f80b2180 0x7f15f815f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15ff9ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b8440 0x7f15f8158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15ff9ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80cfe40 0x7f15f8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15ff9ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815e0c0 con 0x7f15f80b8440 2023-07-06T01:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15ff9ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815e3a0 con 0x7f15f80cfe40 2023-07-06T01:10:42.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15ff9ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f815e680 con 0x7f15f80b2180 2023-07-06T01:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.991+0000 7f15fcf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b8440 0x7f15f8158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b8440 0x7f15f8158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54348/0 (socket says 172.21.15.71:54348) 2023-07-06T01:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 -- 172.21.15.71:0/2710832212 learned_addr learned my addr 172.21.15.71:0/2710832212 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fd79b700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f80b2180 0x7f15f815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fdf9c700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80cfe40 0x7f15f8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 -- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f80b2180 msgr2=0x7f15f815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15f80b2180 0x7f15f815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 -- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80cfe40 msgr2=0x7f15f8156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80cfe40 0x7f15f8156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 -- 172.21.15.71:0/2710832212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f0009a70 con 0x7f15f80b8440 2023-07-06T01:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fdf9c700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15f80cfe40 0x7f15f8156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15fcf9a700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b8440 0x7f15f8158da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c420 tx=0x7f15e800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80052d0 con 0x7f15f80b8440 2023-07-06T01:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8005430 con 0x7f15f80b8440 2023-07-06T01:10:43.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80038c0 con 0x7f15f80b8440 2023-07-06T01:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.992+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f815e960 con 0x7f15f80b8440 2023-07-06T01:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.993+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f8157250 con 0x7f15f80b8440 2023-07-06T01:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.993+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15f80b8810 con 0x7f15f80b8440 2023-07-06T01:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.994+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15e8003a20 con 0x7f15f80b8440 2023-07-06T01:10:43.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.995+0000 7f15edffb700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f15dc06ace0 0x7f15dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.995+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f15e8088630 con 0x7f15f80b8440 2023-07-06T01:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15edffb700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f15dc071150 0x7f15dc073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 --> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15dc073c30 con 0x7f15dc071150 2023-07-06T01:10:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e808ac10 con 0x7f15f80b8440 2023-07-06T01:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15fdf9c700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f15dc071150 0x7f15dc073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15fd79b700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f15dc06ace0 0x7f15dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15fdf9c700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f15dc071150 0x7f15dc073560 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.996+0000 7f15fd79b700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f15dc06ace0 0x7f15dc06d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f15f4007fd0 tx=0x7f15f4007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:42.997+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== osd.1 v2:172.21.15.71:6816/714374974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f15dc073c30 con 0x7f15dc071150 2023-07-06T01:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.011+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 --> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15f80cf3c0 con 0x7f15dc071150 2023-07-06T01:10:43.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15edffb700 1 -- 172.21.15.71:0/2710832212 <== osd.1 v2:172.21.15.71:6816/714374974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f15f0012860 con 0x7f15dc071150 2023-07-06T01:10:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f15dc071150 msgr2=0x7f15dc073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:6816/714374974,v1:172.21.15.71:6817/714374974] conn(0x7f15dc071150 0x7f15dc073560 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f15dc06ace0 msgr2=0x7f15dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f15dc06ace0 0x7f15dc06d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f15f4007fd0 tx=0x7f15f4007c20 comp rx=0 tx=0).stop 2023-07-06T01:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b8440 msgr2=0x7f15f8158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 --2- 172.21.15.71:0/2710832212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15f80b8440 0x7f15f8158da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f15e800c420 tx=0x7f15e800c7e0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15fdf9c700 1 -- 172.21.15.71:0/2710832212 reap_dead start 2023-07-06T01:10:43.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 shutdown_connections 2023-07-06T01:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 >> 172.21.15.71:0/2710832212 conn(0x7f15f806be10 msgr2=0x7f15f80b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 shutdown_connections 2023-07-06T01:10:43.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.012+0000 7f15ff9ff700 1 -- 172.21.15.71:0/2710832212 wait complete. 2023-07-06T01:10:43.031 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-06T01:10:43.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.224+0000 7f144ffff700 1 Processor -- start 2023-07-06T01:10:43.227 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.224+0000 7f144ffff700 1 -- start start 2023-07-06T01:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f14480b5c90 0x7f14480d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144ffff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f14480b6110 0x7f14480d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144ffff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14480cf780 con 0x7f144815fca0 2023-07-06T01:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144ffff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480cd490 con 0x7f14480b5c90 2023-07-06T01:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144ffff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480cd770 con 0x7f14480b6110 2023-07-06T01:10:43.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144d59a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f14480b5c90 0x7f14480d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144d59a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f14480b5c90 0x7f14480d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57054/0 (socket says 172.21.15.71:57054) 2023-07-06T01:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144d59a700 1 -- 172.21.15.71:0/180359019 learned_addr learned my addr 172.21.15.71:0/180359019 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.225+0000 7f144e59c700 1 --2- 172.21.15.71:0/180359019 >> v2:172.21.15.194:3300/0 conn(0x7f14480b6110 0x7f14480d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144d59a700 1 -- 172.21.15.71:0/180359019 >> v2:172.21.15.194:3300/0 conn(0x7f14480b6110 msgr2=0x7f14480d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144d59a700 1 --2- 172.21.15.71:0/180359019 >> v2:172.21.15.194:3300/0 conn(0x7f14480b6110 0x7f14480d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144d59a700 1 -- 172.21.15.71:0/180359019 >> v1:172.21.15.194:6789/0 conn(0x7f144815fca0 legacy=0x7f14480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:43.232 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:10:43.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144d59a700 1 -- 172.21.15.71:0/180359019 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480cda50 con 0x7f14480b5c90 2023-07-06T01:10:43.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144d59a700 1 --2- 172.21.15.71:0/180359019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f14480d2d40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f14480cd410 tx=0x7f1438009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9708dd5831d6ab8d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144cd99700 1 -- 172.21.15.71:0/180359019 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438004230 con 0x7f14480b5c90 2023-07-06T01:10:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144cd99700 1 -- 172.21.15.71:0/180359019 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438004390 con 0x7f14480b5c90 2023-07-06T01:10:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.226+0000 7f144cd99700 1 -- 172.21.15.71:0/180359019 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380036a0 con 0x7f14480b5c90 2023-07-06T01:10:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 -- 172.21.15.71:0/180359019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 msgr2=0x7f14480d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 --2- 172.21.15.71:0/180359019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f14480d2d40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f14480cd410 tx=0x7f1438009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 -- 172.21.15.71:0/180359019 shutdown_connections 2023-07-06T01:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 --2- 172.21.15.71:0/180359019 >> v2:172.21.15.194:3300/0 conn(0x7f14480b6110 0x7f14480d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 --2- 172.21.15.71:0/180359019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f14480d2d40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 -- 172.21.15.71:0/180359019 >> 172.21.15.71:0/180359019 conn(0x7f144806c150 msgr2=0x7f144806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 -- 172.21.15.71:0/180359019 shutdown_connections 2023-07-06T01:10:43.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.227+0000 7f144ffff700 1 -- 172.21.15.71:0/180359019 wait complete. 2023-07-06T01:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.230+0000 7f144ffff700 1 Processor -- start 2023-07-06T01:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.230+0000 7f144ffff700 1 -- start start 2023-07-06T01:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f144815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144ffff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14480b6110 0x7f1448150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144ffff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f144815fca0 0x7f1448158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144815bf50 con 0x7f14480b5c90 2023-07-06T01:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144ffff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480c69b0 con 0x7f14480b6110 2023-07-06T01:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144ffff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480c6c90 con 0x7f144815fca0 2023-07-06T01:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f144815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f144815ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57070/0 (socket says 172.21.15.71:57070) 2023-07-06T01:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 -- 172.21.15.71:0/228109794 learned_addr learned my addr 172.21.15.71:0/228109794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144d59a700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14480b6110 0x7f1448150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144e59c700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f144815fca0 0x7f1448158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 -- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f144815fca0 msgr2=0x7f1448158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f144815fca0 0x7f1448158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 -- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14480b6110 msgr2=0x7f1448150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14480b6110 0x7f1448150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144dd9b700 1 -- 172.21.15.71:0/228109794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438009550 con 0x7f14480b5c90 2023-07-06T01:10:43.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.231+0000 7f144e59c700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f144815fca0 0x7f1448158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:43.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.232+0000 7f144dd9b700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f144815ba10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f144400b4a0 tx=0x7f144400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.232+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444011830 con 0x7f14480b5c90 2023-07-06T01:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.232+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444011990 con 0x7f14480b5c90 2023-07-06T01:10:43.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.232+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444011d40 con 0x7f14480b5c90 2023-07-06T01:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.232+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480c6f70 con 0x7f14480b5c90 2023-07-06T01:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.232+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14480c7530 con 0x7f14480b5c90 2023-07-06T01:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.233+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14480c7750 con 0x7f14480b5c90 2023-07-06T01:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.234+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f144401a400 con 0x7f14480b5c90 2023-07-06T01:10:43.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.235+0000 7f143e7fc700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f142c06ace0 0x7f142c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.235+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1444088ed0 con 0x7f14480b5c90 2023-07-06T01:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.236+0000 7f144d59a700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f142c06ace0 0x7f142c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.237+0000 7f144d59a700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f142c06ace0 0x7f142c06d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1438009130 tx=0x7f1438008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.240+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f14440542b0 con 0x7f14480b5c90 2023-07-06T01:10:43.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.442+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f144806ae40 con 0x7f142c06ace0 2023-07-06T01:10:43.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.443+0000 7f143e7fc700 1 -- 172.21.15.71:0/228109794 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1438004130 con 0x7f142c06ace0 2023-07-06T01:10:43.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f142c06ace0 msgr2=0x7f142c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f142c06ace0 0x7f142c06d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1438009130 tx=0x7f1438008030 comp rx=0 tx=0).stop 2023-07-06T01:10:43.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 msgr2=0x7f144815ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f144815ba10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f144400b4a0 tx=0x7f144400b7b0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 shutdown_connections 2023-07-06T01:10:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f142c06ace0 0x7f142c06d190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f144815fca0 0x7f1448158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14480b5c90 0x7f144815ba10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 --2- 172.21.15.71:0/228109794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14480b6110 0x7f1448150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 >> 172.21.15.71:0/228109794 conn(0x7f144806c150 msgr2=0x7f144815a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 shutdown_connections 2023-07-06T01:10:43.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.446+0000 7f144ffff700 1 -- 172.21.15.71:0/228109794 wait complete. 2023-07-06T01:10:43.452 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2023-07-06T01:10:43.466 INFO:tasks.ceph:Scrubbing osd.2 2023-07-06T01:10:43.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:43.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.662+0000 7fdde9dff700 1 Processor -- start 2023-07-06T01:10:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.663+0000 7fdde9dff700 1 -- start start 2023-07-06T01:10:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde9dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdde40cfe40 0x7fdde40cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde9dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40b2180 0x7fdde40d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde9dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde4160cc0 con 0x7fdde40b8440 2023-07-06T01:10:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde9dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde4160ae0 con 0x7fdde40cfe40 2023-07-06T01:10:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde9dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde4160f80 con 0x7fdde40b2180 2023-07-06T01:10:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdde40cfe40 0x7fdde40cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdde40cfe40 0x7fdde40cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57072/0 (socket says 172.21.15.71:57072) 2023-07-06T01:10:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 -- 172.21.15.71:0/3061355459 learned_addr learned my addr 172.21.15.71:0/3061355459 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 -- 172.21.15.71:0/3061355459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40b2180 msgr2=0x7fdde40d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3061355459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40b2180 0x7fdde40d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 -- 172.21.15.71:0/3061355459 >> v1:172.21.15.194:6789/0 conn(0x7fdde40b8440 legacy=0x7fdde40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.664+0000 7fdde2ffd700 1 -- 172.21.15.71:0/3061355459 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40cf0e0 con 0x7fdde40cfe40 2023-07-06T01:10:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3061355459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40cfe40 0x7fdde40cd530 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fddd80098f0 tx=0x7fddd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2545f915970046 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde27fc700 1 -- 172.21.15.71:0/3061355459 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8004230 con 0x7fdde40cfe40 2023-07-06T01:10:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde27fc700 1 -- 172.21.15.71:0/3061355459 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd8004390 con 0x7fdde40cfe40 2023-07-06T01:10:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde27fc700 1 -- 172.21.15.71:0/3061355459 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80036a0 con 0x7fdde40cfe40 2023-07-06T01:10:43.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde9dff700 1 -- 172.21.15.71:0/3061355459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40cfe40 msgr2=0x7fdde40cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde9dff700 1 --2- 172.21.15.71:0/3061355459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40cfe40 0x7fdde40cd530 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fddd80098f0 tx=0x7fddd8009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde9dff700 1 -- 172.21.15.71:0/3061355459 shutdown_connections 2023-07-06T01:10:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde9dff700 1 --2- 172.21.15.71:0/3061355459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40b2180 0x7fdde40d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde9dff700 1 --2- 172.21.15.71:0/3061355459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40cfe40 0x7fdde40cd530 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.665+0000 7fdde9dff700 1 -- 172.21.15.71:0/3061355459 >> 172.21.15.71:0/3061355459 conn(0x7fdde406be10 msgr2=0x7fdde4071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.666+0000 7fdde9dff700 1 -- 172.21.15.71:0/3061355459 shutdown_connections 2023-07-06T01:10:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.666+0000 7fdde9dff700 1 -- 172.21.15.71:0/3061355459 wait complete. 2023-07-06T01:10:43.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.667+0000 7fdde9dff700 1 Processor -- start 2023-07-06T01:10:43.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.667+0000 7fdde9dff700 1 -- start start 2023-07-06T01:10:43.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde9dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40b2180 0x7fdde415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde9dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde40b8440 0x7fdde415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde9dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40cfe40 0x7fdde40c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde9dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde41f37c0 con 0x7fdde40b2180 2023-07-06T01:10:43.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde9dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415eb30 con 0x7fdde40b8440 2023-07-06T01:10:43.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde9dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde415bd90 con 0x7fdde40cfe40 2023-07-06T01:10:43.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.668+0000 7fdde37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40b2180 0x7fdde415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40b2180 0x7fdde415b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57084/0 (socket says 172.21.15.71:57084) 2023-07-06T01:10:43.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 -- 172.21.15.71:0/3472779572 learned_addr learned my addr 172.21.15.71:0/3472779572 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 -- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40cfe40 msgr2=0x7fdde40c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde40cfe40 0x7fdde40c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 -- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde40b8440 msgr2=0x7fdde415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde40b8440 0x7fdde415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde40b8440 0x7fdde415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 -- 172.21.15.71:0/3472779572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8009550 con 0x7fdde40b2180 2023-07-06T01:10:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde40b8440 0x7fdde415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde37fe700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40b2180 0x7fdde415b850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c4d0 tx=0x7fddd400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011790 con 0x7fdde40b2180 2023-07-06T01:10:43.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd40118f0 con 0x7fdde40b2180 2023-07-06T01:10:43.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde415e570 con 0x7fdde40b2180 2023-07-06T01:10:43.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.669+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011ca0 con 0x7fdde40b2180 2023-07-06T01:10:43.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.670+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde40c6990 con 0x7fdde40b2180 2023-07-06T01:10:43.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.670+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdde40b8810 con 0x7fdde40b2180 2023-07-06T01:10:43.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.672+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddd401c460 con 0x7fdde40b2180 2023-07-06T01:10:43.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.672+0000 7fddcbfff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fddd006ace0 0x7fddd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.673+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fddd4088f30 con 0x7fdde40b2180 2023-07-06T01:10:43.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.673+0000 7fddcbfff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7fddd0071150 0x7fddd0073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.673+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 --> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddd0073c30 con 0x7fddd0071150 2023-07-06T01:10:43.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.673+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddd408b5d0 con 0x7fdde40b2180 2023-07-06T01:10:43.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.673+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fddd006ace0 0x7fddd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.673+0000 7fdde3fff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7fddd0071150 0x7fddd0073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.674+0000 7fdde3fff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7fddd0071150 0x7fddd0073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.674+0000 7fdde2ffd700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fddd006ace0 0x7fddd006d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdde40d02a0 tx=0x7fddd8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.674+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== osd.2 v2:172.21.15.71:6808/2164673014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fddd0073c30 con 0x7fddd0071150 2023-07-06T01:10:43.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.689+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 --> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdde40cf3c0 con 0x7fddd0071150 2023-07-06T01:10:43.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.689+0000 7fddcbfff700 1 -- 172.21.15.71:0/3472779572 <== osd.2 v2:172.21.15.71:6808/2164673014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdddc00ac20 con 0x7fddd0071150 2023-07-06T01:10:43.694 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:43.694 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:43.694 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7fddd0071150 msgr2=0x7fddd0073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:6808/2164673014,v1:172.21.15.71:6809/2164673014] conn(0x7fddd0071150 0x7fddd0073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fddd006ace0 msgr2=0x7fddd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fddd006ace0 0x7fddd006d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdde40d02a0 tx=0x7fddd8008030 comp rx=0 tx=0).stop 2023-07-06T01:10:43.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40b2180 msgr2=0x7fdde415b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 --2- 172.21.15.71:0/3472779572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde40b2180 0x7fdde415b850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c4d0 tx=0x7fddd400c890 comp rx=0 tx=0).stop 2023-07-06T01:10:43.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde3fff700 1 -- 172.21.15.71:0/3472779572 reap_dead start 2023-07-06T01:10:43.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 shutdown_connections 2023-07-06T01:10:43.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 >> 172.21.15.71:0/3472779572 conn(0x7fdde406be10 msgr2=0x7fdde40b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:43.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 shutdown_connections 2023-07-06T01:10:43.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.690+0000 7fdde9dff700 1 -- 172.21.15.71:0/3472779572 wait complete. 2023-07-06T01:10:43.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-06T01:10:43.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.900+0000 7fa9a17ff700 1 Processor -- start 2023-07-06T01:10:43.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.901+0000 7fa9a17ff700 1 -- start start 2023-07-06T01:10:43.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa9a17ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa99c15fca0 0x7fa99c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa9a17ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa99c0b5c90 0x7fa99c0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa9a17ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0cf780 con 0x7fa99c0b6110 2023-07-06T01:10:43.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa9a17ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0cd490 con 0x7fa99c0b5c90 2023-07-06T01:10:43.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa9a17ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0cd770 con 0x7fa99c15fca0 2023-07-06T01:10:43.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa99c0b5c90 0x7fa99c0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa99c0b5c90 0x7fa99c0d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57094/0 (socket says 172.21.15.71:57094) 2023-07-06T01:10:43.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa99c0b6110 0x7fa99c0cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47540/0 (socket says 172.21.15.71:47540) 2023-07-06T01:10:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 -- 172.21.15.71:0/3783844574 learned_addr learned my addr 172.21.15.71:0/3783844574 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99affd700 1 --2- 172.21.15.71:0/3783844574 >> v2:172.21.15.194:3300/0 conn(0x7fa99c15fca0 0x7fa99c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 -- 172.21.15.71:0/3783844574 >> v2:172.21.15.194:3300/0 conn(0x7fa99c15fca0 msgr2=0x7fa99c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 --2- 172.21.15.71:0/3783844574 >> v2:172.21.15.194:3300/0 conn(0x7fa99c15fca0 0x7fa99c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 -- 172.21.15.71:0/3783844574 >> v1:172.21.15.71:6789/0 conn(0x7fa99c0b6110 legacy=0x7fa99c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.902+0000 7fa99a7fc700 1 -- 172.21.15.71:0/3783844574 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0cda50 con 0x7fa99c0b5c90 2023-07-06T01:10:43.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa99a7fc700 1 --2- 172.21.15.71:0/3783844574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c0b5c90 0x7fa99c0d2d40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0d0930 tx=0x7fa990009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4281c4bba162a05 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa999ffb700 1 -- 172.21.15.71:0/3783844574 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990011830 con 0x7fa99c0b5c90 2023-07-06T01:10:43.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa999ffb700 1 -- 172.21.15.71:0/3783844574 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990011990 con 0x7fa99c0b5c90 2023-07-06T01:10:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa999ffb700 1 -- 172.21.15.71:0/3783844574 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990011d20 con 0x7fa99c0b5c90 2023-07-06T01:10:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa9a17ff700 1 -- 172.21.15.71:0/3783844574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c0b5c90 msgr2=0x7fa99c0d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/3783844574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c0b5c90 0x7fa99c0d2d40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0d0930 tx=0x7fa990009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa9a17ff700 1 -- 172.21.15.71:0/3783844574 shutdown_connections 2023-07-06T01:10:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.903+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/3783844574 >> v2:172.21.15.194:3300/0 conn(0x7fa99c15fca0 0x7fa99c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.904+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/3783844574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c0b5c90 0x7fa99c0d2d40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.904+0000 7fa9a17ff700 1 -- 172.21.15.71:0/3783844574 >> 172.21.15.71:0/3783844574 conn(0x7fa99c06c150 msgr2=0x7fa99c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:43.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.904+0000 7fa9a17ff700 1 -- 172.21.15.71:0/3783844574 shutdown_connections 2023-07-06T01:10:43.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.904+0000 7fa9a17ff700 1 -- 172.21.15.71:0/3783844574 wait complete. 2023-07-06T01:10:43.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.905+0000 7fa9a17ff700 1 Processor -- start 2023-07-06T01:10:43.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.905+0000 7fa9a17ff700 1 -- start start 2023-07-06T01:10:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.906+0000 7fa9a17ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa99c0b5c90 0x7fa99c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.906+0000 7fa9a17ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa99c0b6110 0x7fa99c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.906+0000 7fa9a17ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 0x7fa99c0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.906+0000 7fa9a17ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0ccd70 con 0x7fa99c15fca0 2023-07-06T01:10:43.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.906+0000 7fa9a17ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c157bf0 con 0x7fa99c0b6110 2023-07-06T01:10:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.906+0000 7fa9a17ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1f5450 con 0x7fa99c0b5c90 2023-07-06T01:10:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 0x7fa99c0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 0x7fa99c0b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57098/0 (socket says 172.21.15.71:57098) 2023-07-06T01:10:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 -- 172.21.15.71:0/2542536869 learned_addr learned my addr 172.21.15.71:0/2542536869 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:43.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99a7fc700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa99c0b6110 0x7fa99c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99affd700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa99c0b5c90 0x7fa99c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 -- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa99c0b5c90 msgr2=0x7fa99c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa99c0b5c90 0x7fa99c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 -- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa99c0b6110 msgr2=0x7fa99c1576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:43.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa99c0b6110 0x7fa99c1576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 -- 172.21.15.71:0/2542536869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009550 con 0x7fa99c15fca0 2023-07-06T01:10:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.907+0000 7fa99b7fe700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 0x7fa99c0b7a80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa99400cc00 tx=0x7fa99400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.908+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99400aa40 con 0x7fa99c15fca0 2023-07-06T01:10:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.908+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99400aba0 con 0x7fa99c15fca0 2023-07-06T01:10:43.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.908+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994007070 con 0x7fa99c15fca0 2023-07-06T01:10:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.908+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c1f5730 con 0x7fa99c15fca0 2023-07-06T01:10:43.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.908+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c1f5cf0 con 0x7fa99c15fca0 2023-07-06T01:10:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.909+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c0008d0 con 0x7fa99c15fca0 2023-07-06T01:10:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.910+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9940071d0 con 0x7fa99c15fca0 2023-07-06T01:10:43.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.911+0000 7fa9837fe700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa98806ace0 0x7fa98806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:43.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.911+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa994088e50 con 0x7fa99c15fca0 2023-07-06T01:10:43.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.911+0000 7fa99affd700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa98806ace0 0x7fa98806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:43.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.912+0000 7fa99affd700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa98806ace0 0x7fa98806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009b40 tx=0x7fa98c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:43.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:43.915+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa994054230 con 0x7fa99c15fca0 2023-07-06T01:10:44.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.111+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa99c06ae40 con 0x7fa98806ace0 2023-07-06T01:10:44.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.112+0000 7fa9837fe700 1 -- 172.21.15.71:0/2542536869 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa98c004020 con 0x7fa98806ace0 2023-07-06T01:10:44.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa98806ace0 msgr2=0x7fa98806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa98806ace0 0x7fa98806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009b40 tx=0x7fa98c009210 comp rx=0 tx=0).stop 2023-07-06T01:10:44.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 msgr2=0x7fa99c0b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 0x7fa99c0b7a80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa99400cc00 tx=0x7fa99400cf10 comp rx=0 tx=0).stop 2023-07-06T01:10:44.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 shutdown_connections 2023-07-06T01:10:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fa98806ace0 0x7fa98806d190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa99c15fca0 0x7fa99c0b7a80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa99c0b5c90 0x7fa99c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 --2- 172.21.15.71:0/2542536869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa99c0b6110 0x7fa99c1576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 >> 172.21.15.71:0/2542536869 conn(0x7fa99c06c150 msgr2=0x7fa99c0b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 shutdown_connections 2023-07-06T01:10:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.114+0000 7fa9a17ff700 1 -- 172.21.15.71:0/2542536869 wait complete. 2023-07-06T01:10:44.119 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2023-07-06T01:10:44.134 INFO:tasks.ceph:Scrubbing osd.3 2023-07-06T01:10:44.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:44.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.329+0000 7f82513ff700 1 Processor -- start 2023-07-06T01:10:44.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.329+0000 7f82513ff700 1 -- start start 2023-07-06T01:10:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.330+0000 7f82513ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c0cbb20 0x7f824c0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f82513ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f824c06f810 0x7f824c06b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f82513ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c0adf30 con 0x7f824c158af0 2023-07-06T01:10:44.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f82513ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0cd080 con 0x7f824c06f810 2023-07-06T01:10:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f82513ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0cd360 con 0x7f824c0cbb20 2023-07-06T01:10:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824affd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f824c158af0 0x7f824c0cb410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47544/0 (socket says 172.21.15.71:47544) 2023-07-06T01:10:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824affd700 1 -- 172.21.15.71:0/2546817493 learned_addr learned my addr 172.21.15.71:0/2546817493 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824b7fe700 1 --2- 172.21.15.71:0/2546817493 >> v2:172.21.15.71:3300/0 conn(0x7f824c06f810 0x7f824c06b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f8243fff700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c0cbb20 0x7f824c0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824a7fc700 1 -- 172.21.15.71:0/2546817493 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821523138 0 0) 0x7f824c0adf30 con 0x7f824c158af0 2023-07-06T01:10:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824a7fc700 1 -- 172.21.15.71:0/2546817493 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82380057c0 con 0x7f824c158af0 2023-07-06T01:10:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824b7fe700 1 -- 172.21.15.71:0/2546817493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c0cbb20 msgr2=0x7f824c0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:44.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824b7fe700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c0cbb20 0x7f824c0c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824b7fe700 1 -- 172.21.15.71:0/2546817493 >> v1:172.21.15.71:6789/0 conn(0x7f824c158af0 legacy=0x7f824c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f824b7fe700 1 -- 172.21.15.71:0/2546817493 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0cad00 con 0x7f824c06f810 2023-07-06T01:10:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.331+0000 7f8243fff700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c0cbb20 0x7f824c0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:44.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f824b7fe700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c06f810 0x7f824c06b9c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f824400aea0 tx=0x7f824400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8238cb04b477488 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f824a7fc700 1 -- 172.21.15.71:0/2546817493 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824400a2d0 con 0x7f824c06f810 2023-07-06T01:10:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f824a7fc700 1 -- 172.21.15.71:0/2546817493 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824400c910 con 0x7f824c06f810 2023-07-06T01:10:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f824a7fc700 1 -- 172.21.15.71:0/2546817493 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824400ccc0 con 0x7f824c06f810 2023-07-06T01:10:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f82513ff700 1 -- 172.21.15.71:0/2546817493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c06f810 msgr2=0x7f824c06b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f82513ff700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c06f810 0x7f824c06b9c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f824400aea0 tx=0x7f824400c330 comp rx=0 tx=0).stop 2023-07-06T01:10:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f82513ff700 1 -- 172.21.15.71:0/2546817493 shutdown_connections 2023-07-06T01:10:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f82513ff700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c06f810 0x7f824c06b9c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f82513ff700 1 --2- 172.21.15.71:0/2546817493 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c0cbb20 0x7f824c0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.332+0000 7f82513ff700 1 -- 172.21.15.71:0/2546817493 >> 172.21.15.71:0/2546817493 conn(0x7f824c069f60 msgr2=0x7f824c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.333+0000 7f82513ff700 1 -- 172.21.15.71:0/2546817493 shutdown_connections 2023-07-06T01:10:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.333+0000 7f82513ff700 1 -- 172.21.15.71:0/2546817493 wait complete. 2023-07-06T01:10:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.334+0000 7f82513ff700 1 Processor -- start 2023-07-06T01:10:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.334+0000 7f82513ff700 1 -- start start 2023-07-06T01:10:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.335+0000 7f82513ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c06f810 0x7f824c0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.335+0000 7f82513ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f824c0cbb20 0x7f824c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.335+0000 7f82513ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c158af0 0x7f824c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.335+0000 7f82513ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c1e5430 con 0x7f824c158af0 2023-07-06T01:10:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.335+0000 7f82513ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c155c60 con 0x7f824c0cbb20 2023-07-06T01:10:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.335+0000 7f82513ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c155f40 con 0x7f824c06f810 2023-07-06T01:10:44.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c158af0 0x7f824c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c158af0 0x7f824c155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57112/0 (socket says 172.21.15.71:57112) 2023-07-06T01:10:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 -- 172.21.15.71:0/2369524477 learned_addr learned my addr 172.21.15.71:0/2369524477 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824affd700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c06f810 0x7f824c0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f8243fff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f824c0cbb20 0x7f824c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 -- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c06f810 msgr2=0x7f824c0b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f824c06f810 0x7f824c0b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 -- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f824c0cbb20 msgr2=0x7f824c151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f824c0cbb20 0x7f824c151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 -- 172.21.15.71:0/2369524477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824400ab80 con 0x7f824c158af0 2023-07-06T01:10:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f8243fff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f824c0cbb20 0x7f824c151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.336+0000 7f824b7fe700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c158af0 0x7f824c155360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f824400afd0 tx=0x7f8244004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.337+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824400aa00 con 0x7f824c158af0 2023-07-06T01:10:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.337+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244003a20 con 0x7f824c158af0 2023-07-06T01:10:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.337+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c156220 con 0x7f824c158af0 2023-07-06T01:10:44.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.337+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244003db0 con 0x7f824c158af0 2023-07-06T01:10:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.337+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c1558a0 con 0x7f824c158af0 2023-07-06T01:10:44.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.337+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f824c158ec0 con 0x7f824c158af0 2023-07-06T01:10:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.339+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f824401a040 con 0x7f824c158af0 2023-07-06T01:10:44.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.339+0000 7f82437fe700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f822c06ace0 0x7f822c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f824408a160 con 0x7f824c158af0 2023-07-06T01:10:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f82437fe700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f822c071150 0x7f822c073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 --> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f822c073c30 con 0x7f822c071150 2023-07-06T01:10:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f824408c740 con 0x7f824c158af0 2023-07-06T01:10:44.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f824affd700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f822c06ace0 0x7f822c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f8243fff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f822c071150 0x7f822c073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.340+0000 7f8243fff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f822c071150 0x7f822c073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.341+0000 7f824affd700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f822c06ace0 0x7f822c06d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f823c007fd0 tx=0x7f823c007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.341+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== osd.3 v2:172.21.15.71:6824/1769601539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f822c073c30 con 0x7f822c071150 2023-07-06T01:10:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 --> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f824c0cafe0 con 0x7f822c071150 2023-07-06T01:10:44.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82437fe700 1 -- 172.21.15.71:0/2369524477 <== osd.3 v2:172.21.15.71:6824/1769601539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f823400c040 con 0x7f822c071150 2023-07-06T01:10:44.359 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:44.359 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:44.360 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f822c071150 msgr2=0x7f822c073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:6824/1769601539,v1:172.21.15.71:6825/1769601539] conn(0x7f822c071150 0x7f822c073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f822c06ace0 msgr2=0x7f822c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f822c06ace0 0x7f822c06d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f823c007fd0 tx=0x7f823c007dc0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c158af0 msgr2=0x7f824c155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.356+0000 7f82513ff700 1 --2- 172.21.15.71:0/2369524477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f824c158af0 0x7f824c155360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f824400afd0 tx=0x7f8244004ad0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.357+0000 7f824b7fe700 1 -- 172.21.15.71:0/2369524477 reap_dead start 2023-07-06T01:10:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.357+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 shutdown_connections 2023-07-06T01:10:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.357+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 >> 172.21.15.71:0/2369524477 conn(0x7f824c069f60 msgr2=0x7f824c158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.357+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 shutdown_connections 2023-07-06T01:10:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.357+0000 7f82513ff700 1 -- 172.21.15.71:0/2369524477 wait complete. 2023-07-06T01:10:44.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-06T01:10:44.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.572+0000 7f9be7dff700 1 Processor -- start 2023-07-06T01:10:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.572+0000 7f9be7dff700 1 -- start start 2023-07-06T01:10:44.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be7dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be7dff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9be00b60e0 0x7f9be00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be7dff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be00cf780 con 0x7f9be015fca0 2023-07-06T01:10:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be7dff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be00cd490 con 0x7f9be00b60e0 2023-07-06T01:10:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be7dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00cd770 con 0x7f9be00b5c90 2023-07-06T01:10:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be639c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9be00b60e0 0x7f9be00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be639c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9be00b60e0 0x7f9be00d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57122/0 (socket says 172.21.15.71:57122) 2023-07-06T01:10:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be639c700 1 -- 172.21.15.71:0/431129902 learned_addr learned my addr 172.21.15.71:0/431129902 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.573+0000 7f9be539a700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be639c700 1 -- 172.21.15.71:0/431129902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 msgr2=0x7f9be00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be639c700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be639c700 1 -- 172.21.15.71:0/431129902 >> v1:172.21.15.194:6789/0 conn(0x7f9be015fca0 legacy=0x7f9be00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be639c700 1 -- 172.21.15.71:0/431129902 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00cda50 con 0x7f9be00b60e0 2023-07-06T01:10:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be4b99700 1 -- 172.21.15.71:0/431129902 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415339611 0 0) 0x7f9be00cf780 con 0x7f9be015fca0 2023-07-06T01:10:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be539a700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be639c700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be00d3280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009e50 tx=0x7f9bd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1827ef20eae95cf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be4b99700 1 -- 172.21.15.71:0/431129902 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800e070 con 0x7f9be00b60e0 2023-07-06T01:10:44.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be4b99700 1 -- 172.21.15.71:0/431129902 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd800b9c0 con 0x7f9be00b60e0 2023-07-06T01:10:44.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.574+0000 7f9be4b99700 1 -- 172.21.15.71:0/431129902 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800bd70 con 0x7f9be00b60e0 2023-07-06T01:10:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 -- 172.21.15.71:0/431129902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 msgr2=0x7f9be00d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be00d3280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009e50 tx=0x7f9bd800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 -- 172.21.15.71:0/431129902 shutdown_connections 2023-07-06T01:10:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be00d3280 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 --2- 172.21.15.71:0/431129902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 -- 172.21.15.71:0/431129902 >> 172.21.15.71:0/431129902 conn(0x7f9be006c150 msgr2=0x7f9be006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 -- 172.21.15.71:0/431129902 shutdown_connections 2023-07-06T01:10:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.575+0000 7f9be7dff700 1 -- 172.21.15.71:0/431129902 wait complete. 2023-07-06T01:10:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.576+0000 7f9be7dff700 1 Processor -- start 2023-07-06T01:10:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.577+0000 7f9be7dff700 1 -- start start 2023-07-06T01:10:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.577+0000 7f9be7dff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.577+0000 7f9be7dff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be7dff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9be015fca0 0x7f9be00cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be7dff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00b3ef0 con 0x7f9be00b60e0 2023-07-06T01:10:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be7dff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00caee0 con 0x7f9be015fca0 2023-07-06T01:10:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be7dff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0155000 con 0x7f9be00b5c90 2023-07-06T01:10:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57134/0 (socket says 172.21.15.71:57134) 2023-07-06T01:10:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 -- 172.21.15.71:0/3716427675 learned_addr learned my addr 172.21.15.71:0/3716427675 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be5b9b700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be639c700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9be015fca0 0x7f9be00cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 -- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 msgr2=0x7f9be00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 -- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9be015fca0 msgr2=0x7f9be00cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9be015fca0 0x7f9be00cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 -- 172.21.15.71:0/3716427675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd8009b30 con 0x7f9be00b60e0 2023-07-06T01:10:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be639c700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9be015fca0 0x7f9be00cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.578+0000 7f9be539a700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be015c520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000e810 tx=0x7f9bd000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.579+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0004230 con 0x7f9be00b60e0 2023-07-06T01:10:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.579+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0004390 con 0x7f9be00b60e0 2023-07-06T01:10:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.579+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be01552e0 con 0x7f9be00b60e0 2023-07-06T01:10:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.579+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00036a0 con 0x7f9be00b60e0 2023-07-06T01:10:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.579+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be01558a0 con 0x7f9be00b60e0 2023-07-06T01:10:44.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.580+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be00008d0 con 0x7f9be00b60e0 2023-07-06T01:10:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.581+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9bd0003800 con 0x7f9be00b60e0 2023-07-06T01:10:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.582+0000 7f9bd67fc700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9bc406ace0 0x7f9bc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.582+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9bd0088cf0 con 0x7f9be00b60e0 2023-07-06T01:10:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.582+0000 7f9be5b9b700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9bc406ace0 0x7f9bc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.583+0000 7f9be5b9b700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9bc406ace0 0x7f9bc406d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000f60 tx=0x7f9bdc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.586+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9bd0054020 con 0x7f9be00b60e0 2023-07-06T01:10:44.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.783+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9be006ae40 con 0x7f9bc406ace0 2023-07-06T01:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.785+0000 7f9bd67fc700 1 -- 172.21.15.71:0/3716427675 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9bdc0050d0 con 0x7f9bc406ace0 2023-07-06T01:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9bc406ace0 msgr2=0x7f9bc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9bc406ace0 0x7f9bc406d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000f60 tx=0x7f9bdc009040 comp rx=0 tx=0).stop 2023-07-06T01:10:44.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 msgr2=0x7f9be015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be015c520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000e810 tx=0x7f9bd000ebd0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 shutdown_connections 2023-07-06T01:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9bc406ace0 0x7f9bc406d190 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9be015fca0 0x7f9be00cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9be00b5c90 0x7f9be00b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 --2- 172.21.15.71:0/3716427675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9be00b60e0 0x7f9be015c520 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 >> 172.21.15.71:0/3716427675 conn(0x7f9be006c150 msgr2=0x7f9be00d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 shutdown_connections 2023-07-06T01:10:44.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:44.786+0000 7f9be7dff700 1 -- 172.21.15.71:0/3716427675 wait complete. 2023-07-06T01:10:44.795 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2023-07-06T01:10:44.807 INFO:tasks.ceph:Scrubbing osd.4 2023-07-06T01:10:44.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:45.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.003+0000 7f12f79ff700 1 Processor -- start 2023-07-06T01:10:45.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.003+0000 7f12f79ff700 1 -- start start 2023-07-06T01:10:45.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.004+0000 7f12f79ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f12f00cfe40 0x7f12f00cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.004+0000 7f12f79ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 0x7f12f00d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.004+0000 7f12f79ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f0160cc0 con 0x7f12f00b8440 2023-07-06T01:10:45.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.004+0000 7f12f79ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f0160ae0 con 0x7f12f00cfe40 2023-07-06T01:10:45.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.004+0000 7f12f79ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0160f80 con 0x7f12f00b2180 2023-07-06T01:10:45.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 0x7f12f00d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 0x7f12f00d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.71:33620/0 (socket says 172.21.15.71:33620) 2023-07-06T01:10:45.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 -- 172.21.15.71:0/2782545134 learned_addr learned my addr 172.21.15.71:0/2782545134 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:45.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f4f9a700 1 --2- 172.21.15.71:0/2782545134 >> v2:172.21.15.194:3300/0 conn(0x7f12f00cfe40 0x7f12f00cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 -- 172.21.15.71:0/2782545134 >> v2:172.21.15.194:3300/0 conn(0x7f12f00cfe40 msgr2=0x7f12f00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:45.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 --2- 172.21.15.71:0/2782545134 >> v2:172.21.15.194:3300/0 conn(0x7f12f00cfe40 0x7f12f00cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 -- 172.21.15.71:0/2782545134 >> v1:172.21.15.194:6789/0 conn(0x7f12f00b8440 legacy=0x7f12f00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 -- 172.21.15.71:0/2782545134 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00cf0e0 con 0x7f12f00b2180 2023-07-06T01:10:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.005+0000 7f12f5f9c700 1 --2- 172.21.15.71:0/2782545134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 0x7f12f00d0960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009e50 tx=0x7f12e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c41f748ecd8782 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12e7fff700 1 -- 172.21.15.71:0/2782545134 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800e070 con 0x7f12f00b2180 2023-07-06T01:10:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12e7fff700 1 -- 172.21.15.71:0/2782545134 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e800b910 con 0x7f12f00b2180 2023-07-06T01:10:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12e7fff700 1 -- 172.21.15.71:0/2782545134 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e800bcc0 con 0x7f12f00b2180 2023-07-06T01:10:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 -- 172.21.15.71:0/2782545134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 msgr2=0x7f12f00d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 --2- 172.21.15.71:0/2782545134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 0x7f12f00d0960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009e50 tx=0x7f12e800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 -- 172.21.15.71:0/2782545134 shutdown_connections 2023-07-06T01:10:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 --2- 172.21.15.71:0/2782545134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00b2180 0x7f12f00d0960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 --2- 172.21.15.71:0/2782545134 >> v2:172.21.15.194:3300/0 conn(0x7f12f00cfe40 0x7f12f00cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 -- 172.21.15.71:0/2782545134 >> 172.21.15.71:0/2782545134 conn(0x7f12f006be10 msgr2=0x7f12f0071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 -- 172.21.15.71:0/2782545134 shutdown_connections 2023-07-06T01:10:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.006+0000 7f12f79ff700 1 -- 172.21.15.71:0/2782545134 wait complete. 2023-07-06T01:10:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.008+0000 7f12f79ff700 1 Processor -- start 2023-07-06T01:10:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.008+0000 7f12f79ff700 1 -- start start 2023-07-06T01:10:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f79ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f00b2180 0x7f12f00c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f79ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f00b8440 0x7f12f015dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f79ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00cfe40 0x7f12f00c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f79ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f01579d0 con 0x7f12f00b8440 2023-07-06T01:10:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f79ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f015e2c0 con 0x7f12f00b2180 2023-07-06T01:10:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f79ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f015e5a0 con 0x7f12f00cfe40 2023-07-06T01:10:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f4f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f00b8440 0x7f12f015dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f4f9a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f00b8440 0x7f12f015dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57136/0 (socket says 172.21.15.71:57136) 2023-07-06T01:10:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.009+0000 7f12f4f9a700 1 -- 172.21.15.71:0/3169408029 learned_addr learned my addr 172.21.15.71:0/3169408029 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f579b700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f00b2180 0x7f12f00c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f5f9c700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00cfe40 0x7f12f00c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f4f9a700 1 -- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00cfe40 msgr2=0x7f12f00c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f4f9a700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12f00cfe40 0x7f12f00c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f4f9a700 1 -- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f00b2180 msgr2=0x7f12f00c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f4f9a700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12f00b2180 0x7f12f00c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f4f9a700 1 -- 172.21.15.71:0/3169408029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8009b30 con 0x7f12f00b8440 2023-07-06T01:10:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f4f9a700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f00b8440 0x7f12f015dbc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e840 tx=0x7f12e000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0009590 con 0x7f12f00b8440 2023-07-06T01:10:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0013680 con 0x7f12f00b8440 2023-07-06T01:10:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f015e880 con 0x7f12f00b8440 2023-07-06T01:10:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0013a30 con 0x7f12f00b8440 2023-07-06T01:10:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.010+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f015ee40 con 0x7f12f00b8440 2023-07-06T01:10:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.011+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12f00b8810 con 0x7f12f00b8440 2023-07-06T01:10:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.012+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12e0013b90 con 0x7f12f00b8440 2023-07-06T01:10:45.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.013+0000 7f12e5ffb700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f12d406ace0 0x7f12d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.013+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f12e0089160 con 0x7f12f00b8440 2023-07-06T01:10:45.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.013+0000 7f12e5ffb700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7f12d4071150 0x7f12d4073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.013+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 --> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f12d4073c30 con 0x7f12d4071150 2023-07-06T01:10:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.013+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e008b740 con 0x7f12f00b8440 2023-07-06T01:10:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.014+0000 7f12f579b700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f12d406ace0 0x7f12d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.014+0000 7f12f5f9c700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7f12d4071150 0x7f12d4073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.014+0000 7f12f579b700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f12d406ace0 0x7f12d406d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0016c0 tx=0x7f12ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.014+0000 7f12f5f9c700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7f12d4071150 0x7f12d4073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.015+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== osd.4 v2:172.21.15.194:6800/654779018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f12d4073c30 con 0x7f12d4071150 2023-07-06T01:10:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.030+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 --> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12f00cf3c0 con 0x7f12d4071150 2023-07-06T01:10:45.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12e5ffb700 1 -- 172.21.15.71:0/3169408029 <== osd.4 v2:172.21.15.194:6800/654779018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f12e80099b0 con 0x7f12d4071150 2023-07-06T01:10:45.033 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:45.034 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:45.034 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7f12d4071150 msgr2=0x7f12d4073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6800/654779018,v1:172.21.15.194:6801/654779018] conn(0x7f12d4071150 0x7f12d4073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f12d406ace0 msgr2=0x7f12d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f12d406ace0 0x7f12d406d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0016c0 tx=0x7f12ec009040 comp rx=0 tx=0).stop 2023-07-06T01:10:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f00b8440 msgr2=0x7f12f015dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 --2- 172.21.15.71:0/3169408029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12f00b8440 0x7f12f015dbc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e840 tx=0x7f12e000ec00 comp rx=0 tx=0).stop 2023-07-06T01:10:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f5f9c700 1 -- 172.21.15.71:0/3169408029 reap_dead start 2023-07-06T01:10:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 shutdown_connections 2023-07-06T01:10:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 >> 172.21.15.71:0/3169408029 conn(0x7f12f006be10 msgr2=0x7f12f00b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.031+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 shutdown_connections 2023-07-06T01:10:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.032+0000 7f12f79ff700 1 -- 172.21.15.71:0/3169408029 wait complete. 2023-07-06T01:10:45.050 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-06T01:10:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.244+0000 7f39881ff700 1 Processor -- start 2023-07-06T01:10:45.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.244+0000 7f39881ff700 1 -- start start 2023-07-06T01:10:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.245+0000 7f39881ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39800b5c90 0x7f39800d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.245+0000 7f39881ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f39800b6110 0x7f39800d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.245+0000 7f39881ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800cf780 con 0x7f398015fca0 2023-07-06T01:10:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.245+0000 7f39881ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800cd490 con 0x7f39800b6110 2023-07-06T01:10:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.245+0000 7f39881ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800cd770 con 0x7f39800b5c90 2023-07-06T01:10:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f3985f9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f398015fca0 0x7f39800d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47550/0 (socket says 172.21.15.71:47550) 2023-07-06T01:10:45.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f3985f9b700 1 -- 172.21.15.71:0/128518953 learned_addr learned my addr 172.21.15.71:0/128518953 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f398679c700 1 --2- 172.21.15.71:0/128518953 >> v2:172.21.15.71:3300/0 conn(0x7f39800b6110 0x7f39800d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f398579a700 1 --2- 172.21.15.71:0/128518953 >> v2:172.21.15.194:3300/0 conn(0x7f39800b5c90 0x7f39800d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f3984f99700 1 -- 172.21.15.71:0/128518953 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839686711 0 0) 0x7f39800cf780 con 0x7f398015fca0 2023-07-06T01:10:45.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f3984f99700 1 -- 172.21.15.71:0/128518953 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f396c0035b0 con 0x7f398015fca0 2023-07-06T01:10:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f398679c700 1 -- 172.21.15.71:0/128518953 >> v2:172.21.15.194:3300/0 conn(0x7f39800b5c90 msgr2=0x7f39800d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f398679c700 1 --2- 172.21.15.71:0/128518953 >> v2:172.21.15.194:3300/0 conn(0x7f39800b5c90 0x7f39800d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f398679c700 1 -- 172.21.15.71:0/128518953 >> v1:172.21.15.71:6789/0 conn(0x7f398015fca0 legacy=0x7f39800d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.246+0000 7f398679c700 1 -- 172.21.15.71:0/128518953 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800cda50 con 0x7f39800b6110 2023-07-06T01:10:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f398679c700 1 --2- 172.21.15.71:0/128518953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800d3280 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f398006b6f0 tx=0x7f397800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b904f561087921 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f3984f99700 1 -- 172.21.15.71:0/128518953 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800e070 con 0x7f39800b6110 2023-07-06T01:10:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f3984f99700 1 -- 172.21.15.71:0/128518953 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800bb20 con 0x7f39800b6110 2023-07-06T01:10:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f3984f99700 1 -- 172.21.15.71:0/128518953 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978012430 con 0x7f39800b6110 2023-07-06T01:10:45.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 -- 172.21.15.71:0/128518953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 msgr2=0x7f39800d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 --2- 172.21.15.71:0/128518953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800d3280 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f398006b6f0 tx=0x7f397800b330 comp rx=0 tx=0).stop 2023-07-06T01:10:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 -- 172.21.15.71:0/128518953 shutdown_connections 2023-07-06T01:10:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 --2- 172.21.15.71:0/128518953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800d3280 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 --2- 172.21.15.71:0/128518953 >> v2:172.21.15.194:3300/0 conn(0x7f39800b5c90 0x7f39800d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 -- 172.21.15.71:0/128518953 >> 172.21.15.71:0/128518953 conn(0x7f398006c150 msgr2=0x7f398006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.247+0000 7f39881ff700 1 -- 172.21.15.71:0/128518953 shutdown_connections 2023-07-06T01:10:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.248+0000 7f39881ff700 1 -- 172.21.15.71:0/128518953 wait complete. 2023-07-06T01:10:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.249+0000 7f39881ff700 1 Processor -- start 2023-07-06T01:10:45.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.249+0000 7f39881ff700 1 -- start start 2023-07-06T01:10:45.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.250+0000 7f39881ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39800b5c90 0x7f3980150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.250+0000 7f39881ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.250+0000 7f39881ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f398015fca0 0x7f39800b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.250+0000 7f39881ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800c8120 con 0x7f39800b6110 2023-07-06T01:10:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.250+0000 7f39881ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801f6360 con 0x7f39800b5c90 2023-07-06T01:10:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.250+0000 7f39881ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39801f55a0 con 0x7f398015fca0 2023-07-06T01:10:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57162/0 (socket says 172.21.15.71:57162) 2023-07-06T01:10:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 -- 172.21.15.71:0/2960354945 learned_addr learned my addr 172.21.15.71:0/2960354945 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f3985f9b700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39800b5c90 0x7f3980150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398679c700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f398015fca0 0x7f39800b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 -- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f398015fca0 msgr2=0x7f39800b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f398015fca0 0x7f39800b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 -- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39800b5c90 msgr2=0x7f3980150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39800b5c90 0x7f3980150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 -- 172.21.15.71:0/2960354945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009a70 con 0x7f39800b6110 2023-07-06T01:10:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f3985f9b700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39800b5c90 0x7f3980150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:45.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398679c700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f398015fca0 0x7f39800b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f398579a700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800b3100 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f397000e9b0 tx=0x7f397000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970009710 con 0x7f39800b6110 2023-07-06T01:10:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000c850 con 0x7f39800b6110 2023-07-06T01:10:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39801f5880 con 0x7f39800b6110 2023-07-06T01:10:45.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.251+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000cbc0 con 0x7f39800b6110 2023-07-06T01:10:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.252+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39801f5e40 con 0x7f39800b6110 2023-07-06T01:10:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.253+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800008d0 con 0x7f39800b6110 2023-07-06T01:10:45.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.254+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f397000cd20 con 0x7f39800b6110 2023-07-06T01:10:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.255+0000 7f39767fc700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f396406ace0 0x7f396406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.255+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3970089a90 con 0x7f39800b6110 2023-07-06T01:10:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.256+0000 7f3985f9b700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f396406ace0 0x7f396406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.256+0000 7f3985f9b700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f396406ace0 0x7f396406d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f397c0011e0 tx=0x7f397c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.258+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3970058960 con 0x7f39800b6110 2023-07-06T01:10:45.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.454+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f398006ae40 con 0x7f396406ace0 2023-07-06T01:10:45.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.455+0000 7f39767fc700 1 -- 172.21.15.71:0/2960354945 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f397c001c70 con 0x7f396406ace0 2023-07-06T01:10:45.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f396406ace0 msgr2=0x7f396406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f396406ace0 0x7f396406d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f397c0011e0 tx=0x7f397c009040 comp rx=0 tx=0).stop 2023-07-06T01:10:45.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 msgr2=0x7f39800b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800b3100 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f397000e9b0 tx=0x7f397000ed70 comp rx=0 tx=0).stop 2023-07-06T01:10:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 shutdown_connections 2023-07-06T01:10:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f396406ace0 0x7f396406d190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f398015fca0 0x7f39800b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39800b5c90 0x7f3980150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 --2- 172.21.15.71:0/2960354945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39800b6110 0x7f39800b3100 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 >> 172.21.15.71:0/2960354945 conn(0x7f398006c150 msgr2=0x7f39800d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 shutdown_connections 2023-07-06T01:10:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.457+0000 7f39881ff700 1 -- 172.21.15.71:0/2960354945 wait complete. 2023-07-06T01:10:45.462 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2023-07-06T01:10:45.477 INFO:tasks.ceph:Scrubbing osd.5 2023-07-06T01:10:45.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:45.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.674+0000 7f7981bff700 1 Processor -- start 2023-07-06T01:10:45.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.674+0000 7f7981bff700 1 -- start start 2023-07-06T01:10:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f7981bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f797c070dc0 0x7f797c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f7981bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f7981bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c071b10 con 0x7f797c15a510 2023-07-06T01:10:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f7981bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0cbc50 con 0x7f797c070dc0 2023-07-06T01:10:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f7981bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c071270 con 0x7f797c0cb7b0 2023-07-06T01:10:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f797b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f797c15a510 0x7f797c0706b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47564/0 (socket says 172.21.15.71:47564) 2023-07-06T01:10:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.675+0000 7f797b7fe700 1 -- 172.21.15.71:0/1793773553 learned_addr learned my addr 172.21.15.71:0/1793773553 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:45.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797affd700 1 --2- 172.21.15.71:0/1793773553 >> v2:172.21.15.194:3300/0 conn(0x7f797c070dc0 0x7f797c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797bfff700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797a7fc700 1 -- 172.21.15.71:0/1793773553 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853212584 0 0) 0x7f797c071b10 con 0x7f797c15a510 2023-07-06T01:10:45.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797a7fc700 1 -- 172.21.15.71:0/1793773553 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79640035b0 con 0x7f797c15a510 2023-07-06T01:10:45.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797affd700 1 -- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 msgr2=0x7f797c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797affd700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797affd700 1 -- 172.21.15.71:0/1793773553 >> v1:172.21.15.71:6789/0 conn(0x7f797c15a510 legacy=0x7f797c0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797a7fc700 1 -- 172.21.15.71:0/1793773553 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2138149365 0 0) 0x7f79640035b0 con 0x7f797c15a510 2023-07-06T01:10:45.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797affd700 1 -- 172.21.15.71:0/1793773553 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c071550 con 0x7f797c070dc0 2023-07-06T01:10:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797bfff700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:10:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.676+0000 7f797affd700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c070dc0 0x7f797c0cb270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7970009840 tx=0x7f7970009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d21c39832daf9b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f797a7fc700 1 -- 172.21.15.71:0/1793773553 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c001670 con 0x7f797c070dc0 2023-07-06T01:10:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f797a7fc700 1 -- 172.21.15.71:0/1793773553 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970004030 con 0x7f797c070dc0 2023-07-06T01:10:45.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f797a7fc700 1 -- 172.21.15.71:0/1793773553 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700043a0 con 0x7f797c070dc0 2023-07-06T01:10:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 -- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c070dc0 msgr2=0x7f797c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c070dc0 0x7f797c0cb270 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7970009840 tx=0x7f7970009b50 comp rx=0 tx=0).stop 2023-07-06T01:10:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 -- 172.21.15.71:0/1793773553 shutdown_connections 2023-07-06T01:10:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 --2- 172.21.15.71:0/1793773553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c070dc0 0x7f797c0cb270 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 -- 172.21.15.71:0/1793773553 >> 172.21.15.71:0/1793773553 conn(0x7f797c069f60 msgr2=0x7f797c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.677+0000 7f7981bff700 1 -- 172.21.15.71:0/1793773553 shutdown_connections 2023-07-06T01:10:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.678+0000 7f7981bff700 1 -- 172.21.15.71:0/1793773553 wait complete. 2023-07-06T01:10:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.679+0000 7f7981bff700 1 Processor -- start 2023-07-06T01:10:45.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.679+0000 7f7981bff700 1 -- start start 2023-07-06T01:10:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.680+0000 7f7981bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f797c070dc0 0x7f797c0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.680+0000 7f7981bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.680+0000 7f7981bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c15a510 0x7f797c0c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.680+0000 7f7981bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c60b0 con 0x7f797c070dc0 2023-07-06T01:10:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.680+0000 7f7981bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c6390 con 0x7f797c15a510 2023-07-06T01:10:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.680+0000 7f7981bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c6670 con 0x7f797c0cb7b0 2023-07-06T01:10:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f797c070dc0 0x7f797c0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f797c070dc0 0x7f797c0c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57174/0 (socket says 172.21.15.71:57174) 2023-07-06T01:10:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 -- 172.21.15.71:0/664188423 learned_addr learned my addr 172.21.15.71:0/664188423 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797bfff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c15a510 0x7f797c0c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797affd700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 -- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 msgr2=0x7f797c151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 -- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c15a510 msgr2=0x7f797c0c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c15a510 0x7f797c0c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 -- 172.21.15.71:0/664188423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009a70 con 0x7f797c070dc0 2023-07-06T01:10:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797bfff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f797c15a510 0x7f797c0c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797affd700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f797c0cb7b0 0x7f797c151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:10:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f797b7fe700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f797c070dc0 0x7f797c0c5ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c780 tx=0x7f796c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.681+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c004c80 con 0x7f797c070dc0 2023-07-06T01:10:45.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.682+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c004de0 con 0x7f797c070dc0 2023-07-06T01:10:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.682+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79700094a0 con 0x7f797c070dc0 2023-07-06T01:10:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.682+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0072f0 con 0x7f797c070dc0 2023-07-06T01:10:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.682+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c0c6c30 con 0x7f797c070dc0 2023-07-06T01:10:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.682+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f797c0c9180 con 0x7f797c070dc0 2023-07-06T01:10:45.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.684+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f796c007450 con 0x7f797c070dc0 2023-07-06T01:10:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.684+0000 7f7963fff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f796806ace0 0x7f796806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.685+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f796c089050 con 0x7f797c070dc0 2023-07-06T01:10:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.685+0000 7f7963fff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f7968071150 0x7f7968073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.685+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 --> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7968073c30 con 0x7f7968071150 2023-07-06T01:10:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.685+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f796c08b5d0 con 0x7f797c070dc0 2023-07-06T01:10:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.685+0000 7f797affd700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f796806ace0 0x7f796806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.685+0000 7f797bfff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f7968071150 0x7f7968073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.686+0000 7f797affd700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f796806ace0 0x7f796806d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f797c06a790 tx=0x7f7970008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.686+0000 7f797bfff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f7968071150 0x7f7968073560 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.687+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== osd.5 v2:172.21.15.194:6808/2313076380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7968073c30 con 0x7f7968071150 2023-07-06T01:10:45.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.701+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 --> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f797c071830 con 0x7f7968071150 2023-07-06T01:10:45.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.702+0000 7f7963fff700 1 -- 172.21.15.71:0/664188423 <== osd.5 v2:172.21.15.194:6808/2313076380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f79740075d0 con 0x7f7968071150 2023-07-06T01:10:45.705 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:45.705 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:45.705 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.702+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f7968071150 msgr2=0x7f7968073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.702+0000 7f7981bff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6808/2313076380,v1:172.21.15.194:6809/2313076380] conn(0x7f7968071150 0x7f7968073560 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.702+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f796806ace0 msgr2=0x7f796806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f796806ace0 0x7f796806d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f797c06a790 tx=0x7f7970008030 comp rx=0 tx=0).stop 2023-07-06T01:10:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f797c070dc0 msgr2=0x7f797c0c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 --2- 172.21.15.71:0/664188423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f797c070dc0 0x7f797c0c5ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c780 tx=0x7f796c00cb40 comp rx=0 tx=0).stop 2023-07-06T01:10:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f797bfff700 1 -- 172.21.15.71:0/664188423 reap_dead start 2023-07-06T01:10:45.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 shutdown_connections 2023-07-06T01:10:45.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 >> 172.21.15.71:0/664188423 conn(0x7f797c069f60 msgr2=0x7f797c0b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 shutdown_connections 2023-07-06T01:10:45.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.703+0000 7f7981bff700 1 -- 172.21.15.71:0/664188423 wait complete. 2023-07-06T01:10:45.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-06T01:10:45.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.914+0000 7fc60abff700 1 Processor -- start 2023-07-06T01:10:45.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.914+0000 7fc60abff700 1 -- start start 2023-07-06T01:10:45.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.915+0000 7fc60abff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc60415fca0 0x7fc6040d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.915+0000 7fc60abff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.915+0000 7fc60abff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040cf780 con 0x7fc6040b5c90 2023-07-06T01:10:45.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.915+0000 7fc60abff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040cd490 con 0x7fc60415fca0 2023-07-06T01:10:45.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.915+0000 7fc60abff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040cd770 con 0x7fc6040b6110 2023-07-06T01:10:45.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc60415fca0 0x7fc6040d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc60415fca0 0x7fc6040d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57180/0 (socket says 172.21.15.71:57180) 2023-07-06T01:10:45.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 -- 172.21.15.71:0/2479847806 learned_addr learned my addr 172.21.15.71:0/2479847806 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:45.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60919c700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 -- 172.21.15.71:0/2479847806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 msgr2=0x7fc6040cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:45.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 -- 172.21.15.71:0/2479847806 >> v1:172.21.15.194:6789/0 conn(0x7fc6040b5c90 legacy=0x7fc6040d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 -- 172.21.15.71:0/2479847806 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040cda50 con 0x7fc60415fca0 2023-07-06T01:10:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60919c700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:45.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.916+0000 7fc60899b700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d1420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80098f0 tx=0x7fc5f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7def70f9ef5cac server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc6037fe700 1 -- 172.21.15.71:0/2479847806 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800b8a0 con 0x7fc60415fca0 2023-07-06T01:10:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc6037fe700 1 -- 172.21.15.71:0/2479847806 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800ba00 con 0x7fc60415fca0 2023-07-06T01:10:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc6037fe700 1 -- 172.21.15.71:0/2479847806 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800bd90 con 0x7fc60415fca0 2023-07-06T01:10:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 -- 172.21.15.71:0/2479847806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 msgr2=0x7fc6040d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d1420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80098f0 tx=0x7fc5f8009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:45.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 -- 172.21.15.71:0/2479847806 shutdown_connections 2023-07-06T01:10:45.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 --2- 172.21.15.71:0/2479847806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d1420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 -- 172.21.15.71:0/2479847806 >> 172.21.15.71:0/2479847806 conn(0x7fc60406c150 msgr2=0x7fc60406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:45.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 -- 172.21.15.71:0/2479847806 shutdown_connections 2023-07-06T01:10:45.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.917+0000 7fc60abff700 1 -- 172.21.15.71:0/2479847806 wait complete. 2023-07-06T01:10:45.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.919+0000 7fc60abff700 1 Processor -- start 2023-07-06T01:10:45.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.919+0000 7fc60abff700 1 -- start start 2023-07-06T01:10:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60abff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6040b5c90 0x7fc6041f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60abff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60abff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60abff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040ccd00 con 0x7fc60415fca0 2023-07-06T01:10:45.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60abff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041f5580 con 0x7fc6040b5c90 2023-07-06T01:10:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60abff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6041f2500 con 0x7fc6040b6110 2023-07-06T01:10:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60919c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57184/0 (socket says 172.21.15.71:57184) 2023-07-06T01:10:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60919c700 1 -- 172.21.15.71:0/3454539987 learned_addr learned my addr 172.21.15.71:0/3454539987 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:45.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc60899b700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6040b5c90 0x7fc6041f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.920+0000 7fc603fff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60919c700 1 -- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 msgr2=0x7fc6040cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60919c700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60919c700 1 -- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6040b5c90 msgr2=0x7fc6041f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:45.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60919c700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6040b5c90 0x7fc6041f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:45.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60919c700 1 -- 172.21.15.71:0/3454539987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009550 con 0x7fc60415fca0 2023-07-06T01:10:45.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60919c700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d0c10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc007ef0 tx=0x7fc5fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00dd80 con 0x7fc60415fca0 2023-07-06T01:10:45.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00f040 con 0x7fc60415fca0 2023-07-06T01:10:45.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6041f27e0 con 0x7fc60415fca0 2023-07-06T01:10:45.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc003c60 con 0x7fc60415fca0 2023-07-06T01:10:45.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.921+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6041f2da0 con 0x7fc60415fca0 2023-07-06T01:10:45.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.922+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6041f5780 con 0x7fc60415fca0 2023-07-06T01:10:45.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.923+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5fc004030 con 0x7fc60415fca0 2023-07-06T01:10:45.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.924+0000 7fc6017fa700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5e806ace0 0x7fc5e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:45.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.925+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc5fc089220 con 0x7fc60415fca0 2023-07-06T01:10:45.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.925+0000 7fc60899b700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5e806ace0 0x7fc5e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:45.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.926+0000 7fc60899b700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5e806ace0 0x7fc5e806d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8014040 tx=0x7fc5f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:45.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:45.928+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6041f5780 con 0x7fc60415fca0 2023-07-06T01:10:46.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.121+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc60406ae40 con 0x7fc5e806ace0 2023-07-06T01:10:46.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.123+0000 7fc6017fa700 1 -- 172.21.15.71:0/3454539987 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5f800bb70 con 0x7fc5e806ace0 2023-07-06T01:10:46.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5e806ace0 msgr2=0x7fc5e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5e806ace0 0x7fc5e806d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8014040 tx=0x7fc5f8008030 comp rx=0 tx=0).stop 2023-07-06T01:10:46.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 msgr2=0x7fc6040d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d0c10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc007ef0 tx=0x7fc5fc00d3b0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 shutdown_connections 2023-07-06T01:10:46.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc5e806ace0 0x7fc5e806d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc60415fca0 0x7fc6040d0c10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6040b5c90 0x7fc6041f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 --2- 172.21.15.71:0/3454539987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6040b6110 0x7fc6040cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 >> 172.21.15.71:0/3454539987 conn(0x7fc60406c150 msgr2=0x7fc6040b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:46.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 shutdown_connections 2023-07-06T01:10:46.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.124+0000 7fc60abff700 1 -- 172.21.15.71:0/3454539987 wait complete. 2023-07-06T01:10:46.130 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2023-07-06T01:10:46.144 INFO:tasks.ceph:Scrubbing osd.6 2023-07-06T01:10:46.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.341+0000 7f0c14fff700 1 Processor -- start 2023-07-06T01:10:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.341+0000 7f0c14fff700 1 -- start start 2023-07-06T01:10:46.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c14fff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0c100b4320 0x7f0c100cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c14fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c100cf880 0x7f0c100cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c14fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100cf330 0x7f0c100b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c14fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c100ce960 con 0x7f0c100cf880 2023-07-06T01:10:46.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c14fff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c100b46f0 con 0x7f0c100b4320 2023-07-06T01:10:46.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c14fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100cdd50 con 0x7f0c100cf330 2023-07-06T01:10:46.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c0dd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c100cf880 0x7f0c100cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c0dd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c100cf880 0x7f0c100cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57194/0 (socket says 172.21.15.71:57194) 2023-07-06T01:10:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.342+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/2456073774 learned_addr learned my addr 172.21.15.71:0/2456073774 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0ed9d700 1 --2- 172.21.15.71:0/2456073774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100cf330 0x7f0c100b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0e59c700 1 --2- 172.21.15.71:0/2456073774 >> v2:172.21.15.194:3300/0 conn(0x7f0c100b4320 0x7f0c100cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/2456073774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100cf330 msgr2=0x7f0c100b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:46.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0dd9b700 1 --2- 172.21.15.71:0/2456073774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100cf330 0x7f0c100b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/2456073774 >> v2:172.21.15.194:3300/0 conn(0x7f0c100b4320 msgr2=0x7f0c100cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0dd9b700 1 --2- 172.21.15.71:0/2456073774 >> v2:172.21.15.194:3300/0 conn(0x7f0c100b4320 0x7f0c100cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/2456073774 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c100ce030 con 0x7f0c100cf880 2023-07-06T01:10:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0dd9b700 1 --2- 172.21.15.71:0/2456073774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf880 0x7f0c100cedf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0c10066890 tx=0x7f0c04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3185255172d06a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0d59a700 1 -- 172.21.15.71:0/2456073774 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400b870 con 0x7f0c100cf880 2023-07-06T01:10:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0d59a700 1 -- 172.21.15.71:0/2456073774 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0400b9d0 con 0x7f0c100cf880 2023-07-06T01:10:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.343+0000 7f0c0d59a700 1 -- 172.21.15.71:0/2456073774 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400bd60 con 0x7f0c100cf880 2023-07-06T01:10:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 -- 172.21.15.71:0/2456073774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf880 msgr2=0x7f0c100cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 --2- 172.21.15.71:0/2456073774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf880 0x7f0c100cedf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0c10066890 tx=0x7f0c04009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 -- 172.21.15.71:0/2456073774 shutdown_connections 2023-07-06T01:10:46.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 --2- 172.21.15.71:0/2456073774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100cf330 0x7f0c100b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 --2- 172.21.15.71:0/2456073774 >> v2:172.21.15.194:3300/0 conn(0x7f0c100b4320 0x7f0c100cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 --2- 172.21.15.71:0/2456073774 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf880 0x7f0c100cedf0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 -- 172.21.15.71:0/2456073774 >> 172.21.15.71:0/2456073774 conn(0x7f0c1009c130 msgr2=0x7f0c100d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:46.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 -- 172.21.15.71:0/2456073774 shutdown_connections 2023-07-06T01:10:46.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.344+0000 7f0c14fff700 1 -- 172.21.15.71:0/2456073774 wait complete. 2023-07-06T01:10:46.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.346+0000 7f0c14fff700 1 Processor -- start 2023-07-06T01:10:46.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.347+0000 7f0c14fff700 1 -- start start 2023-07-06T01:10:46.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c14fff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100b4320 0x7f0c101503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c14fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf330 0x7f0c1015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c14fff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c100cf880 0x7f0c1015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c14fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101f22d0 con 0x7f0c100cf330 2023-07-06T01:10:46.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c14fff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100a0ad0 con 0x7f0c100cf880 2023-07-06T01:10:46.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c14fff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100a0510 con 0x7f0c100b4320 2023-07-06T01:10:46.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf330 0x7f0c1015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf330 0x7f0c1015a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57206/0 (socket says 172.21.15.71:57206) 2023-07-06T01:10:46.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/3826790101 learned_addr learned my addr 172.21.15.71:0/3826790101 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:46.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0e59c700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100b4320 0x7f0c101503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0ed9d700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c100cf880 0x7f0c1015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100b4320 msgr2=0x7f0c101503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100b4320 0x7f0c101503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c100cf880 msgr2=0x7f0c1015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c100cf880 0x7f0c1015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0dd9b700 1 -- 172.21.15.71:0/3826790101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04009550 con 0x7f0c100cf330 2023-07-06T01:10:46.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.348+0000 7f0c0e59c700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c100b4320 0x7f0c101503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:46.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.349+0000 7f0c0dd9b700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf330 0x7f0c1015a250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009c10 tx=0x7f0c04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.349+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04004540 con 0x7f0c100cf330 2023-07-06T01:10:46.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.349+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c040036a0 con 0x7f0c100cf330 2023-07-06T01:10:46.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.349+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c100a07f0 con 0x7f0c100cf330 2023-07-06T01:10:46.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.349+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04003a50 con 0x7f0c100cf330 2023-07-06T01:10:46.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.349+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c100cb610 con 0x7f0c100cf330 2023-07-06T01:10:46.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.350+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c100ce5f0 con 0x7f0c100cf330 2023-07-06T01:10:46.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.351+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c04021070 con 0x7f0c100cf330 2023-07-06T01:10:46.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.352+0000 7f0bfeffd700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0bf006ace0 0x7f0bf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.352+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0c0408a890 con 0x7f0c100cf330 2023-07-06T01:10:46.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.352+0000 7f0bfeffd700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7f0bf0071150 0x7f0bf0073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.352+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 --> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bf0073c30 con 0x7f0bf0071150 2023-07-06T01:10:46.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.352+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c0408f2a0 con 0x7f0c100cf330 2023-07-06T01:10:46.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.352+0000 7f0c0e59c700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0bf006ace0 0x7f0bf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.353+0000 7f0c0ed9d700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7f0bf0071150 0x7f0bf0073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.353+0000 7f0c0e59c700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0bf006ace0 0x7f0bf006d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c00006fd0 tx=0x7f0c00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.353+0000 7f0c0ed9d700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7f0bf0071150 0x7f0bf0073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.354+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== osd.6 v2:172.21.15.194:6816/3534579584 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0bf0073c30 con 0x7f0bf0071150 2023-07-06T01:10:46.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.369+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 --> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0c100ce310 con 0x7f0bf0071150 2023-07-06T01:10:46.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.369+0000 7f0bfeffd700 1 -- 172.21.15.71:0/3826790101 <== osd.6 v2:172.21.15.194:6816/3534579584 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0c08009b70 con 0x7f0bf0071150 2023-07-06T01:10:46.372 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:46.373 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:46.373 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:46.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7f0bf0071150 msgr2=0x7f0bf0073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6816/3534579584,v1:172.21.15.194:6817/3534579584] conn(0x7f0bf0071150 0x7f0bf0073560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0bf006ace0 msgr2=0x7f0bf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f0bf006ace0 0x7f0bf006d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c00006fd0 tx=0x7f0c00008040 comp rx=0 tx=0).stop 2023-07-06T01:10:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf330 msgr2=0x7f0c1015a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 --2- 172.21.15.71:0/3826790101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c100cf330 0x7f0c1015a250 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009c10 tx=0x7f0c04004750 comp rx=0 tx=0).stop 2023-07-06T01:10:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c0ed9d700 1 -- 172.21.15.71:0/3826790101 reap_dead start 2023-07-06T01:10:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 shutdown_connections 2023-07-06T01:10:46.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 >> 172.21.15.71:0/3826790101 conn(0x7f0c1009c130 msgr2=0x7f0c100b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:46.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 shutdown_connections 2023-07-06T01:10:46.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.370+0000 7f0c14fff700 1 -- 172.21.15.71:0/3826790101 wait complete. 2023-07-06T01:10:46.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-06T01:10:46.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.584+0000 7f9df81ff700 1 Processor -- start 2023-07-06T01:10:46.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.584+0000 7f9df81ff700 1 -- start start 2023-07-06T01:10:46.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df81ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9df006c330 0x7f9df006c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df81ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9df00c9010 0x7f9df00c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df01565f0 0x7f9df0156a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df81ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df006cc40 con 0x7f9df006c330 2023-07-06T01:10:46.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df81ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00c9a60 con 0x7f9df00c9010 2023-07-06T01:10:46.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0159b70 con 0x7f9df01565f0 2023-07-06T01:10:46.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df5f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9df006c330 0x7f9df006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df5f9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9df006c330 0x7f9df006c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57210/0 (socket says 172.21.15.71:57210) 2023-07-06T01:10:46.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.585+0000 7f9df5f9b700 1 -- 172.21.15.71:0/2454987024 learned_addr learned my addr 172.21.15.71:0/2454987024 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:46.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df579a700 1 --2- 172.21.15.71:0/2454987024 >> v2:172.21.15.194:3300/0 conn(0x7f9df00c9010 0x7f9df00c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df679c700 1 --2- 172.21.15.71:0/2454987024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df01565f0 0x7f9df0156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df5f9b700 1 -- 172.21.15.71:0/2454987024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df01565f0 msgr2=0x7f9df0156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df5f9b700 1 --2- 172.21.15.71:0/2454987024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df01565f0 0x7f9df0156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df5f9b700 1 -- 172.21.15.71:0/2454987024 >> v2:172.21.15.194:3300/0 conn(0x7f9df00c9010 msgr2=0x7f9df00c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df5f9b700 1 --2- 172.21.15.71:0/2454987024 >> v2:172.21.15.194:3300/0 conn(0x7f9df00c9010 0x7f9df00c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df5f9b700 1 -- 172.21.15.71:0/2454987024 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0159e50 con 0x7f9df006c330 2023-07-06T01:10:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df579a700 1 --2- 172.21.15.71:0/2454987024 >> v2:172.21.15.194:3300/0 conn(0x7f9df00c9010 0x7f9df00c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:10:46.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df5f9b700 1 --2- 172.21.15.71:0/2454987024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df006c330 0x7f9df006c700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9df006f4d0 tx=0x7f9dec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92be5e0155245300 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df4f99700 1 -- 172.21.15.71:0/2454987024 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00b870 con 0x7f9df006c330 2023-07-06T01:10:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df4f99700 1 -- 172.21.15.71:0/2454987024 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00b9d0 con 0x7f9df006c330 2023-07-06T01:10:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.586+0000 7f9df4f99700 1 -- 172.21.15.71:0/2454987024 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00bd60 con 0x7f9df006c330 2023-07-06T01:10:46.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 -- 172.21.15.71:0/2454987024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df006c330 msgr2=0x7f9df006c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 --2- 172.21.15.71:0/2454987024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df006c330 0x7f9df006c700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9df006f4d0 tx=0x7f9dec009bd0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 -- 172.21.15.71:0/2454987024 shutdown_connections 2023-07-06T01:10:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 --2- 172.21.15.71:0/2454987024 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df01565f0 0x7f9df0156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 --2- 172.21.15.71:0/2454987024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df006c330 0x7f9df006c700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 --2- 172.21.15.71:0/2454987024 >> v2:172.21.15.194:3300/0 conn(0x7f9df00c9010 0x7f9df00c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 -- 172.21.15.71:0/2454987024 >> 172.21.15.71:0/2454987024 conn(0x7f9df00cb440 msgr2=0x7f9df00cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 -- 172.21.15.71:0/2454987024 shutdown_connections 2023-07-06T01:10:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.587+0000 7f9df81ff700 1 -- 172.21.15.71:0/2454987024 wait complete. 2023-07-06T01:10:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.589+0000 7f9df81ff700 1 Processor -- start 2023-07-06T01:10:46.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.589+0000 7f9df81ff700 1 -- start start 2023-07-06T01:10:46.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df81ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9df006c330 0x7f9df00b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df81ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df00c9010 0x7f9df00b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df81ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 0x7f9df0152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df81ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00b1ca0 con 0x7f9df01565f0 2023-07-06T01:10:46.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df81ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00b2540 con 0x7f9df006c330 2023-07-06T01:10:46.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df81ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00715f0 con 0x7f9df00c9010 2023-07-06T01:10:46.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df679c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 0x7f9df0152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df679c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 0x7f9df0152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57218/0 (socket says 172.21.15.71:57218) 2023-07-06T01:10:46.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df679c700 1 -- 172.21.15.71:0/4171459559 learned_addr learned my addr 172.21.15.71:0/4171459559 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:46.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.590+0000 7f9df5f9b700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9df006c330 0x7f9df00b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df579a700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df00c9010 0x7f9df00b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df679c700 1 -- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df00c9010 msgr2=0x7f9df00b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df679c700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df00c9010 0x7f9df00b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df679c700 1 -- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9df006c330 msgr2=0x7f9df00b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df679c700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9df006c330 0x7f9df00b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df679c700 1 -- 172.21.15.71:0/4171459559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009550 con 0x7f9df01565f0 2023-07-06T01:10:46.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df679c700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 0x7f9df0152220 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9de8007e70 tx=0x7f9de800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de800ed30 con 0x7f9df01565f0 2023-07-06T01:10:46.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de800eeb0 con 0x7f9df01565f0 2023-07-06T01:10:46.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df00b1ef0 con 0x7f9df01565f0 2023-07-06T01:10:46.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8014640 con 0x7f9df01565f0 2023-07-06T01:10:46.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.591+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df0152760 con 0x7f9df01565f0 2023-07-06T01:10:46.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.592+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df00b26d0 con 0x7f9df01565f0 2023-07-06T01:10:46.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.593+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9de80147a0 con 0x7f9df01565f0 2023-07-06T01:10:46.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.594+0000 7f9de67fc700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dd406ace0 0x7f9dd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:46.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.594+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9de8089810 con 0x7f9df01565f0 2023-07-06T01:10:46.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.595+0000 7f9df5f9b700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dd406ace0 0x7f9dd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.595+0000 7f9df5f9b700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dd406ace0 0x7f9dd406d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9dec014040 tx=0x7f9dec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:46.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.598+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9de80585d0 con 0x7f9df01565f0 2023-07-06T01:10:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.793+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9df0159860 con 0x7f9dd406ace0 2023-07-06T01:10:46.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.794+0000 7f9de67fc700 1 -- 172.21.15.71:0/4171459559 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9dec00bb40 con 0x7f9dd406ace0 2023-07-06T01:10:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dd406ace0 msgr2=0x7f9dd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dd406ace0 0x7f9dd406d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9dec014040 tx=0x7f9dec008030 comp rx=0 tx=0).stop 2023-07-06T01:10:46.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 msgr2=0x7f9df0152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 0x7f9df0152220 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9de8007e70 tx=0x7f9de800e3c0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 shutdown_connections 2023-07-06T01:10:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f9dd406ace0 0x7f9dd406d190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9df01565f0 0x7f9df0152220 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9df006c330 0x7f9df00b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 --2- 172.21.15.71:0/4171459559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9df00c9010 0x7f9df00b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:46.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.796+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 >> 172.21.15.71:0/4171459559 conn(0x7f9df00cb440 msgr2=0x7f9df006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:46.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.797+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 shutdown_connections 2023-07-06T01:10:46.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:46.797+0000 7f9df81ff700 1 -- 172.21.15.71:0/4171459559 wait complete. 2023-07-06T01:10:46.803 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 6 to deep-scrub 2023-07-06T01:10:46.817 INFO:tasks.ceph:Scrubbing osd.7 2023-07-06T01:10:46.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-06T01:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.015+0000 7f36f97ff700 1 Processor -- start 2023-07-06T01:10:47.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.015+0000 7f36f97ff700 1 -- start start 2023-07-06T01:10:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.016+0000 7f36f97ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36f4158af0 0x7f36f40c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f97ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f36f40cbb20 0x7f36f406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f97ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40adf30 con 0x7f36f406f810 2023-07-06T01:10:47.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f97ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40cd080 con 0x7f36f4158af0 2023-07-06T01:10:47.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f97ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40cd360 con 0x7f36f40cbb20 2023-07-06T01:10:47.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f2ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36f4158af0 0x7f36f40c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36ebfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f36f406f810 0x7f36f40cb410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47566/0 (socket says 172.21.15.71:47566) 2023-07-06T01:10:47.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36ebfff700 1 -- 172.21.15.71:0/634796487 learned_addr learned my addr 172.21.15.71:0/634796487 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:47.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f37fe700 1 --2- 172.21.15.71:0/634796487 >> v2:172.21.15.194:3300/0 conn(0x7f36f40cbb20 0x7f36f406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f2ffd700 1 -- 172.21.15.71:0/634796487 >> v2:172.21.15.194:3300/0 conn(0x7f36f40cbb20 msgr2=0x7f36f406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:47.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f2ffd700 1 --2- 172.21.15.71:0/634796487 >> v2:172.21.15.194:3300/0 conn(0x7f36f40cbb20 0x7f36f406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f2ffd700 1 -- 172.21.15.71:0/634796487 >> v1:172.21.15.71:6789/0 conn(0x7f36f406f810 legacy=0x7f36f40cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f2ffd700 1 -- 172.21.15.71:0/634796487 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40cad00 con 0x7f36f4158af0 2023-07-06T01:10:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.017+0000 7f36f2ffd700 1 --2- 172.21.15.71:0/634796487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f4158af0 0x7f36f40c9050 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f36f40cd640 tx=0x7f36e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a257b715d1ad51 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f27fc700 1 -- 172.21.15.71:0/634796487 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011830 con 0x7f36f4158af0 2023-07-06T01:10:47.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f27fc700 1 -- 172.21.15.71:0/634796487 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4011990 con 0x7f36f4158af0 2023-07-06T01:10:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f27fc700 1 -- 172.21.15.71:0/634796487 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011d20 con 0x7f36f4158af0 2023-07-06T01:10:47.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 -- 172.21.15.71:0/634796487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f4158af0 msgr2=0x7f36f40c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 --2- 172.21.15.71:0/634796487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f4158af0 0x7f36f40c9050 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f36f40cd640 tx=0x7f36e4009b20 comp rx=0 tx=0).stop 2023-07-06T01:10:47.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 -- 172.21.15.71:0/634796487 shutdown_connections 2023-07-06T01:10:47.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 --2- 172.21.15.71:0/634796487 >> v2:172.21.15.194:3300/0 conn(0x7f36f40cbb20 0x7f36f406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 --2- 172.21.15.71:0/634796487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f4158af0 0x7f36f40c9050 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 -- 172.21.15.71:0/634796487 >> 172.21.15.71:0/634796487 conn(0x7f36f4069f60 msgr2=0x7f36f406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:47.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 -- 172.21.15.71:0/634796487 shutdown_connections 2023-07-06T01:10:47.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.018+0000 7f36f97ff700 1 -- 172.21.15.71:0/634796487 wait complete. 2023-07-06T01:10:47.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.020+0000 7f36f97ff700 1 Processor -- start 2023-07-06T01:10:47.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.020+0000 7f36f97ff700 1 -- start start 2023-07-06T01:10:47.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f97ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f406f810 0x7f36f40ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f97ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f40cbb20 0x7f36f40b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f97ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36f4158af0 0x7f36f414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f97ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40b1540 con 0x7f36f40cbb20 2023-07-06T01:10:47.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f97ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40c75f0 con 0x7f36f406f810 2023-07-06T01:10:47.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f97ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f414ff10 con 0x7f36f4158af0 2023-07-06T01:10:47.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f40cbb20 0x7f36f40b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f40cbb20 0x7f36f40b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57228/0 (socket says 172.21.15.71:57228) 2023-07-06T01:10:47.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36ebfff700 1 -- 172.21.15.71:0/3385936565 learned_addr learned my addr 172.21.15.71:0/3385936565 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.021+0000 7f36f2ffd700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f406f810 0x7f36f40ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36f37fe700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36f4158af0 0x7f36f414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36ebfff700 1 -- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36f4158af0 msgr2=0x7f36f414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36ebfff700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36f4158af0 0x7f36f414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36ebfff700 1 -- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f406f810 msgr2=0x7f36f40ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36ebfff700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36f406f810 0x7f36f40ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36ebfff700 1 -- 172.21.15.71:0/3385936565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40094a0 con 0x7f36f40cbb20 2023-07-06T01:10:47.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36ebfff700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f40cbb20 0x7f36f40b0e60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00c500 tx=0x7f36dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc005d70 con 0x7f36f40cbb20 2023-07-06T01:10:47.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc0070d0 con 0x7f36f40cbb20 2023-07-06T01:10:47.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f40c6cc0 con 0x7f36f40cbb20 2023-07-06T01:10:47.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc007440 con 0x7f36f40cbb20 2023-07-06T01:10:47.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.022+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f40c7280 con 0x7f36f40cbb20 2023-07-06T01:10:47.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.023+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36f4158ec0 con 0x7f36f40cbb20 2023-07-06T01:10:47.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.024+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36dc0075a0 con 0x7f36f40cbb20 2023-07-06T01:10:47.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.025+0000 7f36eb7fe700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f36d406ace0 0x7f36d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.025+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f36dc088510 con 0x7f36f40cbb20 2023-07-06T01:10:47.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.025+0000 7f36eb7fe700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7f36d4071150 0x7f36d4073560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.025+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 --> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36d4073c30 con 0x7f36d4071150 2023-07-06T01:10:47.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.025+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36dc08aaf0 con 0x7f36f40cbb20 2023-07-06T01:10:47.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.026+0000 7f36f2ffd700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f36d406ace0 0x7f36d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.026+0000 7f36f37fe700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7f36d4071150 0x7f36d4073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.026+0000 7f36f2ffd700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f36d406ace0 0x7f36d406d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36e40090b0 tx=0x7f36e401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.026+0000 7f36f37fe700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7f36d4071150 0x7f36d4073560 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.027+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== osd.7 v2:172.21.15.194:6820/1393064559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f36d4073c30 con 0x7f36d4071150 2023-07-06T01:10:47.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.042+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 --> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f36f40cafe0 con 0x7f36d4071150 2023-07-06T01:10:47.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36eb7fe700 1 -- 172.21.15.71:0/3385936565 <== osd.7 v2:172.21.15.194:6820/1393064559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f36ec009b90 con 0x7f36d4071150 2023-07-06T01:10:47.046 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-07-06T01:10:47.046 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-06T01:10:47.046 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-07-06T01:10:47.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7f36d4071150 msgr2=0x7f36d4073560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6820/1393064559,v1:172.21.15.194:6822/1393064559] conn(0x7f36d4071150 0x7f36d4073560 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f36d406ace0 msgr2=0x7f36d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f36d406ace0 0x7f36d406d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f36e40090b0 tx=0x7f36e401c040 comp rx=0 tx=0).stop 2023-07-06T01:10:47.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f40cbb20 msgr2=0x7f36f40b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 --2- 172.21.15.71:0/3385936565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36f40cbb20 0x7f36f40b0e60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00c500 tx=0x7f36dc00c810 comp rx=0 tx=0).stop 2023-07-06T01:10:47.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f37fe700 1 -- 172.21.15.71:0/3385936565 reap_dead start 2023-07-06T01:10:47.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 shutdown_connections 2023-07-06T01:10:47.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.043+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 >> 172.21.15.71:0/3385936565 conn(0x7f36f4069f60 msgr2=0x7f36f4073060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:47.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.044+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 shutdown_connections 2023-07-06T01:10:47.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.044+0000 7f36f97ff700 1 -- 172.21.15.71:0/3385936565 wait complete. 2023-07-06T01:10:47.062 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-06T01:10:47.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 Processor -- start 2023-07-06T01:10:47.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 -- start start 2023-07-06T01:10:47.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc27815dc80 0x7fc278160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2780d1250 0x7fc278160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27806cb60 con 0x7fc27815d8b0 2023-07-06T01:10:47.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2781613a0 con 0x7fc27815dc80 2023-07-06T01:10:47.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.256+0000 7fc27d3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27806c230 con 0x7fc2780d1250 2023-07-06T01:10:47.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2767fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc27815dc80 0x7fc278160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc276ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc27815d8b0 0x7fc2780d0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:47576/0 (socket says 172.21.15.71:47576) 2023-07-06T01:10:47.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc276ffd700 1 -- 172.21.15.71:0/3080647146 learned_addr learned my addr 172.21.15.71:0/3080647146 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:10:47.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2777fe700 1 --2- 172.21.15.71:0/3080647146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2780d1250 0x7fc278160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc275ffb700 1 -- 172.21.15.71:0/3080647146 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532486346 0 0) 0x7fc27806cb60 con 0x7fc27815d8b0 2023-07-06T01:10:47.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2767fc700 1 -- 172.21.15.71:0/3080647146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2780d1250 msgr2=0x7fc278160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:47.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2767fc700 1 --2- 172.21.15.71:0/3080647146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2780d1250 0x7fc278160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2767fc700 1 -- 172.21.15.71:0/3080647146 >> v1:172.21.15.71:6789/0 conn(0x7fc27815d8b0 legacy=0x7fc2780d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2767fc700 1 -- 172.21.15.71:0/3080647146 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27806c510 con 0x7fc27815dc80 2023-07-06T01:10:47.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.257+0000 7fc2767fc700 1 --2- 172.21.15.71:0/3080647146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27815dc80 0x7fc278160640 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009870 tx=0x7fc26c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818af1250b91f41e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc275ffb700 1 -- 172.21.15.71:0/3080647146 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c011830 con 0x7fc27815dc80 2023-07-06T01:10:47.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc275ffb700 1 -- 172.21.15.71:0/3080647146 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c011990 con 0x7fc27815dc80 2023-07-06T01:10:47.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc275ffb700 1 -- 172.21.15.71:0/3080647146 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c011d20 con 0x7fc27815dc80 2023-07-06T01:10:47.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 -- 172.21.15.71:0/3080647146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27815dc80 msgr2=0x7fc278160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/3080647146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27815dc80 0x7fc278160640 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009870 tx=0x7fc26c009b80 comp rx=0 tx=0).stop 2023-07-06T01:10:47.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 -- 172.21.15.71:0/3080647146 shutdown_connections 2023-07-06T01:10:47.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/3080647146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2780d1250 0x7fc278160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/3080647146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27815dc80 0x7fc278160640 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 -- 172.21.15.71:0/3080647146 >> 172.21.15.71:0/3080647146 conn(0x7fc27806db20 msgr2=0x7fc27806df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:47.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 -- 172.21.15.71:0/3080647146 shutdown_connections 2023-07-06T01:10:47.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.258+0000 7fc27d3ff700 1 -- 172.21.15.71:0/3080647146 wait complete. 2023-07-06T01:10:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.260+0000 7fc27d3ff700 1 Processor -- start 2023-07-06T01:10:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.260+0000 7fc27d3ff700 1 -- start start 2023-07-06T01:10:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc27d3ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2780d1250 0x7fc278153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc27d3ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc27815d8b0 0x7fc2781e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc27d3ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 0x7fc2781f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc27d3ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2781e7740 con 0x7fc2780af1f0 2023-07-06T01:10:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc27d3ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780ae150 con 0x7fc2780d1250 2023-07-06T01:10:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc27d3ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780ae430 con 0x7fc27815d8b0 2023-07-06T01:10:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc2777fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 0x7fc2781f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc2777fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 0x7fc2781f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57254/0 (socket says 172.21.15.71:57254) 2023-07-06T01:10:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc2777fe700 1 -- 172.21.15.71:0/2647534691 learned_addr learned my addr 172.21.15.71:0/2647534691 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc276ffd700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2780d1250 0x7fc278153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.261+0000 7fc2767fc700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc27815d8b0 0x7fc2781e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc2777fe700 1 -- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc27815d8b0 msgr2=0x7fc2781e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc2777fe700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc27815d8b0 0x7fc2781e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc2777fe700 1 -- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2780d1250 msgr2=0x7fc278153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc2777fe700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2780d1250 0x7fc278153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc2777fe700 1 -- 172.21.15.71:0/2647534691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c0094a0 con 0x7fc2780af1f0 2023-07-06T01:10:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc2777fe700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 0x7fc2781f2600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc270007de0 tx=0x7fc27000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27000ed30 con 0x7fc2780af1f0 2023-07-06T01:10:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc270014420 con 0x7fc2780af1f0 2023-07-06T01:10:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2780ae710 con 0x7fc2780af1f0 2023-07-06T01:10:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2700147d0 con 0x7fc2780af1f0 2023-07-06T01:10:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.262+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2780aecd0 con 0x7fc2780af1f0 2023-07-06T01:10:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.263+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27806cfd0 con 0x7fc2780af1f0 2023-07-06T01:10:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.264+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc270014930 con 0x7fc2780af1f0 2023-07-06T01:10:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.265+0000 7fc25f7fe700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc26406ace0 0x7fc26406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.265+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc270089970 con 0x7fc2780af1f0 2023-07-06T01:10:47.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.265+0000 7fc276ffd700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc26406ace0 0x7fc26406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.266+0000 7fc276ffd700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc26406ace0 0x7fc26406d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc268007fd0 tx=0x7fc268007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.269+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc27806cfd0 con 0x7fc2780af1f0 2023-07-06T01:10:47.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.462+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2781610c0 con 0x7fc26406ace0 2023-07-06T01:10:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.463+0000 7fc25f7fe700 1 -- 172.21.15.71:0/2647534691 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc268001370 con 0x7fc26406ace0 2023-07-06T01:10:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc26406ace0 msgr2=0x7fc26406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc26406ace0 0x7fc26406d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc268007fd0 tx=0x7fc268007de0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 msgr2=0x7fc2781f2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 0x7fc2781f2600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc270007de0 tx=0x7fc27000e3c0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 shutdown_connections 2023-07-06T01:10:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fc26406ace0 0x7fc26406d190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2780af1f0 0x7fc2781f2600 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2780d1250 0x7fc278153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 --2- 172.21.15.71:0/2647534691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc27815d8b0 0x7fc2781e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 >> 172.21.15.71:0/2647534691 conn(0x7fc27806db20 msgr2=0x7fc2780b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 shutdown_connections 2023-07-06T01:10:47.471 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.466+0000 7fc27d3ff700 1 -- 172.21.15.71:0/2647534691 wait complete. 2023-07-06T01:10:47.472 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 7 to deep-scrub 2023-07-06T01:10:47.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:10:47.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.677+0000 7f22185ff700 1 Processor -- start 2023-07-06T01:10:47.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.677+0000 7f22185ff700 1 -- start start 2023-07-06T01:10:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.678+0000 7f22185ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f221015fca0 0x7f22100d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.678+0000 7f22185ff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22100b5c90 0x7f22100d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.678+0000 7f22185ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22100cf780 con 0x7f22100b6100 2023-07-06T01:10:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.678+0000 7f22185ff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22100cd490 con 0x7f22100b5c90 2023-07-06T01:10:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.678+0000 7f22185ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22100cd770 con 0x7f221015fca0 2023-07-06T01:10:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22100b5c90 0x7f22100d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f22100b5c90 0x7f22100d2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57256/0 (socket says 172.21.15.71:57256) 2023-07-06T01:10:47.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 -- 172.21.15.71:0/1392678634 learned_addr learned my addr 172.21.15.71:0/1392678634 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:47.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f221639b700 1 --2- 172.21.15.71:0/1392678634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f221015fca0 0x7f22100d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 -- 172.21.15.71:0/1392678634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f221015fca0 msgr2=0x7f22100d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:10:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 --2- 172.21.15.71:0/1392678634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f221015fca0 0x7f22100d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 -- 172.21.15.71:0/1392678634 >> v1:172.21.15.194:6789/0 conn(0x7f22100b6100 legacy=0x7f22100cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 -- 172.21.15.71:0/1392678634 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100cda50 con 0x7f22100b5c90 2023-07-06T01:10:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215b9a700 1 --2- 172.21.15.71:0/1392678634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22100b5c90 0x7f22100d2d40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f22000098f0 tx=0x7f2200009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89c1c1c9f867679 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215399700 1 -- 172.21.15.71:0/1392678634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000b8a0 con 0x7f22100b5c90 2023-07-06T01:10:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.679+0000 7f2215399700 1 -- 172.21.15.71:0/1392678634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220000ba00 con 0x7f22100b5c90 2023-07-06T01:10:47.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f2215399700 1 -- 172.21.15.71:0/1392678634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000bd90 con 0x7f22100b5c90 2023-07-06T01:10:47.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 -- 172.21.15.71:0/1392678634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22100b5c90 msgr2=0x7f22100d2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 --2- 172.21.15.71:0/1392678634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22100b5c90 0x7f22100d2d40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f22000098f0 tx=0x7f2200009c00 comp rx=0 tx=0).stop 2023-07-06T01:10:47.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 -- 172.21.15.71:0/1392678634 shutdown_connections 2023-07-06T01:10:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 --2- 172.21.15.71:0/1392678634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f221015fca0 0x7f22100d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 --2- 172.21.15.71:0/1392678634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f22100b5c90 0x7f22100d2d40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 -- 172.21.15.71:0/1392678634 >> 172.21.15.71:0/1392678634 conn(0x7f221006c150 msgr2=0x7f221006c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 -- 172.21.15.71:0/1392678634 shutdown_connections 2023-07-06T01:10:47.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.680+0000 7f22185ff700 1 -- 172.21.15.71:0/1392678634 wait complete. 2023-07-06T01:10:47.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.682+0000 7f22185ff700 1 Processor -- start 2023-07-06T01:10:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.682+0000 7f22185ff700 1 -- start start 2023-07-06T01:10:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f22185ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22100b5c90 0x7f221015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f22185ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100b6100 0x7f221014c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f22185ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 0x7f22101f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f22185ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221015bf00 con 0x7f221015fca0 2023-07-06T01:10:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f22185ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22100cae00 con 0x7f22100b6100 2023-07-06T01:10:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f22185ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221015c0f0 con 0x7f22100b5c90 2023-07-06T01:10:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f2216b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 0x7f22101f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f2216b9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 0x7f22101f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57264/0 (socket says 172.21.15.71:57264) 2023-07-06T01:10:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f2216b9c700 1 -- 172.21.15.71:0/2581497469 learned_addr learned my addr 172.21.15.71:0/2581497469 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:10:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f221639b700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22100b5c90 0x7f221015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.683+0000 7f2215b9a700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100b6100 0x7f221014c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2216b9c700 1 -- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22100b5c90 msgr2=0x7f221015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2216b9c700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22100b5c90 0x7f221015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2216b9c700 1 -- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100b6100 msgr2=0x7f221014c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2216b9c700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100b6100 0x7f221014c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2216b9c700 1 -- 172.21.15.71:0/2581497469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009550 con 0x7f221015fca0 2023-07-06T01:10:47.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2216b9c700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 0x7f22101f2400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f220800cbc0 tx=0x7f220800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208003c00 con 0x7f221015fca0 2023-07-06T01:10:47.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208003d60 con 0x7f221015fca0 2023-07-06T01:10:47.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221015c3d0 con 0x7f221015fca0 2023-07-06T01:10:47.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800aae0 con 0x7f221015fca0 2023-07-06T01:10:47.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.684+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22100cb300 con 0x7f221015fca0 2023-07-06T01:10:47.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.685+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22100008d0 con 0x7f221015fca0 2023-07-06T01:10:47.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.686+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f220800ac40 con 0x7f221015fca0 2023-07-06T01:10:47.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.688+0000 7f2206ffd700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f21f406ace0 0x7f21f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:10:47.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.688+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f22080890b0 con 0x7f221015fca0 2023-07-06T01:10:47.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.688+0000 7f221639b700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f21f406ace0 0x7f21f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:10:47.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.689+0000 7f221639b700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f21f406ace0 0x7f21f406d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f220c006b20 tx=0x7f220c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:10:47.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.692+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2208054470 con 0x7f221015fca0 2023-07-06T01:10:47.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.880+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f221006ae40 con 0x7f21f406ace0 2023-07-06T01:10:47.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.884+0000 7f2206ffd700 1 -- 172.21.15.71:0/2581497469 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72727 (secure 0 0 0) 0x7f220c0076b0 con 0x7f21f406ace0 2023-07-06T01:10:47.887 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:10:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f21f406ace0 msgr2=0x7f21f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f21f406ace0 0x7f21f406d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f220c006b20 tx=0x7f220c008040 comp rx=0 tx=0).stop 2023-07-06T01:10:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 msgr2=0x7f22101f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:10:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 0x7f22101f2400 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f220800cbc0 tx=0x7f220800ced0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 shutdown_connections 2023-07-06T01:10:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f21f406ace0 0x7f21f406d190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f221015fca0 0x7f22101f2400 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22100b5c90 0x7f221015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 --2- 172.21.15.71:0/2581497469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22100b6100 0x7f221014c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:10:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 >> 172.21.15.71:0/2581497469 conn(0x7f221006c150 msgr2=0x7f22100d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:10:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.886+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 shutdown_connections 2023-07-06T01:10:47.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:10:47.887+0000 7f22185ff700 1 -- 172.21.15.71:0/2581497469 wait complete. 2023-07-06T01:10:47.892 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:10:47.908 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2023-07-06T01:10:46.859453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220520,"kb_used_data":4904,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754200,"statfs":{"total":773094113280,"available":772868300800,"internally_reserved":0,"allocated":5021696,"data_stored":2790408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002373"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:37.667675+0000","last_change":"2023-07-06T01:08:45.183928+0000","last_active":"2023-07-06T01:10:37.667675+0000","last_peered":"2023-07-06T01:10:37.667675+0000","last_clean":"2023-07-06T01:10:37.667675+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:37.667675+0000","last_undegraded":"2023-07-06T01:10:37.667675+0000","last_fullsized":"2023-07-06T01:10:37.667675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:37.671481+0000","last_change":"2023-07-06T01:08:45.184149+0000","last_active":"2023-07-06T01:10:37.671481+0000","last_peered":"2023-07-06T01:10:37.671481+0000","last_clean":"2023-07-06T01:10:37.671481+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:37.671481+0000","last_undegraded":"2023-07-06T01:10:37.671481+0000","last_fullsized":"2023-07-06T01:10:37.671481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:04:37.955087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:44.499755+0000","last_change":"2023-07-06T01:10:44.499799+0000","last_active":"2023-07-06T01:10:44.499755+0000","last_peered":"2023-07-06T01:10:44.499755+0000","last_clean":"2023-07-06T01:10:44.499755+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:44.499755+0000","last_undegraded":"2023-07-06T01:10:44.499755+0000","last_fullsized":"2023-07-06T01:10:44.499755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:44.499681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:44.499681+0000","last_clean_scrub_stamp":"2023-07-06T01:10:44.499681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:32:55.353688+0000","scrub_duration":0.001370036,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:37.671313+0000","last_change":"2023-07-06T01:08:45.184944+0000","last_active":"2023-07-06T01:10:37.671313+0000","last_peered":"2023-07-06T01:10:37.671313+0000","last_clean":"2023-07-06T01:10:37.671313+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:37.671313+0000","last_undegraded":"2023-07-06T01:10:37.671313+0000","last_fullsized":"2023-07-06T01:10:37.671313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T03:17:41.186828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:36.973220+0000","last_change":"2023-07-06T01:08:38.148714+0000","last_active":"2023-07-06T01:10:36.973220+0000","last_peered":"2023-07-06T01:10:36.973220+0000","last_clean":"2023-07-06T01:10:36.973220+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:36.973220+0000","last_undegraded":"2023-07-06T01:10:36.973220+0000","last_fullsized":"2023-07-06T01:10:36.973220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:37.116456+0000","last_clean_scrub_stamp":"2023-07-06T01:08:37.116456+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T10:48:32.694446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:36.973221+0000","last_change":"2023-07-06T01:08:45.184461+0000","last_active":"2023-07-06T01:10:36.973221+0000","last_peered":"2023-07-06T01:10:36.973221+0000","last_clean":"2023-07-06T01:10:36.973221+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:10:36.973221+0000","last_undegraded":"2023-07-06T01:10:36.973221+0000","last_fullsized":"2023-07-06T01:10:36.973221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T08:15:13.194432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:36.973123+0000","last_change":"2023-07-06T01:08:45.184043+0000","last_active":"2023-07-06T01:10:36.973123+0000","last_peered":"2023-07-06T01:10:36.973123+0000","last_clean":"2023-07-06T01:10:36.973123+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:10:36.973123+0000","last_undegraded":"2023-07-06T01:10:36.973123+0000","last_fullsized":"2023-07-06T01:10:36.973123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:02:35.943434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:37.670088+0000","last_change":"2023-07-06T01:08:45.184166+0000","last_active":"2023-07-06T01:10:37.670088+0000","last_peered":"2023-07-06T01:10:37.670088+0000","last_clean":"2023-07-06T01:10:37.670088+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:37.670088+0000","last_undegraded":"2023-07-06T01:10:37.670088+0000","last_fullsized":"2023-07-06T01:10:37.670088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:37.331122+0000","last_change":"2023-07-06T01:08:45.183988+0000","last_active":"2023-07-06T01:10:37.331122+0000","last_peered":"2023-07-06T01:10:37.331122+0000","last_clean":"2023-07-06T01:10:37.331122+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:37.331122+0000","last_undegraded":"2023-07-06T01:10:37.331122+0000","last_fullsized":"2023-07-06T01:10:37.331122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:08:44.160655+0000","last_clean_scrub_stamp":"2023-07-06T01:08:44.160655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T01:22:41.442535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":791577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.86199999999999999,"15min":0.89800000000000002},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.90400000000000003,"15min":0.93799999999999994},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88100000000000001,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.149,"15min":1.149},"last":0.623},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.82799999999999996,"5min":1.083,"15min":1.083},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":1.198,"15min":1.198},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94499999999999995,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.874,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94399999999999995,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.872},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.51800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98899999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.622,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96099999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.95699999999999996}]},{"osd":6,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51300000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.63700000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.02,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.89200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.91100000000000003,"15min":0.95699999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85599999999999998,"5min":7.54,"15min":7.54},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94899999999999995,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.052,"15min":1.125},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84699999999999998,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":1.1080000000000001,"15min":1.179},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89500000000000002,"5min":10.696,"15min":10.696},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":1.0620000000000001,"15min":1.1259999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84699999999999998,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.77100000000000002}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94399999999999995,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.1000000000000001,"15min":1.1739999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93200000000000005,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.753}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.47199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.075,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.46800000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0029999999999999,"5min":1.05,"15min":1.05},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.75},"min":{"1min":0.53400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.008,"5min":1.347,"15min":1.347},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97599999999999998,"5min":1.028,"15min":1.028},"last":0.80400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40699999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.36099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59499999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.317,"5min":0.314,"15min":0.314},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56699999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.746},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.91500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":791577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39600000000000002,"15min":0.40300000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.443,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.45300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.622},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56499999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.58699999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.82999999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":2.851,"15min":2.851},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.113,"5min":1.248,"15min":1.248},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.81799999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78800000000000003,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.9960000000000004,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.57199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.629,"15min":1.629},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91300000000000003,"5min":1.026,"15min":1.026},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.70499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55200000000000005,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":1.2969999999999999,"15min":1.4370000000000001},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":22.029,"15min":22.029},"last":0.432}]},{"osd":1,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.56599999999999995,"15min":0.58499999999999996},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":2.77,"15min":2.77},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.321,"15min":1.4630000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65200000000000002,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.56100000000000005,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.60699999999999998,"5min":2.835,"15min":2.835},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.623,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.4850000000000001,"15min":1.6120000000000001},"min":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95099999999999996,"5min":21.965,"15min":21.965},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89900000000000002,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.0509999999999999,"5min":1.228,"15min":1.228},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.508,"15min":1.6399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91800000000000004,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.86199999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.998,"5min":1.226,"15min":1.226},"last":0.67600000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":1.5589999999999999,"15min":1.6910000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98699999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0329999999999999,"5min":1.341,"15min":1.341},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.31900000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46999999999999997,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60799999999999998,"5min":0.749,"15min":0.749},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.437}]},{"osd":2,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.629,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.378}]},{"osd":4,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.607,"15min":1.607},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.036,"5min":1.048,"15min":1.048},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0549999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.746},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.02,"5min":1.345,"15min":1.345},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":1.238,"15min":1.238},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97799999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.02,"5min":3.992,"15min":3.992},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.98799999999999999,"15min":1.0409999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":1.038},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.083,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.99199999999999999,"15min":1.0349999999999999},"min":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0229999999999999,"15min":1.0329999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.2530000000000001,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.135,"15min":1.157},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.3399999999999999,"5min":10.91,"15min":10.91},"last":0.499}]},{"osd":3,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.50900000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89900000000000002,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":1.069,"15min":1.119},"min":{"1min":0.56499999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1419999999999999,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89900000000000002,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.753},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97599999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.99399999999999999,"15min":1.0589999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":1.125,"15min":1.125},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81799999999999995,"5min":1.085,"15min":1.085},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.64800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.395,"15min":1.395},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.77200000000000002,"5min":1.425,"15min":1.425},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89000000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90200000000000002,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.624},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85399999999999998,"5min":0.875,"15min":0.875},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.61699999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.85899999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76600000000000001,"15min":0.75800000000000001},"min":{"1min":0.72399999999999998,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:10:47.913 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.913 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.914 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.914 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-06T01:08:37.116456+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=37, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.914 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.915 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.915 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.915 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-06T01:08:44.160655+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=8, tm_sec=44, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=1, tm_min=10, tm_sec=41, tm_wday=3, tm_yday=187, tm_isdst=0) 2023-07-06T01:10:47.916 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-06T01:11:07.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T01:11:08.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.119+0000 7fe602bff700 1 Processor -- start 2023-07-06T01:11:08.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.119+0000 7fe602bff700 1 -- start start 2023-07-06T01:11:08.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.120+0000 7fe602bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 0x7fe5fc0d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.120+0000 7fe602bff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe5fc0b60e0 0x7fe5fc0d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.120+0000 7fe602bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0cf780 con 0x7fe5fc15fca0 2023-07-06T01:11:08.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.120+0000 7fe602bff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cd490 con 0x7fe5fc0b60e0 2023-07-06T01:11:08.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.120+0000 7fe602bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cd770 con 0x7fe5fc0b5c90 2023-07-06T01:11:08.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe60099b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe5fc15fca0 0x7fe5fc0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33258/0 (socket says 172.21.15.71:33258) 2023-07-06T01:11:08.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe60099b700 1 -- 172.21.15.71:0/3244455786 learned_addr learned my addr 172.21.15.71:0/3244455786 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:11:08.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe60119c700 1 --2- 172.21.15.71:0/3244455786 >> v2:172.21.15.194:3300/0 conn(0x7fe5fc0b60e0 0x7fe5fc0d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fbfff700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 0x7fe5fc0d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298132540 0 0) 0x7fe5fc0cf780 con 0x7fe5fc15fca0 2023-07-06T01:11:08.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec0035b0 con 0x7fe5fc15fca0 2023-07-06T01:11:08.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272799907 0 0) 0x7fe5ec0035b0 con 0x7fe5fc15fca0 2023-07-06T01:11:08.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 msgr2=0x7fe5fc0d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 0x7fe5fc0d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 >> v2:172.21.15.194:3300/0 conn(0x7fe5fc0b60e0 msgr2=0x7fe5fc0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 --2- 172.21.15.71:0/3244455786 >> v2:172.21.15.194:3300/0 conn(0x7fe5fc0b60e0 0x7fe5fc0d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0cda50 con 0x7fe5fc15fca0 2023-07-06T01:11:08.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.121+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7fe5f0001670 con 0x7fe5fc15fca0 2023-07-06T01:11:08.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 >> v1:172.21.15.71:6789/0 conn(0x7fe5fc15fca0 legacy=0x7fe5fc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5ec003a00 0x7fe5ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ec004430 0x7fe5ec0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 0x7fe5ec004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cd490 con 0x7fe5ec004430 2023-07-06T01:11:08.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0cd770 con 0x7fe5ec003a00 2023-07-06T01:11:08.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec00ba10 con 0x7fe5fc0b5c90 2023-07-06T01:11:08.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fbfff700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ec004430 0x7fe5ec0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe60099b700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5ec003a00 0x7fe5ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe60119c700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 0x7fe5ec004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fbfff700 1 -- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 msgr2=0x7fe5ec004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fbfff700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5fc0b5c90 0x7fe5ec004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fbfff700 1 -- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5ec003a00 msgr2=0x7fe5ec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fbfff700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5ec003a00 0x7fe5ec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe5fbfff700 1 -- 172.21.15.71:0/3244455786 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0035b0 con 0x7fe5ec004430 2023-07-06T01:11:08.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.122+0000 7fe60099b700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5ec003a00 0x7fe5ec003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:11:08.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe5fbfff700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ec004430 0x7fe5ec0048f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009b60 tx=0x7fe5ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace0c0037b3c0a08 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800e6c0 con 0x7fe5ec004430 2023-07-06T01:11:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800e820 con 0x7fe5ec004430 2023-07-06T01:11:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe5fb7fe700 1 -- 172.21.15.71:0/3244455786 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800eb90 con 0x7fe5ec004430 2023-07-06T01:11:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe602bff700 1 -- 172.21.15.71:0/3244455786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ec004430 msgr2=0x7fe5ec0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe602bff700 1 --2- 172.21.15.71:0/3244455786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5ec004430 0x7fe5ec0048f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009b60 tx=0x7fe5ec005880 comp rx=0 tx=0).stop 2023-07-06T01:11:08.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe60119c700 1 -- 172.21.15.71:0/3244455786 reap_dead start 2023-07-06T01:11:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe602bff700 1 -- 172.21.15.71:0/3244455786 shutdown_connections 2023-07-06T01:11:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe602bff700 1 -- 172.21.15.71:0/3244455786 >> 172.21.15.71:0/3244455786 conn(0x7fe5fc06c150 msgr2=0x7fe5fc06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:11:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe602bff700 1 -- 172.21.15.71:0/3244455786 shutdown_connections 2023-07-06T01:11:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.123+0000 7fe602bff700 1 -- 172.21.15.71:0/3244455786 wait complete. 2023-07-06T01:11:08.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.125+0000 7fe602bff700 1 Processor -- start 2023-07-06T01:11:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.125+0000 7fe602bff700 1 -- start start 2023-07-06T01:11:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe602bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5ec004430 0x7fe5fc153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe602bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5fc1f5c20 0x7fe5fc0d2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe602bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 0x7fe5fc1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe602bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc1f2cc0 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe602bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0d3540 con 0x7fe5fc1f5c20 2023-07-06T01:11:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe602bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc1f5790 con 0x7fe5ec004430 2023-07-06T01:11:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.126+0000 7fe60119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 0x7fe5fc1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 0x7fe5fc1f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50922/0 (socket says 172.21.15.71:50922) 2023-07-06T01:11:08.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 -- 172.21.15.71:0/2612223231 learned_addr learned my addr 172.21.15.71:0/2612223231 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:11:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 -- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5ec004430 msgr2=0x7fe5fc153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5ec004430 0x7fe5fc153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 -- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5fc1f5c20 msgr2=0x7fe5fc0d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5fc1f5c20 0x7fe5fc0d2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 -- 172.21.15.71:0/2612223231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc1f2700 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe60119c700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 0x7fe5fc1f1af0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4011bf0 tx=0x7fe5f400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400e040 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f400f040 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400fe50 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc1f29e0 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.127+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc1f6090 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.129+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc1f5280 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.129+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5f4022460 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.131+0000 7fe5f97fa700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe5e006ace0 0x7fe5e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.131+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe5f4089740 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.131+0000 7fe60099b700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe5e006ace0 0x7fe5e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.132+0000 7fe60099b700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe5e006ace0 0x7fe5e006d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0cbbe0 tx=0x7fe5f0000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.135+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5fc1f5280 con 0x7fe5fc0d30d0 2023-07-06T01:11:08.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.322+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 --> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5fc06ae40 con 0x7fe5e006ace0 2023-07-06T01:11:08.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.326+0000 7fe5f97fa700 1 -- 172.21.15.71:0/2612223231 <== mgr.4102 v2:172.21.15.194:6832/3257045375 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72787 (secure 0 0 0) 0x7fe5f0005e60 con 0x7fe5e006ace0 2023-07-06T01:11:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:11:08.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe5e006ace0 msgr2=0x7fe5e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe5e006ace0 0x7fe5e006d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0cbbe0 tx=0x7fe5f0000ed0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 msgr2=0x7fe5fc1f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 0x7fe5fc1f1af0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4011bf0 tx=0x7fe5f400f1b0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 shutdown_connections 2023-07-06T01:11:08.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7fe5e006ace0 0x7fe5e006d190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc0d30d0 0x7fe5fc1f1af0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe5ec004430 0x7fe5fc153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 --2- 172.21.15.71:0/2612223231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5fc1f5c20 0x7fe5fc0d2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 >> 172.21.15.71:0/2612223231 conn(0x7fe5fc06c150 msgr2=0x7fe5fc0b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:11:08.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.328+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 shutdown_connections 2023-07-06T01:11:08.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.329+0000 7fe602bff700 1 -- 172.21.15.71:0/2612223231 wait complete. 2023-07-06T01:11:08.334 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-07-06T01:11:08.349 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2023-07-06T01:11:06.864256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":220520,"kb_used_data":4904,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754200,"statfs":{"total":773094113280,"available":772868300800,"internally_reserved":0,"allocated":5021696,"data_stored":2790408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003080"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:49.751887+0000","last_change":"2023-07-06T01:10:49.751887+0000","last_active":"2023-07-06T01:10:49.751887+0000","last_peered":"2023-07-06T01:10:49.751887+0000","last_clean":"2023-07-06T01:10:49.751887+0000","last_became_active":"2023-07-06T01:08:45.183579+0000","last_became_peered":"2023-07-06T01:08:45.183579+0000","last_unstale":"2023-07-06T01:10:49.751887+0000","last_undegraded":"2023-07-06T01:10:49.751887+0000","last_fullsized":"2023-07-06T01:10:49.751887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:49.751741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:49.751741+0000","last_clean_scrub_stamp":"2023-07-06T01:10:49.751741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T06:09:31.204914+0000","scrub_duration":0.001702194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:51.330672+0000","last_change":"2023-07-06T01:10:51.330672+0000","last_active":"2023-07-06T01:10:51.330672+0000","last_peered":"2023-07-06T01:10:51.330672+0000","last_clean":"2023-07-06T01:10:51.330672+0000","last_became_active":"2023-07-06T01:08:45.183880+0000","last_became_peered":"2023-07-06T01:08:45.183880+0000","last_unstale":"2023-07-06T01:10:51.330672+0000","last_undegraded":"2023-07-06T01:10:51.330672+0000","last_fullsized":"2023-07-06T01:10:51.330672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:51.330486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:51.330486+0000","last_clean_scrub_stamp":"2023-07-06T01:10:51.330486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T09:50:45.469872+0000","scrub_duration":0.0023167470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:44.499799+0000","last_change":"2023-07-06T01:10:44.499799+0000","last_active":"2023-07-06T01:10:44.499799+0000","last_peered":"2023-07-06T01:10:44.499799+0000","last_clean":"2023-07-06T01:10:44.499799+0000","last_became_active":"2023-07-06T01:08:45.776715+0000","last_became_peered":"2023-07-06T01:08:45.776715+0000","last_unstale":"2023-07-06T01:10:44.499799+0000","last_undegraded":"2023-07-06T01:10:44.499799+0000","last_fullsized":"2023-07-06T01:10:44.499799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:44.499681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:44.499681+0000","last_clean_scrub_stamp":"2023-07-06T01:10:44.499681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:32:55.353688+0000","scrub_duration":0.001370036,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:55.366916+0000","last_change":"2023-07-06T01:10:55.366969+0000","last_active":"2023-07-06T01:10:55.366916+0000","last_peered":"2023-07-06T01:10:55.366916+0000","last_clean":"2023-07-06T01:10:55.366916+0000","last_became_active":"2023-07-06T01:08:45.184644+0000","last_became_peered":"2023-07-06T01:08:45.184644+0000","last_unstale":"2023-07-06T01:10:55.366916+0000","last_undegraded":"2023-07-06T01:10:55.366916+0000","last_fullsized":"2023-07-06T01:10:55.366916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:55.366809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:55.366809+0000","last_clean_scrub_stamp":"2023-07-06T01:10:55.366809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:29:41.278478+0000","scrub_duration":0.002219983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"41'119","reported_seq":221,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:52.368478+0000","last_change":"2023-07-06T01:10:52.368550+0000","last_active":"2023-07-06T01:10:52.368478+0000","last_peered":"2023-07-06T01:10:52.368478+0000","last_clean":"2023-07-06T01:10:52.368478+0000","last_became_active":"2023-07-06T01:08:38.147734+0000","last_became_peered":"2023-07-06T01:08:38.147734+0000","last_unstale":"2023-07-06T01:10:52.368478+0000","last_undegraded":"2023-07-06T01:10:52.368478+0000","last_fullsized":"2023-07-06T01:10:52.368478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2023-07-06T01:10:52.368385+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2023-07-06T01:10:52.368385+0000","last_clean_scrub_stamp":"2023-07-06T01:10:52.368385+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T11:55:30.124033+0000","scrub_duration":0.0088882270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:11:03.266434+0000","last_change":"2023-07-06T01:11:03.266485+0000","last_active":"2023-07-06T01:11:03.266434+0000","last_peered":"2023-07-06T01:11:03.266434+0000","last_clean":"2023-07-06T01:11:03.266434+0000","last_became_active":"2023-07-06T01:08:45.184134+0000","last_became_peered":"2023-07-06T01:08:45.184134+0000","last_unstale":"2023-07-06T01:11:03.266434+0000","last_undegraded":"2023-07-06T01:11:03.266434+0000","last_fullsized":"2023-07-06T01:11:03.266434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:11:03.266334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:11:03.266334+0000","last_clean_scrub_stamp":"2023-07-06T01:11:03.266334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:30:31.867110+0000","scrub_duration":0.0023114479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:11:05.222203+0000","last_change":"2023-07-06T01:11:05.222260+0000","last_active":"2023-07-06T01:11:05.222203+0000","last_peered":"2023-07-06T01:11:05.222203+0000","last_clean":"2023-07-06T01:11:05.222203+0000","last_became_active":"2023-07-06T01:08:45.183720+0000","last_became_peered":"2023-07-06T01:08:45.183720+0000","last_unstale":"2023-07-06T01:11:05.222203+0000","last_undegraded":"2023-07-06T01:11:05.222203+0000","last_fullsized":"2023-07-06T01:11:05.222203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:11:05.222092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:11:05.222092+0000","last_clean_scrub_stamp":"2023-07-06T01:11:05.222092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:27:51.267504+0000","scrub_duration":0.0019696449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:47.745060+0000","last_change":"2023-07-06T01:10:47.745060+0000","last_active":"2023-07-06T01:10:47.745060+0000","last_peered":"2023-07-06T01:10:47.745060+0000","last_clean":"2023-07-06T01:10:47.745060+0000","last_became_active":"2023-07-06T01:08:45.183677+0000","last_became_peered":"2023-07-06T01:08:45.183677+0000","last_unstale":"2023-07-06T01:10:47.745060+0000","last_undegraded":"2023-07-06T01:10:47.745060+0000","last_fullsized":"2023-07-06T01:10:47.745060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:47.744885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:47.744885+0000","last_clean_scrub_stamp":"2023-07-06T01:10:47.744885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T05:12:57.469139+0000","scrub_duration":0.0021026970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T01:10:48.380749+0000","last_change":"2023-07-06T01:10:48.380749+0000","last_active":"2023-07-06T01:10:48.380749+0000","last_peered":"2023-07-06T01:10:48.380749+0000","last_clean":"2023-07-06T01:10:48.380749+0000","last_became_active":"2023-07-06T01:08:45.183684+0000","last_became_peered":"2023-07-06T01:08:45.183684+0000","last_unstale":"2023-07-06T01:10:48.380749+0000","last_undegraded":"2023-07-06T01:10:48.380749+0000","last_fullsized":"2023-07-06T01:10:48.380749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T01:10:48.380591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T01:10:48.380591+0000","last_clean_scrub_stamp":"2023-07-06T01:10:48.380591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T07:56:02.398652+0000","scrub_duration":0.00163777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":791577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.86199999999999999,"15min":0.89800000000000002},"min":{"1min":0.38,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89300000000000002,"5min":5.7329999999999997,"15min":5.7329999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.90400000000000003,"15min":0.93799999999999994},"min":{"1min":0.51700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88100000000000001,"5min":5.6909999999999998,"15min":5.6909999999999998},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.149,"15min":1.149},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.82799999999999996,"5min":1.083,"15min":1.083},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.997,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.745},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.877,"5min":1.198,"15min":1.198},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.94299999999999995,"15min":0.98499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94499999999999995,"5min":5.9290000000000003,"15min":5.9290000000000003},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.874,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94399999999999995,"5min":4.3259999999999996,"15min":4.3259999999999996},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61199999999999999,"15min":0.60199999999999998},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.68899999999999995,"15min":0.68100000000000005},"min":{"1min":0.51800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98899999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.77000000000000002},"min":{"1min":0.622,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96099999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jul 6 01:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.51300000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.78400000000000003,"15min":0.77600000000000002},"min":{"1min":0.63700000000000001,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.02,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.91100000000000003,"15min":0.95699999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85599999999999998,"5min":7.54,"15min":7.54},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94899999999999995,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":1.052,"15min":1.125},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84699999999999998,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":1.1080000000000001,"15min":1.179},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89500000000000002,"5min":10.696,"15min":10.696},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":1.0620000000000001,"15min":1.1259999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":10.534000000000001,"15min":10.534000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.73999999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84699999999999998,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94399999999999995,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.1000000000000001,"15min":1.1739999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93200000000000005,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.755}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.47199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.075,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.46800000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.621}]},{"osd":5,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0029999999999999,"5min":1.05,"15min":1.05},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.75},"min":{"1min":0.53400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.008,"5min":1.347,"15min":1.347},"last":0.876},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.76400000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97599999999999998,"5min":1.028,"15min":1.028},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40699999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.36099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59499999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.443},"min":{"1min":0.317,"5min":0.314,"15min":0.314},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.56699999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.436}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.5,"15min":0.498},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.496}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69499999999999995,"15min":0.70099999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.55100000000000005,"5min":0.5,"15min":0.5},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.628},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69999999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94199999999999995,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.753},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":791577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.39600000000000002,"15min":0.40300000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.443,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68899999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.45300000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.56799999999999995,"5min":0.622,"15min":0.622},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.34899999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.56499999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.504,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.58699999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":0.82999999999999996},"min":{"1min":0.51400000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":2.851,"15min":2.851},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.113,"5min":1.248,"15min":1.248},"last":1.167}]},{"osd":5,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.81799999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":1.139}]},{"osd":6,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.78800000000000003,"15min":0.75700000000000001},"min":{"1min":0.53400000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":4.9960000000000004,"5min":4.9960000000000004,"15min":4.9960000000000004},"last":1.022},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.748},"min":{"1min":0.57199999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97299999999999998,"5min":1.629,"15min":1.629},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.755,"15min":0.755},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91300000000000003,"5min":1.026,"15min":1.026},"last":1.381},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77600000000000002,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":1.095}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.69299999999999995,"15min":0.74299999999999999},"min":{"1min":0.28899999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55200000000000005,"5min":5.0810000000000004,"15min":5.0810000000000004},"last":0.505},{"interface":"front","average":{"1min":0.45600000000000002,"5min":1.2969999999999999,"15min":1.4370000000000001},"min":{"1min":0.32500000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":22.029,"15min":22.029},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.56599999999999995,"15min":0.58499999999999996},"min":{"1min":0.33200000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":2.77,"15min":2.77},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":1.321,"15min":1.4630000000000001},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65200000000000002,"5min":22.059000000000001,"15min":22.059000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.56100000000000005,"15min":0.57799999999999996},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.60699999999999998,"5min":2.835,"15min":2.835},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.623,"5min":2.7970000000000002,"15min":2.7970000000000002},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":1.4850000000000001,"15min":1.6120000000000001},"min":{"1min":0.55000000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.95099999999999996,"5min":21.965,"15min":21.965},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89900000000000002,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.76700000000000002},"min":{"1min":0.52300000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.0509999999999999,"5min":1.228,"15min":1.228},"last":0.753},{"interface":"front","average":{"1min":0.71699999999999997,"5min":1.508,"15min":1.6399999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91800000000000004,"5min":21.917000000000002,"15min":21.917000000000002},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.86199999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.59599999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.998,"5min":1.226,"15min":1.226},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":1.5589999999999999,"15min":1.6910000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98699999999999999,"5min":21.998999999999999,"15min":21.998999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.82799999999999996,"15min":0.84099999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0329999999999999,"5min":1.341,"15min":1.341},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44800000000000001,"15min":0.45400000000000001},"min":{"1min":0.31900000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46999999999999997,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60799999999999998,"5min":0.749,"15min":0.749},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51400000000000001,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68600000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.629,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65000000000000002,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95499999999999996,"5min":1.607,"15min":1.607},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.76200000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.036,"5min":1.048,"15min":1.048},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.79300000000000004,"15min":0.80300000000000005},"min":{"1min":0.56000000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0549999999999999,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79300000000000004,"15min":0.79800000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.02,"5min":1.345,"15min":1.345},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jul 6 01:10:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":1.238,"15min":1.238},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81899999999999995,"15min":0.82899999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97799999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.72299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.82099999999999995,"15min":0.84099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.02,"5min":3.992,"15min":3.992},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.98799999999999999,"15min":1.0409999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":9.1739999999999995,"15min":9.1739999999999995},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":1.038},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.083,"5min":9.0370000000000008,"15min":9.0370000000000008},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.99199999999999999,"15min":1.0349999999999999},"min":{"1min":0.45700000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96199999999999997,"5min":9.0129999999999999,"15min":9.0129999999999999},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0229999999999999,"15min":1.0329999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.2530000000000001,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.135,"15min":1.157},"min":{"1min":0.499,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.3399999999999999,"5min":10.91,"15min":10.91},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.50900000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89900000000000002,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":1.069,"15min":1.119},"min":{"1min":0.56499999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1419999999999999,"5min":9.3510000000000009,"15min":9.3510000000000009},"last":0.624}]},{"osd":5,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.46100000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89900000000000002,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91800000000000004,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.76700000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jul 6 01:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83499999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97599999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":201209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.99399999999999999,"15min":1.0589999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":10.172000000000001,"15min":10.172000000000001},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.53500000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":1.125,"15min":1.125},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71199999999999997,"15min":0.72199999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81799999999999995,"5min":1.085,"15min":1.085},"last":0.79900000000000004}]},{"osd":2,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.64800000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.395,"15min":1.395},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.77200000000000002,"5min":1.425,"15min":1.425},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70399999999999996,"15min":0.71299999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.89000000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.80700000000000005,"15min":0.81799999999999995},"min":{"1min":0.57999999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.90200000000000002,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.878}]},{"osd":4,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65100000000000002},"min":{"1min":0.52600000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.85399999999999998,"5min":0.875,"15min":0.875},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.61699999999999999,"5min":0.495,"15min":0.495},"max":{"1min":0.85899999999999999,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jul 6 01:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69899999999999995,"15min":0.69599999999999995},"min":{"1min":0.53900000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.621},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.76600000000000001,"15min":0.75800000000000001},"min":{"1min":0.72399999999999998,"5min":0.497,"15min":0.497},"max":{"1min":0.93799999999999994,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T01:11:08.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-06T01:11:08.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.538+0000 7f38d8bff700 1 Processor -- start 2023-07-06T01:11:08.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.538+0000 7f38d8bff700 1 -- start start 2023-07-06T01:11:08.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d8bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d415fca0 0x7f38d40d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d8bff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40cf780 con 0x7f38d40b5c90 2023-07-06T01:11:08.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d8bff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40cd490 con 0x7f38d40b6100 2023-07-06T01:11:08.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d8bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cd770 con 0x7f38d415fca0 2023-07-06T01:11:08.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38cbfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f38d40b5c90 0x7f38d40d2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33260/0 (socket says 172.21.15.71:33260) 2023-07-06T01:11:08.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38cbfff700 1 -- 172.21.15.71:0/3182292659 learned_addr learned my addr 172.21.15.71:0/3182292659 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:11:08.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d259c700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d415fca0 0x7f38d40d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374600332 0 0) 0x7f38d40cf780 con 0x7f38d40b5c90 2023-07-06T01:11:08.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.540+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c00035b0 con 0x7f38d40b5c90 2023-07-06T01:11:08.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530832971 0 0) 0x7f38d40cd490 con 0x7f38d40b6100 2023-07-06T01:11:08.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d40cf780 con 0x7f38d40b6100 2023-07-06T01:11:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858325683 0 0) 0x7f38c00035b0 con 0x7f38d40b5c90 2023-07-06T01:11:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d415fca0 msgr2=0x7f38d40d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d415fca0 0x7f38d40d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 >> v1:172.21.15.194:6789/0 conn(0x7f38d40b6100 legacy=0x7f38d40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40cda50 con 0x7f38d40b5c90 2023-07-06T01:11:08.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f38bc001670 con 0x7f38d40b5c90 2023-07-06T01:11:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 >> v1:172.21.15.71:6789/0 conn(0x7f38d40b5c90 legacy=0x7f38d40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0003bc0 0x7f38c0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0004850 0x7f38c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c0005200 0x7f38c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cd770 con 0x7f38c0004850 2023-07-06T01:11:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000c030 con 0x7f38c0005200 2023-07-06T01:11:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000c1f0 con 0x7f38c0003bc0 2023-07-06T01:11:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d259c700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d415fca0 0x7f38d40d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T01:11:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38cbfff700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0004850 0x7f38c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d2d9d700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c0005200 0x7f38c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d259c700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0003bc0 0x7f38c0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38cbfff700 1 -- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0003bc0 msgr2=0x7f38c0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38cbfff700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0003bc0 0x7f38c0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38cbfff700 1 -- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c0005200 msgr2=0x7f38c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38cbfff700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c0005200 0x7f38c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38cbfff700 1 -- 172.21.15.71:0/3182292659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00035b0 con 0x7f38c0004850 2023-07-06T01:11:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.541+0000 7f38d2d9d700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38c0005200 0x7f38c000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T01:11:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38cbfff700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0004850 0x7f38c0004cc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00c160 tx=0x7f38c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53ea28431483307 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00cca0 con 0x7f38c0004850 2023-07-06T01:11:08.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00ce20 con 0x7f38c0004850 2023-07-06T01:11:08.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d1d9b700 1 -- 172.21.15.71:0/3182292659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc005ba0 con 0x7f38c0004850 2023-07-06T01:11:08.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d8bff700 1 -- 172.21.15.71:0/3182292659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0004850 msgr2=0x7f38c0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d8bff700 1 --2- 172.21.15.71:0/3182292659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38c0004850 0x7f38c0004cc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00c160 tx=0x7f38c0005880 comp rx=0 tx=0).stop 2023-07-06T01:11:08.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d2d9d700 1 -- 172.21.15.71:0/3182292659 reap_dead start 2023-07-06T01:11:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d8bff700 1 -- 172.21.15.71:0/3182292659 shutdown_connections 2023-07-06T01:11:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.542+0000 7f38d8bff700 1 -- 172.21.15.71:0/3182292659 >> 172.21.15.71:0/3182292659 conn(0x7f38d406c150 msgr2=0x7f38d406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:11:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.543+0000 7f38d8bff700 1 -- 172.21.15.71:0/3182292659 shutdown_connections 2023-07-06T01:11:08.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.543+0000 7f38d8bff700 1 -- 172.21.15.71:0/3182292659 wait complete. 2023-07-06T01:11:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.544+0000 7f38d8bff700 1 Processor -- start 2023-07-06T01:11:08.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.544+0000 7f38d8bff700 1 -- start start 2023-07-06T01:11:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.545+0000 7f38d8bff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0004850 0x7f38d4157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.545+0000 7f38d8bff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 0x7f38d415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.545+0000 7f38d8bff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d40cb4e0 0x7f38d40cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.545+0000 7f38d8bff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40d3410 con 0x7f38d415a2e0 2023-07-06T01:11:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.545+0000 7f38d8bff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415ac90 con 0x7f38d40cb4e0 2023-07-06T01:11:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.545+0000 7f38d8bff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cbea0 con 0x7f38c0004850 2023-07-06T01:11:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 0x7f38d415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 0x7f38d415a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50946/0 (socket says 172.21.15.71:50946) 2023-07-06T01:11:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 -- 172.21.15.71:0/1360101799 learned_addr learned my addr 172.21.15.71:0/1360101799 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:11:08.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38d2d9d700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d40cb4e0 0x7f38d40cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38d259c700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0004850 0x7f38d4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 -- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0004850 msgr2=0x7f38d4157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0004850 0x7f38d4157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 -- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d40cb4e0 msgr2=0x7f38d40cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d40cb4e0 0x7f38d40cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 -- 172.21.15.71:0/1360101799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40cc130 con 0x7f38d415a2e0 2023-07-06T01:11:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38d2d9d700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d40cb4e0 0x7f38d40cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:11:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38d259c700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0004850 0x7f38d4157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:11:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38cbfff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 0x7f38d415a750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00c750 tx=0x7f38bc001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc000ed0 con 0x7f38d415a2e0 2023-07-06T01:11:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc0070d0 con 0x7f38d415a2e0 2023-07-06T01:11:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.546+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d40cc410 con 0x7f38d415a2e0 2023-07-06T01:11:08.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.547+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc007480 con 0x7f38d415a2e0 2023-07-06T01:11:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.547+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d40cc9d0 con 0x7f38d415a2e0 2023-07-06T01:11:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.548+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d40008d0 con 0x7f38d415a2e0 2023-07-06T01:11:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.549+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38bc019030 con 0x7f38d415a2e0 2023-07-06T01:11:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.550+0000 7f38caffd700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38b406ace0 0x7f38b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.550+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f38bc08a3c0 con 0x7f38d415a2e0 2023-07-06T01:11:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.550+0000 7f38d259c700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38b406ace0 0x7f38b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.551+0000 7f38d259c700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38b406ace0 0x7f38b406d190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f38d41f51f0 tx=0x7f38c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.555+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f38bc055780 con 0x7f38d415a2e0 2023-07-06T01:11:08.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.750+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f38d40738f0 con 0x7f38d415a2e0 2023-07-06T01:11:08.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.753+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f38bc055780 con 0x7f38d415a2e0 2023-07-06T01:11:08.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.754+0000 7f38caffd700 1 -- 172.21.15.71:0/1360101799 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f38bc058da0 con 0x7f38d415a2e0 2023-07-06T01:11:08.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.756+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38b406ace0 msgr2=0x7f38b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.756+0000 7f38d8bff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38b406ace0 0x7f38b406d190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f38d41f51f0 tx=0x7f38c4008040 comp rx=0 tx=0).stop 2023-07-06T01:11:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 msgr2=0x7f38d415a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 0x7f38d415a750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f38bc00c750 tx=0x7f38bc001930 comp rx=0 tx=0).stop 2023-07-06T01:11:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 shutdown_connections 2023-07-06T01:11:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f38b406ace0 0x7f38b406d190 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d40cb4e0 0x7f38d40cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38c0004850 0x7f38d4157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 --2- 172.21.15.71:0/1360101799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f38d415a2e0 0x7f38d415a750 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 >> 172.21.15.71:0/1360101799 conn(0x7f38d406c150 msgr2=0x7f38d40b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:11:08.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 shutdown_connections 2023-07-06T01:11:08.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.757+0000 7f38d8bff700 1 -- 172.21.15.71:0/1360101799 wait complete. 2023-07-06T01:11:08.777 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T01:11:08.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T01:11:08.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.968+0000 7f16355ff700 1 Processor -- start 2023-07-06T01:11:08.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.969+0000 7f16355ff700 1 -- start start 2023-07-06T01:11:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f16355ff700 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16300cf2b0 0x7f16300d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f16355ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16300cf6d0 con 0x7f163006a670 2023-07-06T01:11:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f16355ff700 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16300cf920 con 0x7f163015c790 2023-07-06T01:11:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f16355ff700 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16300ca500 con 0x7f16300cf2b0 2023-07-06T01:11:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f162e7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f163006a670 0x7f16300cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33268/0 (socket says 172.21.15.71:33268) 2023-07-06T01:11:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f162e7fc700 1 -- 172.21.15.71:0/66618604 learned_addr learned my addr 172.21.15.71:0/66618604 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-07-06T01:11:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f162f7fe700 1 --2- 172.21.15.71:0/66618604 >> v2:172.21.15.194:3300/0 conn(0x7f16300cf2b0 0x7f16300d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.970+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225613382 0 0) 0x7f16300cf6d0 con 0x7f163006a670 2023-07-06T01:11:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16180035b0 con 0x7f163006a670 2023-07-06T01:11:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504618039 0 0) 0x7f16300cf920 con 0x7f163015c790 2023-07-06T01:11:08.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16300cf6d0 con 0x7f163015c790 2023-07-06T01:11:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 208880746 0 0) 0x7f16180035b0 con 0x7f163006a670 2023-07-06T01:11:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 >> v2:172.21.15.194:3300/0 conn(0x7f16300cf2b0 msgr2=0x7f16300d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 --2- 172.21.15.71:0/66618604 >> v2:172.21.15.194:3300/0 conn(0x7f16300cf2b0 0x7f16300d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 >> v1:172.21.15.194:6789/0 conn(0x7f163015c790 legacy=0x7f1630069f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630070a50 con 0x7f163006a670 2023-07-06T01:11:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 78810694 0 0) 0x7f1624001670 con 0x7f163006a670 2023-07-06T01:11:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 >> v1:172.21.15.71:6789/0 conn(0x7f163006a670 legacy=0x7f16300cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618003be0 0x7f1618003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1618004850 0x7f1618004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f161800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16300ca500 con 0x7f1618005250 2023-07-06T01:11:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161800c160 con 0x7f1618003be0 2023-07-06T01:11:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161800c320 con 0x7f1618004850 2023-07-06T01:11:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162f7fe700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f161800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162effd700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618003be0 0x7f1618003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.971+0000 7f162e7fc700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1618004850 0x7f1618004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 -- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1618004850 msgr2=0x7f1618004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1618004850 0x7f1618004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 -- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618003be0 msgr2=0x7f1618003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T01:11:08.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1618003be0 0x7f1618003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 -- 172.21.15.71:0/66618604 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16180035b0 con 0x7f1618005250 2023-07-06T01:11:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 -- 172.21.15.71:0/66618604 reap_dead start 2023-07-06T01:11:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162f7fe700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f161800ba10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1628009f90 tx=0x7f1618005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e229641c9189a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628003a20 con 0x7f1618005250 2023-07-06T01:11:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f162800f040 con 0x7f1618005250 2023-07-06T01:11:08.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.972+0000 7f162dffb700 1 -- 172.21.15.71:0/66618604 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628003de0 con 0x7f1618005250 2023-07-06T01:11:08.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 -- 172.21.15.71:0/66618604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 msgr2=0x7f161800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f161800ba10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1628009f90 tx=0x7f1618005880 comp rx=0 tx=0).stop 2023-07-06T01:11:08.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 -- 172.21.15.71:0/66618604 shutdown_connections 2023-07-06T01:11:08.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 --2- 172.21.15.71:0/66618604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f161800ba10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 -- 172.21.15.71:0/66618604 >> 172.21.15.71:0/66618604 conn(0x7f16300b22f0 msgr2=0x7f16300cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:11:08.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 -- 172.21.15.71:0/66618604 shutdown_connections 2023-07-06T01:11:08.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.973+0000 7f16355ff700 1 -- 172.21.15.71:0/66618604 wait complete. 2023-07-06T01:11:08.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.974+0000 7f16355ff700 1 Processor -- start 2023-07-06T01:11:08.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 -- start start 2023-07-06T01:11:08.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f16301f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16300b4150 0x7f16300b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16300ae040 0x7f16300ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163015e540 con 0x7f1618005250 2023-07-06T01:11:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16300aea20 con 0x7f16300b4150 2023-07-06T01:11:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.975+0000 7f16355ff700 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163015d8c0 con 0x7f16300ae040 2023-07-06T01:11:08.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f16301f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f16301f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50974/0 (socket says 172.21.15.71:50974) 2023-07-06T01:11:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 -- 172.21.15.71:0/2016820933 learned_addr learned my addr 172.21.15.71:0/2016820933 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-07-06T01:11:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162f7fe700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16300ae040 0x7f16300ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 -- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16300ae040 msgr2=0x7f16300ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162e7fc700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16300b4150 0x7f16300b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16300ae040 0x7f16300ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 -- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16300b4150 msgr2=0x7f16300b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16300b4150 0x7f16300b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 -- 172.21.15.71:0/2016820933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163015dba0 con 0x7f1618005250 2023-07-06T01:11:08.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162f7fe700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16300ae040 0x7f16300ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T01:11:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f162effd700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f16301f16b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f162000f770 tx=0x7f162000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620005320 con 0x7f1618005250 2023-07-06T01:11:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.976+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16200054a0 con 0x7f1618005250 2023-07-06T01:11:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.977+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163015de80 con 0x7f1618005250 2023-07-06T01:11:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.977+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620006ac0 con 0x7f1618005250 2023-07-06T01:11:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.977+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163015d570 con 0x7f1618005250 2023-07-06T01:11:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.978+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163015e860 con 0x7f1618005250 2023-07-06T01:11:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.979+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1620006c20 con 0x7f1618005250 2023-07-06T01:11:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.979+0000 7f16177fe700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f161c06ad10 0x7f161c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T01:11:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.979+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f1620088840 con 0x7f1618005250 2023-07-06T01:11:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.980+0000 7f162e7fc700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f161c06ad10 0x7f161c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T01:11:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.981+0000 7f162e7fc700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f161c06ad10 0x7f161c06d1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f163015c030 tx=0x7f1624001570 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T01:11:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:08.984+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1620053ae0 con 0x7f1618005250 2023-07-06T01:11:09.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.223+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16300008d0 con 0x7f1618005250 2023-07-06T01:11:09.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.223+0000 7f16177fe700 1 -- 172.21.15.71:0/2016820933 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f162001a090 con 0x7f1618005250 2023-07-06T01:11:09.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-07-06T01:11:09.227 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6834/2665489009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2665489009},{"type":"v1","addr":"172.21.15.71:6834","nonce":2665489009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5008,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6836/3301139684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3301139684},{"type":"v1","addr":"172.21.15.194:6836","nonce":3301139684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5139,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/2676926154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6835","nonce":2676926154},{"type":"v1","addr":"172.21.15.194:6837","nonce":2676926154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/780464406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6833","nonce":780464406},{"type":"v1","addr":"172.21.15.71:6835","nonce":780464406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-07-06T01:11:09.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f161c06ad10 msgr2=0x7f161c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:09.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f161c06ad10 0x7f161c06d1c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f163015c030 tx=0x7f1624001570 comp rx=0 tx=0).stop 2023-07-06T01:11:09.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 msgr2=0x7f16301f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T01:11:09.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f16301f16b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f162000f770 tx=0x7f162000fb30 comp rx=0 tx=0).stop 2023-07-06T01:11:09.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 shutdown_connections 2023-07-06T01:11:09.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:6832/3257045375,v1:172.21.15.194:6833/3257045375] conn(0x7f161c06ad10 0x7f161c06d1c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:09.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16300ae040 0x7f16300ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:09.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1618005250 0x7f16301f16b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:09.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 --2- 172.21.15.71:0/2016820933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16300b4150 0x7f16300b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T01:11:09.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 >> 172.21.15.71:0/2016820933 conn(0x7f16300b22f0 msgr2=0x7f16300afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T01:11:09.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 shutdown_connections 2023-07-06T01:11:09.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-07-06T01:11:09.226+0000 7f16355ff700 1 -- 172.21.15.71:0/2016820933 wait complete. 2023-07-06T01:11:09.232 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 18 2023-07-06T01:11:09.246 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-06T01:11:09.246 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-06T01:11:09.247 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T01:11:09.247 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.260 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T01:11:09.261 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T01:11:09.261 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.314 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T01:11:09.314 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T01:11:09.315 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.331 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T01:11:09.332 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T01:11:09.332 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.387 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T01:11:09.388 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-06T01:11:09.389 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-06T01:11:09.389 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.432 INFO:tasks.ceph.osd.0:Stopped 2023-07-06T01:11:09.433 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-06T01:11:09.433 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.474 INFO:tasks.ceph.osd.1:Stopped 2023-07-06T01:11:09.474 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-06T01:11:09.475 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.520 INFO:tasks.ceph.osd.2:Stopped 2023-07-06T01:11:09.521 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-06T01:11:09.522 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.565 INFO:tasks.ceph.osd.3:Stopped 2023-07-06T01:11:09.566 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-06T01:11:09.567 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.608 INFO:tasks.ceph.osd.4:Stopped 2023-07-06T01:11:09.609 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-06T01:11:09.609 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.654 INFO:tasks.ceph.osd.5:Stopped 2023-07-06T01:11:09.655 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-06T01:11:09.655 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.698 INFO:tasks.ceph.osd.6:Stopped 2023-07-06T01:11:09.699 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-06T01:11:09.699 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.743 INFO:tasks.ceph.osd.7:Stopped 2023-07-06T01:11:09.744 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-06T01:11:09.744 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-06T01:11:09.745 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.800 INFO:tasks.ceph.mgr.y:Stopped 2023-07-06T01:11:09.801 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-06T01:11:09.802 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.864 INFO:tasks.ceph.mgr.x:Stopped 2023-07-06T01:11:09.865 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-06T01:11:09.865 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-06T01:11:09.865 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.885 INFO:tasks.ceph.mon.a:Stopped 2023-07-06T01:11:09.885 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-06T01:11:09.886 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.903 INFO:tasks.ceph.mon.b:Stopped 2023-07-06T01:11:09.903 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-06T01:11:09.904 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T01:11:09.961 INFO:tasks.ceph.mon.c:Stopped 2023-07-06T01:11:09.962 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-06T01:11:09.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-06T01:11:10.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:11:10.042 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-06T01:11:10.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:11:10.374 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-06T01:11:10.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:11:10.582 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-06T01:11:10.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:11:10.785 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-06T01:11:10.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:11:10.971 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-06T01:11:11.507 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:11:11.508 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-06T01:11:11.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:11:11.701 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-06T01:11:11.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:11:11.911 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-06T01:11:12.103 INFO:tasks.ceph:Archiving mon data... 2023-07-06T01:11:12.105 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/data/mon.a.tgz 2023-07-06T01:11:12.105 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-07-06T01:11:12.155 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.KH6BZQP0nr 2023-07-06T01:11:12.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KH6BZQP0nr 2023-07-06T01:11:12.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.KH6BZQP0nr 2023-07-06T01:11:12.418 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.KH6BZQP0nr is 297KB 2023-07-06T01:11:12.512 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.KH6BZQP0nr 2023-07-06T01:11:12.557 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/data/mon.b.tgz 2023-07-06T01:11:12.558 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-07-06T01:11:12.603 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.B2OIJjDel6 2023-07-06T01:11:12.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.B2OIJjDel6 2023-07-06T01:11:12.770 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.B2OIJjDel6 2023-07-06T01:11:12.887 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.B2OIJjDel6 is 396KB 2023-07-06T01:11:12.983 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.B2OIJjDel6 2023-07-06T01:11:13.027 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/data/mon.c.tgz 2023-07-06T01:11:13.028 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-07-06T01:11:13.111 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.1bPhBJCxWV 2023-07-06T01:11:13.112 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1bPhBJCxWV 2023-07-06T01:11:13.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.1bPhBJCxWV 2023-07-06T01:11:13.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:13.361 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:13.413 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.1bPhBJCxWV is 396KB 2023-07-06T01:11:13.511 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.1bPhBJCxWV 2023-07-06T01:11:13.556 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-06T01:11:13.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-06T01:11:13.562 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-06T01:11:13.665 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-06T01:11:13.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-06T01:11:13.670 DEBUG:teuthology.orchestra.run.smithi194:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-06T01:11:13.741 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-06T01:11:13.747 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-06T01:11:13.763 INFO:tasks.ceph:Archiving crash dumps... 2023-07-06T01:11:13.765 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/remote/smithi071/crash 2023-07-06T01:11:13.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-06T01:11:13.834 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/remote/smithi194/crash 2023-07-06T01:11:13.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-06T01:11:13.902 INFO:tasks.ceph:Shutting down logrotate 2023-07-06T01:11:13.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:13.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:13.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:14.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-06T01:11:14.133 INFO:tasks.ceph:Compressing logs... 2023-07-06T01:11:14.134 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-06T01:11:14.138 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-06T01:11:14.201 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128898.log 2023-07-06T01:11:14.202 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120452.log 2023-07-06T01:11:14.203 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120459.log 2023-07-06T01:11:14.203 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128898.log.gz 2023-07-06T01:11:14.204 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123540.log 2023-07-06T01:11:14.204 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120452.log.gz 2023-07-06T01:11:14.205 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120459.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120459.log.gz 2023-07-06T01:11:14.205 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127117.log 2023-07-06T01:11:14.206 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128135.log 2023-07-06T01:11:14.206 INFO:teuthology.orchestra.run.smithi071.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.123540.log.gz 2023-07-06T01:11:14.207 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-06T01:11:14.207 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126634.log 2023-07-06T01:11:14.207 INFO:teuthology.orchestra.run.smithi071.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127117.log.gz 2023-07-06T01:11:14.208 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111980.log 2023-07-06T01:11:14.209 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.120715.log 2023-07-06T01:11:14.209 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127315.log 2023-07-06T01:11:14.210 INFO:teuthology.orchestra.run.smithi071.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.128135.log.gz 2023-07-06T01:11:14.210 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126634.log.gz 2023-07-06T01:11:14.210 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124468.log 2023-07-06T01:11:14.211 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127315.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127315.log.gz 2023-07-06T01:11:14.212 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129466.log 2023-07-06T01:11:14.212 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124468.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124468.log.gz 2023-07-06T01:11:14.212 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125781.log 2023-07-06T01:11:14.213 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.111980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112187.log 2023-07-06T01:11:14.213 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111980.log.gz 2023-07-06T01:11:14.213 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.1.120715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.120715.log.gz 2023-07-06T01:11:14.213 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-06T01:11:14.214 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.112187.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112187.log.gz 2023-07-06T01:11:14.214 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112285.log 2023-07-06T01:11:14.214 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112138.log 2023-07-06T01:11:14.215 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.112285.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112285.log.gz 2023-07-06T01:11:14.216 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-06T01:11:14.216 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112030.log 2023-07-06T01:11:14.216 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.112138.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112138.log.gz 2023-07-06T01:11:14.216 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.119863.log 2023-07-06T01:11:14.218 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130220.log 2023-07-06T01:11:14.218 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129466.log.gz 2023-07-06T01:11:14.218 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121065.log 2023-07-06T01:11:14.218 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125781.log.gz 2023-07-06T01:11:14.219 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130220.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130220.log.gz 2023-07-06T01:11:14.219 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131521.log 2023-07-06T01:11:14.219 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119251.log 2023-07-06T01:11:14.219 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121065.log.gz 2023-07-06T01:11:14.219 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131521.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131521.log.gz 2023-07-06T01:11:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127939.log 2023-07-06T01:11:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119251.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119251.log.gz 2023-07-06T01:11:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125585.log 2023-07-06T01:11:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127939.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127939.log.gz 2023-07-06T01:11:14.220 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124810.log 2023-07-06T01:11:14.223 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.112030.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112030.log.gz 2023-07-06T01:11:14.223 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.119176.log 2023-07-06T01:11:14.224 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.3.119863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.119863.log.gz 2023-07-06T01:11:14.224 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-06T01:11:14.224 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.1.119176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.119176.log.gz 2023-07-06T01:11:14.224 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-06T01:11:14.224 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112235.log 2023-07-06T01:11:14.225 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-06T01:11:14.225 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.112235.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112235.log.gz 2023-07-06T01:11:14.225 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111931.log 2023-07-06T01:11:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125585.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.125585.log.gz 2023-07-06T01:11:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128468.log 2023-07-06T01:11:14.227 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124810.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124810.log.gz 2023-07-06T01:11:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123689.log 2023-07-06T01:11:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.128468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128468.log.gz 2023-07-06T01:11:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117949.log 2023-07-06T01:11:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123689.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123689.log.gz 2023-07-06T01:11:14.228 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118759.log 2023-07-06T01:11:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117949.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117949.log.gz 2023-07-06T01:11:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129564.log 2023-07-06T01:11:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118759.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118759.log.gz 2023-07-06T01:11:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118908.log 2023-07-06T01:11:14.229 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129564.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129564.log.gz 2023-07-06T01:11:14.230 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130171.log 2023-07-06T01:11:14.230 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118908.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118908.log.gz 2023-07-06T01:11:14.230 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127068.log 2023-07-06T01:11:14.230 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130171.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130171.log.gz 2023-07-06T01:11:14.230 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122470.log 2023-07-06T01:11:14.231 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-06T01:11:14.231 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.111931.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111931.log.gz 2023-07-06T01:11:14.231 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-06T01:11:14.232 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-06T01:11:14.233 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-06T01:11:14.233 INFO:teuthology.orchestra.run.smithi194.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-06T01:11:14.233 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-06T01:11:14.233 INFO:teuthology.orchestra.run.smithi194.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-06T01:11:14.234 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-06T01:11:14.234 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-06T01:11:14.236 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127068.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127068.log.gz 2023-07-06T01:11:14.236 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123344.log 2023-07-06T01:11:14.236 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.122470.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122470.log.gz 2023-07-06T01:11:14.236 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124713.log 2023-07-06T01:11:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123344.log: gzip -5 --verbose -- 89.6%/var/log/ceph/ceph-client.admin.118404.log -- replaced with /var/log/ceph/ceph-client.admin.123344.log.gz 2023-07-06T01:11:14.237 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-07-06T01:11:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124713.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.124713.log.gz 2023-07-06T01:11:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128849.log 2023-07-06T01:11:14.237 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118404.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118404.log.gz 2023-07-06T01:11:14.238 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124615.log 2023-07-06T01:11:14.238 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128849.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128849.log.gz 2023-07-06T01:11:14.238 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121212.log 2023-07-06T01:11:14.238 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124615.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124615.log.gz 2023-07-06T01:11:14.238 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123640.log 2023-07-06T01:11:14.239 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121212.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121212.log.gz 2023-07-06T01:11:14.239 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131325.log 2023-07-06T01:11:14.239 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123640.log.gz 2023-07-06T01:11:14.239 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123295.log 2023-07-06T01:11:14.240 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112081.log 2023-07-06T01:11:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131325.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131325.log.gz 2023-07-06T01:11:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118305.log 2023-07-06T01:11:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123295.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123295.log.gz 2023-07-06T01:11:14.242 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130122.log 2023-07-06T01:11:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118305.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118305.log.gz 2023-07-06T01:11:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125683.log 2023-07-06T01:11:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130122.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130122.log.gz 2023-07-06T01:11:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130664.log 2023-07-06T01:11:14.243 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125683.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125683.log.gz 2023-07-06T01:11:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124908.log 2023-07-06T01:11:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130664.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.130664.log.gz 2023-07-06T01:11:14.244 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124032.log 2023-07-06T01:11:14.245 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.112081.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112081.log.gz 2023-07-06T01:11:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124908.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124908.log.gz 2023-07-06T01:11:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120722.log 2023-07-06T01:11:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124032.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.124032.log.gz 2023-07-06T01:11:14.246 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-06T01:11:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120722.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120722.log.gz 2023-07-06T01:11:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129907.log 2023-07-06T01:11:14.247 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124326.log 2023-07-06T01:11:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129907.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.129907.log.gz 2023-07-06T01:11:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123442.log 2023-07-06T01:11:14.248 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130713.log 2023-07-06T01:11:14.249 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124326.log.gz 2023-07-06T01:11:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123442.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123442.log.gz 2023-07-06T01:11:14.249 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119055.log 2023-07-06T01:11:14.250 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130713.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130713.log.gz 2023-07-06T01:11:14.250 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130005.log 2023-07-06T01:11:14.251 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119055.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119055.log.gz 2023-07-06T01:11:14.251 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126320.log 2023-07-06T01:11:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130005.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130005.log.gz 2023-07-06T01:11:14.252 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127472.log 2023-07-06T01:11:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126320.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126320.log.gz 2023-07-06T01:11:14.253 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131667.log 2023-07-06T01:11:14.254 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127472.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127472.log.gz 2023-07-06T01:11:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120361.log 2023-07-06T01:11:14.255 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.131667.log.gz 2023-07-06T01:11:14.256 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-06T01:11:14.257 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120361.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120361.log.gz 2023-07-06T01:11:14.257 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120771.log 2023-07-06T01:11:14.258 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126486.log 2023-07-06T01:11:14.259 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120771.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120771.log.gz 2023-07-06T01:11:14.259 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131423.log 2023-07-06T01:11:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126486.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126486.log.gz 2023-07-06T01:11:14.260 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119104.log 2023-07-06T01:11:14.261 INFO:teuthology.orchestra.run.smithi071.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-06T01:11:14.262 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131423.log.gz 2023-07-06T01:11:14.262 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120967.log 2023-07-06T01:11:14.263 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130811.log 2023-07-06T01:11:14.263 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119104.log.gz 2023-07-06T01:11:14.263 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120967.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120967.log.gz 2023-07-06T01:11:14.264 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123983.log 2023-07-06T01:11:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130811.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130811.log.gz 2023-07-06T01:11:14.265 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121310.log 2023-07-06T01:11:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123983.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123983.log.gz 2023-07-06T01:11:14.266 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130072.log 2023-07-06T01:11:14.267 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121310.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121310.log.gz 2023-07-06T01:11:14.267 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119677.log 2023-07-06T01:11:14.268 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130072.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130072.log.gz 2023-07-06T01:11:14.268 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123787.log 2023-07-06T01:11:14.269 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-06T01:11:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119677.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119677.log.gz 2023-07-06T01:11:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128947.log 2023-07-06T01:11:14.270 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123787.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123787.log.gz 2023-07-06T01:11:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126124.log 2023-07-06T01:11:14.271 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128947.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128947.log.gz 2023-07-06T01:11:14.272 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124664.log 2023-07-06T01:11:14.272 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126124.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126124.log.gz 2023-07-06T01:11:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125732.log 2023-07-06T01:11:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124664.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124664.log.gz 2023-07-06T01:11:14.273 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118857.log 2023-07-06T01:11:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125732.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125732.log.gz 2023-07-06T01:11:14.274 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131472.log 2023-07-06T01:11:14.275 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125079.log 2023-07-06T01:11:14.276 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118857.log.gz 2023-07-06T01:11:14.276 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131472.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131472.log.gz 2023-07-06T01:11:14.276 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129045.log 2023-07-06T01:11:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125079.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125079.log.gz 2023-07-06T01:11:14.277 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-06T01:11:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129045.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129045.log.gz 2023-07-06T01:11:14.278 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120463.log 2023-07-06T01:11:14.279 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120673.log 2023-07-06T01:11:14.280 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120463.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120463.log.gz 2023-07-06T01:11:14.281 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-06T01:11:14.281 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119679.log 2023-07-06T01:11:14.282 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125634.log 2023-07-06T01:11:14.282 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120673.log.gz 2023-07-06T01:11:14.283 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118502.log 2023-07-06T01:11:14.283 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119679.log.gz 2023-07-06T01:11:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125634.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125634.log.gz 2023-07-06T01:11:14.284 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126921.log 2023-07-06T01:11:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118502.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.118502.log.gz 2023-07-06T01:11:14.285 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125439.log 2023-07-06T01:11:14.286 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126921.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126921.log.gz 2023-07-06T01:11:14.286 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123188.log 2023-07-06T01:11:14.287 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125439.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125439.log.gz 2023-07-06T01:11:14.287 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126872.log 2023-07-06T01:11:14.288 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123188.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123188.log.gz 2023-07-06T01:11:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129515.log 2023-07-06T01:11:14.289 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126872.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126872.log.gzgzip 2023-07-06T01:11:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.121481.log 2023-07-06T01:11:14.290 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129515.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129515.log.gz 2023-07-06T01:11:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127264.log 2023-07-06T01:11:14.291 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121481.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121481.log.gz 2023-07-06T01:11:14.292 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125292.log 2023-07-06T01:11:14.293 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127264.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127264.log.gz 2023-07-06T01:11:14.293 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120062.log 2023-07-06T01:11:14.294 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125292.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125292.log.gz 2023-07-06T01:11:14.294 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126173.log 2023-07-06T01:11:14.295 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120062.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120062.log.gz 2023-07-06T01:11:14.295 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118355.log 2023-07-06T01:11:14.296 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131276.log 2023-07-06T01:11:14.296 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126173.log.gz 2023-07-06T01:11:14.297 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118355.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118355.log.gz-5 2023-07-06T01:11:14.297 INFO:teuthology.orchestra.run.smithi071.stderr:--verbose -- /var/log/ceph/ceph-client.admin.111830.log 2023-07-06T01:11:14.298 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131276.log: gzip 88.4%-5 -- replaced with /var/log/ceph/ceph-client.admin.131276.log.gz--verbose 2023-07-06T01:11:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.118808.log 2023-07-06T01:11:14.299 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.111830.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111830.log.gz 2023-07-06T01:11:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-06T01:11:14.300 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118808.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118808.log.gz 2023-07-06T01:11:14.301 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131374.log 2023-07-06T01:11:14.303 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120457.log 2023-07-06T01:11:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131374.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.131374.log.gz 2023-07-06T01:11:14.306 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125194.log 2023-07-06T01:11:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119202.log 2023-07-06T01:11:14.307 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120457.log.gz 2023-07-06T01:11:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125194.log.gz 2023-07-06T01:11:14.307 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124228.log 2023-07-06T01:11:14.310 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119202.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119202.log.gzgzip 2023-07-06T01:11:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.119448.log 2023-07-06T01:11:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124228.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124228.log.gz 2023-07-06T01:11:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126369.log 2023-07-06T01:11:14.311 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131227.log 2023-07-06T01:11:14.311 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119448.log.gz 2023-07-06T01:11:14.312 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126369.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126369.log.gz 2023-07-06T01:11:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-06T01:11:14.313 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130517.log 2023-07-06T01:11:14.313 INFO:teuthology.orchestra.run.smithi071.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131227.log.gz 2023-07-06T01:11:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120066.log 2023-07-06T01:11:14.314 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130517.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130517.log.gz 2023-07-06T01:11:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120054.log 2023-07-06T01:11:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130933.log 2023-07-06T01:11:14.316 INFO:teuthology.orchestra.run.smithi071.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120066.log.gz 2023-07-06T01:11:14.316 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120054.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120054.log.gz 2023-07-06T01:11:14.317 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119678.log 2023-07-06T01:11:14.317 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-06T01:11:14.318 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130933.log.gz 2023-07-06T01:11:14.319 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121408.log 2023-07-06T01:11:14.319 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119678.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119678.log.gz 2023-07-06T01:11:14.320 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130566.log 2023-07-06T01:11:14.321 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127019.log 2023-07-06T01:11:14.322 INFO:teuthology.orchestra.run.smithi071.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.121408.log.gz 2023-07-06T01:11:14.322 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130566.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130566.log.gz 2023-07-06T01:11:14.323 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120820.log 2023-07-06T01:11:14.324 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127719.log 2023-07-06T01:11:14.324 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127019.log.gz 2023-07-06T01:11:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120820.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120820.log.gz 2023-07-06T01:11:14.328 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119664.log 2023-07-06T01:11:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127719.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127719.log.gz 2023-07-06T01:11:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130982.log 2023-07-06T01:11:14.329 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119664.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119664.log.gz 2023-07-06T01:11:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125830.log 2023-07-06T01:11:14.330 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130982.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130982.log.gz 2023-07-06T01:11:14.331 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121359.log 2023-07-06T01:11:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128800.log 2023-07-06T01:11:14.332 INFO:teuthology.orchestra.run.smithi071.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125830.log.gz 2023-07-06T01:11:14.332 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121359.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121359.log.gz 2023-07-06T01:11:14.333 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123836.log 2023-07-06T01:11:14.334 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118069.log 2023-07-06T01:11:14.335 INFO:teuthology.orchestra.run.smithi071.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128800.log.gz 2023-07-06T01:11:14.335 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123836.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123836.log.gz 2023-07-06T01:11:14.336 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129613.log 2023-07-06T01:11:14.336 INFO:teuthology.orchestra.run.smithi194.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-06T01:11:14.337 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124277.log 2023-07-06T01:11:14.338 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118069.log.gz 2023-07-06T01:11:14.338 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129613.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129613.log.gz 2023-07-06T01:11:14.339 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118651.log 2023-07-06T01:11:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124277.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124277.log.gz 2023-07-06T01:11:14.340 INFO:teuthology.orchestra.run.smithi071.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-06T01:11:14.340 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119661.log 2023-07-06T01:11:14.341 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118651.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118651.log.gz 2023-07-06T01:11:14.342 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125928.log 2023-07-06T01:11:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119661.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.119661.log.gz--verbose 2023-07-06T01:11:14.343 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.123738.log 2023-07-06T01:11:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125928.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125928.log.gz 2023-07-06T01:11:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124081.log 2023-07-06T01:11:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123738.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123738.log.gz 2023-07-06T01:11:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124957.log 2023-07-06T01:11:14.346 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124081.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124081.log.gz 2023-07-06T01:11:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124130.log 2023-07-06T01:11:14.347 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124957.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124957.log.gz 2023-07-06T01:11:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127215.log 2023-07-06T01:11:14.348 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112305.log 2023-07-06T01:11:14.349 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124130.log.gz 2023-07-06T01:11:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127215.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127215.log.gz 2023-07-06T01:11:14.350 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129142.log 2023-07-06T01:11:14.351 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129346.log 2023-07-06T01:11:14.351 INFO:teuthology.orchestra.run.smithi071.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112305.log.gz 2023-07-06T01:11:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129142.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129142.log.gz 2023-07-06T01:11:14.352 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130860.log 2023-07-06T01:11:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130762.log 2023-07-06T01:11:14.353 INFO:teuthology.orchestra.run.smithi071.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129346.log.gz 2023-07-06T01:11:14.354 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130860.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130860.log.gz 2023-07-06T01:11:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131618.log 2023-07-06T01:11:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120461.log 2023-07-06T01:11:14.356 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130762.log.gz 2023-07-06T01:11:14.357 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-06T01:11:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131618.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131618.log.gz 2023-07-06T01:11:14.357 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123393.log 2023-07-06T01:11:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120461.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120461.log.gz 2023-07-06T01:11:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126970.log 2023-07-06T01:11:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123393.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123393.log.gz 2023-07-06T01:11:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129395.log 2023-07-06T01:11:14.360 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120458.log 2023-07-06T01:11:14.360 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126970.log.gz 2023-07-06T01:11:14.361 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129395.log.gz 2023-07-06T01:11:14.362 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127817.log 2023-07-06T01:11:14.362 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-06T01:11:14.363 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120458.log: gzip -5 87.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.120458.log.gz/var/log/ceph/ceph-client.admin.129297.log 2023-07-06T01:11:14.363 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-07-06T01:11:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127817.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.127817.log.gz 2023-07-06T01:11:14.364 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131080.log 2023-07-06T01:11:14.365 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129297.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129297.log.gz 2023-07-06T01:11:14.365 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129248.log 2023-07-06T01:11:14.366 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131080.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131080.log.gz 2023-07-06T01:11:14.366 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127988.log 2023-07-06T01:11:14.367 INFO:teuthology.orchestra.run.smithi194.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-06T01:11:14.367 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119665.log 2023-07-06T01:11:14.368 INFO:teuthology.orchestra.run.smithi071.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129248.log.gz 2023-07-06T01:11:14.368 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127988.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.127988.log.gz 2023-07-06T01:11:14.369 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125879.log 2023-07-06T01:11:14.369 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120071.log 2023-07-06T01:11:14.369 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119665.log.gz 2023-07-06T01:11:14.370 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125879.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125879.log.gz 2023-07-06T01:11:14.371 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131129.log 2023-07-06T01:11:14.371 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129191.log 2023-07-06T01:11:14.372 INFO:teuthology.orchestra.run.smithi071.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120071.log.gz 2023-07-06T01:11:14.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131129.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131129.log.gz 2023-07-06T01:11:14.373 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127768.log 2023-07-06T01:11:14.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120918.log 2023-07-06T01:11:14.374 INFO:teuthology.orchestra.run.smithi071.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129191.log.gz 2023-07-06T01:11:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127768.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127768.log.gz 2023-07-06T01:11:14.375 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129662.log 2023-07-06T01:11:14.376 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120918.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.105323.log 2023-07-06T01:11:14.376 INFO:teuthology.orchestra.run.smithi071.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120918.log.gz 2023-07-06T01:11:14.377 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129662.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.129662.log.gz 2023-07-06T01:11:14.378 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119300.log 2023-07-06T01:11:14.378 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-06T01:11:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.105323.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.105323.log.gz 2023-07-06T01:11:14.379 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128208.log 2023-07-06T01:11:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119300.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119300.log.gz 2023-07-06T01:11:14.380 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121261.log 2023-07-06T01:11:14.381 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128208.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128208.log.gz 2023-07-06T01:11:14.381 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119153.log 2023-07-06T01:11:14.382 INFO:teuthology.orchestra.run.smithi194.stderr: 2023-07-06T01:11:14.382 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m0.201s 2023-07-06T01:11:14.382 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m0.767s 2023-07-06T01:11:14.383 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.167s 2023-07-06T01:11:14.383 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121261.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121261.log.gz 2023-07-06T01:11:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129760.log 2023-07-06T01:11:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119153.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119153.log.gz 2023-07-06T01:11:14.384 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118168.log 2023-07-06T01:11:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129760.log.gz 2023-07-06T01:11:14.385 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126026.log 2023-07-06T01:11:14.386 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118168.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118168.log.gz 2023-07-06T01:11:14.386 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118702.log 2023-07-06T01:11:14.387 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126026.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126026.log.gz 2023-07-06T01:11:14.387 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126535.log 2023-07-06T01:11:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118702.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118702.log.gz 2023-07-06T01:11:14.388 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-06T01:11:14.389 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126535.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126535.log.gz 2023-07-06T01:11:14.390 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-06T01:11:14.391 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124179.log 2023-07-06T01:11:14.391 INFO:teuthology.orchestra.run.smithi071.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-06T01:11:14.392 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121114.log 2023-07-06T01:11:14.393 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124179.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124179.log.gz 2023-07-06T01:11:14.393 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118020.log 2023-07-06T01:11:14.395 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127670.log 2023-07-06T01:11:14.395 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121114.log.gz 2023-07-06T01:11:14.395 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118020.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118020.log.gz 2023-07-06T01:11:14.396 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120068.log 2023-07-06T01:11:14.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119398.log 2023-07-06T01:11:14.397 INFO:teuthology.orchestra.run.smithi071.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127670.log.gz 2023-07-06T01:11:14.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120068.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120068.log.gz 2023-07-06T01:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126721.log 2023-07-06T01:11:14.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119398.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119398.log.gz 2023-07-06T01:11:14.400 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129711.log 2023-07-06T01:11:14.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127366.log 2023-07-06T01:11:14.402 INFO:teuthology.orchestra.run.smithi071.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126721.log.gz 2023-07-06T01:11:14.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129711.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129711.log.gz 2023-07-06T01:11:14.403 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120065.log 2023-07-06T01:11:14.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127366.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.127366.log.gz 2023-07-06T01:11:14.405 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121699.log 2023-07-06T01:11:14.405 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120065.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120065.log.gz 2023-07-06T01:11:14.406 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-06T01:11:14.407 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121699.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121699.log.gz 2023-07-06T01:11:14.407 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.122943.log 2023-07-06T01:11:14.409 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128588.log 2023-07-06T01:11:14.410 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.2.122943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.122943.log.gz 2023-07-06T01:11:14.410 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125030.log 2023-07-06T01:11:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128588.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128588.log.gz 2023-07-06T01:11:14.412 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126772.log 2023-07-06T01:11:14.413 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125030.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125030.log.gz 2023-07-06T01:11:14.414 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126436.log 2023-07-06T01:11:14.415 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126772.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126772.log.gz 2023-07-06T01:11:14.415 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125341.log 2023-07-06T01:11:14.416 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126436.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126436.log.gz 2023-07-06T01:11:14.417 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126823.log 2023-07-06T01:11:14.418 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125341.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125341.log.gz 2023-07-06T01:11:14.418 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118256.log 2023-07-06T01:11:14.419 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126823.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.126823.log.gz 2023-07-06T01:11:14.420 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-06T01:11:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118256.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118256.log.gz 2023-07-06T01:11:14.421 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123885.log 2023-07-06T01:11:14.423 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124566.log 2023-07-06T01:11:14.423 INFO:teuthology.orchestra.run.smithi071.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-06T01:11:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123885.log.gz 2023-07-06T01:11:14.424 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118600.log 2023-07-06T01:11:14.426 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124566.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124566.log.gz 2023-07-06T01:11:14.426 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127523.log 2023-07-06T01:11:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118600.log.gz 2023-07-06T01:11:14.428 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128996.log 2023-07-06T01:11:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127523.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127523.log.gz 2023-07-06T01:11:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130269.log 2023-07-06T01:11:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128996.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128996.log.gz 2023-07-06T01:11:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131178.log 2023-07-06T01:11:14.431 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-06T01:11:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130269.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.130269.log.gz 2023-07-06T01:11:14.433 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124859.log 2023-07-06T01:11:14.434 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131178.log: 87.9% 93.7% -- replaced with /var/log/ceph/ceph-client.admin.131178.log.gz -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-06T01:11:14.434 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-07-06T01:11:14.436 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112177.log 2023-07-06T01:11:14.436 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124859.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124859.log.gz 2023-07-06T01:11:14.437 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123590.log 2023-07-06T01:11:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.112177.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112177.log.gz 2023-07-06T01:11:14.438 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129858.log 2023-07-06T01:11:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123590.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123590.log.gz 2023-07-06T01:11:14.439 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124517.log 2023-07-06T01:11:14.440 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129858.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129858.log.gz 2023-07-06T01:11:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122215.log 2023-07-06T01:11:14.441 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.124517.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124517.log.gz 2023-07-06T01:11:14.442 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123934.log 2023-07-06T01:11:14.442 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.122215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.122215.log.gz 2023-07-06T01:11:14.443 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125536.log 2023-07-06T01:11:14.444 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123934.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123934.log.gz 2023-07-06T01:11:14.444 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127890.log 2023-07-06T01:11:14.445 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125536.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125536.log.gz 2023-07-06T01:11:14.445 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120451.log 2023-07-06T01:11:14.446 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127890.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.127890.log.gz 2023-07-06T01:11:14.446 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119671.log 2023-07-06T01:11:14.447 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120451.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120451.log.gz 2023-07-06T01:11:14.447 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118453.log 2023-07-06T01:11:14.448 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119671.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119671.log.gz 2023-07-06T01:11:14.449 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131571.log 2023-07-06T01:11:14.449 INFO:teuthology.orchestra.run.smithi071.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118453.log.gz 2023-07-06T01:11:14.450 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129809.log 2023-07-06T01:11:14.451 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131571.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131571.log.gz 2023-07-06T01:11:14.451 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129956.log 2023-07-06T01:11:14.452 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129809.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.129809.log.gz 2023-07-06T01:11:14.452 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127572.log 2023-07-06T01:11:14.453 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.129956.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.129956.log.gz 2023-07-06T01:11:14.453 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120056.log 2023-07-06T01:11:14.454 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127572.log.gz 2023-07-06T01:11:14.454 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126222.log 2023-07-06T01:11:14.455 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117839.log 2023-07-06T01:11:14.456 INFO:teuthology.orchestra.run.smithi071.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120056.log.gz 2023-07-06T01:11:14.456 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126222.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126222.log.gz 2023-07-06T01:11:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119349.log 2023-07-06T01:11:14.457 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.117839.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117839.log.gz 2023-07-06T01:11:14.458 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125390.log 2023-07-06T01:11:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119349.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119349.log.gz 2023-07-06T01:11:14.459 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127423.log 2023-07-06T01:11:14.460 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125390.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125390.log.gz 2023-07-06T01:11:14.460 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123491.log 2023-07-06T01:11:14.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127423.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127423.log.gz 2023-07-06T01:11:14.461 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123237.log 2023-07-06T01:11:14.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123491.log.gz 2023-07-06T01:11:14.462 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125977.log 2023-07-06T01:11:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.123237.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123237.log.gz 2023-07-06T01:11:14.463 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118957.log 2023-07-06T01:11:14.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125977.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125977.log.gz 2023-07-06T01:11:14.465 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121163.log 2023-07-06T01:11:14.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118957.log: 88.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.118957.log.gz--verbose 2023-07-06T01:11:14.466 INFO:teuthology.orchestra.run.smithi071.stderr:-- /var/log/ceph/ceph-client.admin.126271.log 2023-07-06T01:11:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121163.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121163.log.gz 2023-07-06T01:11:14.467 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118551.log 2023-07-06T01:11:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126271.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126271.log.gz 2023-07-06T01:11:14.468 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126075.log 2023-07-06T01:11:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.118551.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118551.log.gz 2023-07-06T01:11:14.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127166.log 2023-07-06T01:11:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.126075.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.126075.log.gz 2023-07-06T01:11:14.470 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120067.log 2023-07-06T01:11:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127166.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127166.log.gz 2023-07-06T01:11:14.471 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127621.log 2023-07-06T01:11:14.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120067.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.120067.log.gz 2023-07-06T01:11:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-06T01:11:14.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.127621.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127621.log.gz 2023-07-06T01:11:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121016.log 2023-07-06T01:11:14.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130615.log 2023-07-06T01:11:14.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121016.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121016.log.gz 2023-07-06T01:11:14.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119006.log 2023-07-06T01:11:14.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.130615.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130615.log.gz 2023-07-06T01:11:14.477 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120869.log 2023-07-06T01:11:14.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131031.log 2023-07-06T01:11:14.479 INFO:teuthology.orchestra.run.smithi071.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.119006.log.gz 2023-07-06T01:11:14.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.120869.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120869.log.gz 2023-07-06T01:11:14.480 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128086.log 2023-07-06T01:11:14.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.131031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119675.log 2023-07-06T01:11:14.482 INFO:teuthology.orchestra.run.smithi071.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.131031.log.gz 2023-07-06T01:11:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128086.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128086.log.gz 2023-07-06T01:11:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128037.log 2023-07-06T01:11:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.119675.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.119675.log.gz 2023-07-06T01:11:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121530.log 2023-07-06T01:11:14.485 INFO:teuthology.orchestra.run.smithi071.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-06T01:11:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.128037.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128037.log.gz 2023-07-06T01:11:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125243.log 2023-07-06T01:11:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.121530.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.121530.log.gz 2023-07-06T01:11:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.125243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.125243.log.gz 2023-07-06T01:11:14.580 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-06T01:11:14.585 INFO:teuthology.orchestra.run.smithi071.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-06T01:11:14.588 INFO:teuthology.orchestra.run.smithi071.stderr: 2023-07-06T01:11:14.588 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m0.412s 2023-07-06T01:11:14.589 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m0.752s 2023-07-06T01:11:14.589 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.627s 2023-07-06T01:11:14.590 INFO:tasks.ceph:Archiving logs... 2023-07-06T01:11:14.590 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/remote/smithi071/log 2023-07-06T01:11:14.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-06T01:11:14.948 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/remote/smithi194/log 2023-07-06T01:11:14.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-06T01:11:15.129 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-06T01:11:15.150 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-06T01:11:15.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-06T01:11:15.156 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-06T01:11:15.282 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-06T01:11:15.297 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-06T01:11:15.297 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T01:11:15.302 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T01:11:15.341 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2023-07-06T01:11:15.345 INFO:teuthology.orchestra.run.smithi194.stderr:bash: ntpq: command not found 2023-07-06T01:11:15.348 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T01:11:15.349 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-07-06T01:11:15.349 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 -474us[ -474us] +/- 91ms 2023-07-06T01:11:15.349 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -503us[ -503us] +/- 52ms 2023-07-06T01:11:15.349 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv03.front.sepia.ceph.com 3 6 377 50 +1000us[+1006us] +/- 68ms 2023-07-06T01:11:15.349 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:11:15.352 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T01:11:15.353 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-07-06T01:11:15.353 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 50 -470us[ -465us] +/- 91ms 2023-07-06T01:11:15.353 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -507us[ -502us] +/- 52ms 2023-07-06T01:11:15.353 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv03.front.sepia.ceph.com 3 6 377 49 +997us[+1002us] +/- 68ms 2023-07-06T01:11:15.354 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T01:11:15.354 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-06T01:11:15.364 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-06T01:11:15.365 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-06T01:11:15.386 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-06T01:11:15.554 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-06T01:11:15.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T01:11:15.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:11:15.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T01:11:15.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:11:15.865 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-06T01:11:15.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-06T01:11:15.886 INFO:teuthology.task.internal:Duration was 982.114830 seconds 2023-07-06T01:11:15.886 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-06T01:11:15.902 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-06T01:11:15.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-06T01:11:15.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-06T01:11:16.018 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T01:11:16.022 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T01:11:16.328 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-06T01:11:16.329 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2023-07-06T01:11:16.329 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-06T01:11:16.391 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2023-07-06T01:11:16.391 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-06T01:11:16.452 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-06T01:11:16.453 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-06T01:11:16.458 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-06T01:11:16.541 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-06T01:11:16.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-06T01:11:16.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-06T01:11:16.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-06T01:11:16.671 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-06T01:11:16.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-06T01:11:16.740 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-06T01:11:16.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-06T01:11:16.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-06T01:11:16.825 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-06T01:11:16.888 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2023-07-06T01:11:16.892 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2023-07-06T01:11:16.925 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-06T01:11:16.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:11:16.969 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-06T01:11:17.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T01:11:17.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-06T01:11:17.024 INFO:teuthology.task.internal:Transferring archived files... 2023-07-06T01:11:17.025 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/remote/smithi071 2023-07-06T01:11:17.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-06T01:11:17.102 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779/remote/smithi194 2023-07-06T01:11:17.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-06T01:11:17.179 INFO:teuthology.task.internal:Removing archive directory... 2023-07-06T01:11:17.180 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-06T01:11:17.184 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-06T01:11:17.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-06T01:11:17.240 INFO:teuthology.task.internal:Not uploading archives. 2023-07-06T01:11:17.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-06T01:11:17.308 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-06T01:11:17.309 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-06T01:11:17.313 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-06T01:11:17.354 INFO:teuthology.orchestra.run.smithi071.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 6 01:11 /home/ubuntu/cephtest 2023-07-06T01:11:17.359 INFO:teuthology.orchestra.run.smithi194.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 6 01:11 /home/ubuntu/cephtest 2023-07-06T01:11:17.362 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-06T01:11:17.372 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-06T01:11:17.414 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T01:11:17.446 DEBUG:teuthology.nuke:shortname: smithi071 2023-07-06T01:11:17.446 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T01:11:17.475 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:44:57.431614', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh1FiUsm6UWjQTeRcXz5Gm5JfU5CUddCynwS0utyfFwmoR4cf9H1CosIW6mi51Z3OFzYDuyLg+kZEXQnHAe+xMfYkin0D52pWlBe2vtVtegKV6gSi2bPZZBdvK9dw+XKtteBSJnNTpnHvTJF2Yrrqgek11b7ah2tmHBhEdSHAj1Lff9kWDlUVvXtG2FCfEl37pLFx3XJ4lLEn6TGGszrRKjupnTZdCPtNbvf1n81p+PDOrGSGFrISjdKfoIELpSuJCWfoeVt5YALjj/KgD6YeYmJ9pU7baL1MDSVLtBCSwGDTU++Lk18aP3dkOGhQZtfLdDeCTbEMhschHkOBsXyjtab3c1tYMR3CaSssoTTUlQuZXuKjlKRgV4Le9Qfug+CzWXpRv7CUD/J+qufAOOFaA5NL/HtrjDWHJ4LsKXCj3gKefs0CfPpVvKCY8vg407f1FtUglSKisDdNeUrRT5N3LkNYX7SnhtuQPSqMa5LVQ6MyiX/jAvcD+h4NlbUhrSD0='} 2023-07-06T01:11:17.479 DEBUG:teuthology.nuke:shortname: smithi194 2023-07-06T01:11:17.479 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T01:11:17.503 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:44:57.434855', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDj5B0Sb4F/pfxtBCMrH5SFVfDCw3e5E78alRxLQitAg1KqDrFIra8rZ6nVmuYK2TrpQY3OnfmukqXMpeLB125bEAq3TGf6gWxwX7BRflCkJWEo2T18EYK8PKrcU2PJDga+4tQgIw1k2i6JbbtfPn54gYWDaNu6ON0m3Yaqs1qJ4wsLNmeVnzB39U9BxrxyTzG/W+9kjxC3ooaRCrc9V8l4kDJbQxXvXCuhjlKN40yMvaaupeV3AWoej876HFVczkrv8cXPicU3bv1linPy+XAwsfKPYE7QSj22Rj9KbG9EH8Hu+GN1WKFcK9LJN4vPpcGeIcnt13RYtfsUuQckfOG65pHn+wAjLx6adLuDL2G0zuDuGhNP+5wtlgZMFvb7JdfKr1iCtOeu4qVsmXZorH3SXd+eLwnH9O5x4Ytx2MSDyQ2qTxaHGppOJ0G2ST/SbacB+pWdccKDxhKf/Il6DuLTdHX4jYBnvRwqh56LpltlgQYwIdWPuCjawpJpKjuUEM='} 2023-07-06T01:11:17.535 INFO:teuthology.orchestra.console:Power off smithi071 2023-07-06T01:11:17.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T01:11:17.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:17.581 INFO:teuthology.orchestra.console:Power off smithi194 2023-07-06T01:11:17.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T01:11:17.606 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:21.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:21.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:25.710 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:25.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:25.957 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2023-07-06T01:11:29.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T01:11:30.041 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-07-06T01:11:30.147 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd client.1-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} duration: 982.1148300170898 failure_reason: 'Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2bc9edb05b9c4ecba6064bbe068519ba status: fail success: false 2023-07-06T01:11:30.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:11:30.249 INFO:teuthology.run:FAIL